starred/onyx
1
0 Fork 0
mirror of https://github.com/onyx-dot-app/onyx.git synced 2026-10-23 03:42:59 -05:00
Code Issues Packages Projects Releases 10 Wiki Activity
5,294 Commits 2,107 Branches 2,544 Tags
4e7adcc9eec647d7290f22ef3671776216ee89de
Commit Graph
51 Commits
Author SHA1 Message Date
Jamison Lahman 6bb00d2c6b chore(gha): run connector tests when uv.lock changes (#6768) 2025-12-16 18:44:06 +00:00
dependabot[bot] 749f720dfd chore(deps): Bump actions/checkout from 6.0.0 to 6.0.1 (#6734) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-12-15 18:32:05 +00:00
Wenxi eac79cfdf2 chore: disable coda tests temporarily until we fully configure (#6733) 2025-12-15 10:19:28 -08:00
Chris Weaver 43a3cb89b9 fix: env vars for tests (#6720) 2025-12-14 16:37:06 -08:00
Jamison Lahman 29b28c8352 chore(deployment): run tests on tag push (#6543) 2025-12-03 01:49:21 +00:00
Jamison Lahman 25522dfbb8 chore(gha): setup-python accepts requirements to install (#6463) 2025-11-26 17:27:30 -05:00
Jamison Lahman 8a6db7474d chore(gha): assert GHA jobs have timeouts (#6455) 2025-11-26 18:14:23 +00:00
dependabot[bot]andJamison Lahman d6fbb7affd chore(deps): Bump actions/checkout from 4.3.0 to 6.0.0 (#6410) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jamison Lahman <jamison@lahman.dev>
 2025-11-24 18:57:28 +00:00
Jamison Lahman b30d38c747 chore(gha): fix zizmor issues (#6344) 2025-11-19 23:57:34 +00:00
Jamison Lahman 482b2c4204 chore(gha): run uvx zizmor --fix=all (#6342) 2025-11-19 14:26:45 -08:00
Jamison Lahman 43ae02a870 chore(gha): remove custom cloudwatch metrics (#6202) 2025-11-13 00:12:13 +00:00
Jamison Lahman 14123926a7 chore(gha): final runs-on migration nits (#6170) 2025-11-12 23:00:25 +00:00
Jamison Lahman ac57b10240 chore(gha): ensure run-id is unique, fix hanging jobs (#6183) 2025-11-12 01:25:59 +00:00
Jamison Lahmanandgreptile-apps[bot] 76fc01968b chore(gha): de-dupe python setup for external dep tests (#6159) 
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
 2025-11-11 09:38:01 -08:00
Jamison Lahman 8b39d60bca chore(gha): migrate connectors-check to uv w/ caching (#6102) 2025-11-06 19:55:24 +00:00
Jamison Lahman 1e101f8028 chore(gha): pin workflow versions (#6058) 
## Description

SHAs are more secure than version tags.
 2025-11-05 13:29:58 -08:00
Wenxi 3026ac8912 feat: blob connector and test enhancements (#5746) 2025-10-17 13:52:03 -07:00
Wenxi c90ff701dc chore: move gh non-secrets to vars (#5744) 2025-10-16 16:42:24 -07:00
Evan Lohn c7e872d4e3 feat: selectively run sf and hubspot tests (#5657) 2025-10-08 10:25:00 -07:00
Evan Lohn 8c9a20be7a fix: atlassian scoped tokens (#5483) 2025-10-01 14:53:28 -07:00
Chris Weaver 189f4bb071 fix: add bitbucket env vars (#5510) 2025-09-26 12:38:59 -07:00
Raunak Bhagat e2d3d65c60 fix: Move around group-sync tests (since they require docker services to be running) (#5041) 
* Move around tests

* Add missing fixtures + change directory structure up some more

* Add env variables
 2025-07-17 22:41:31 +00:00
Raunak Bhagat 004e56a91b feat: IMAP connector (#4987) 
* Implement fetching; still need to work on document parsing

* Add basic skeleton of parsing email bodies

* Add id field

* Add email body parsing

* Implement checkpointed imap-connector

* Add testing logic for basic iteration

* Add logic to get different header if "to" isn't present

- possible in mailing-list workflows

* Add ability to index specific mailboxes

* Add breaking when indexing has been fully exhausted

* Sanitize all mailbox names + add space between stripped strings after parsing

* Add multi-recipient parsing

* Change around semantic-identifier and title

* Add imap tests

* Add recipients and content assertions to tests

* Add envvars to github actions workflow file

* Remove encoding header

* Update logic to not immediately establish connection upon init of `ImapConnector`

* Add start and end datetime filtering + edit when connection is established / how login is done

* Remove content-type header

* Add note about guards

* Change default parameters to be `None` instead of `[]`

* Address comment on PR

* Implement more PR suggestions

* More PR suggestions

* Implement more PR suggestions

* Change up login/logout flow (PR suggestion)

* Move port number to be envvar

* Make globals variants in enum instead (PR suggestion)

* Fix more documentation related suggestions on PR

* Have the imap connector implement `CheckpointedConnectorWithPermSync` instead

* Add helper for loading all docs with permission syncing
 2025-07-08 23:58:22 +00:00
Raunak Bhagat 5d7169f244 Implement JIRA permission syncing (#4899) 2025-06-24 23:59:26 +00:00
Chris Weaver c1f9a9d122 Hubspot connector enhancements (#4927) 
* Enhance hubspot connector

* Add companies, deals, and tickets

* improve typing

* Add HUBSPOT_ACCESS_TOKEN to connector tests

* Fix prettier

* Fix mypy

* Address JR comments
 2025-06-22 13:54:04 -07:00
Raunak Bhagat f27fe068e8 Add env variables (#4711) 2025-05-14 19:39:29 +00:00
Raunak Bhagat d744c0dab4 fix: Fix error in which channel names would not have the leading "#" removed (#4664) 
* Fix failing entrypoint into slack connector

* Pre-filter channel names upon instantiation of slack connector class

* Add decrypt script

* Add slack connector tests

* Fix mypy errors on decrypt.py

* Add property to SlackConnector class

* Add some basic tests

* Move location of tests

* Change name of env token

* Add secrets for Slack

* Add more parameterized cases

* Change env variable name

* Change names

* Update channel names

* Edit tests

* Modify tests

* Only import type in __main__

* Fix tests to actually test connectors

* Pass parameter to fixture directly
 2025-05-07 04:55:21 +00:00
Chris Weaver 9be3da2357 Fix gitlab (#4629) 
* Fix gitlab

* Add back assert
 2025-04-28 17:42:49 -07:00
Chris Weaver 87478c5ca6 Parallelize connector tests (#4563) 
* Parallelize connector tests

* Use --dist loadfile

* Add slow test logging
 2025-04-19 18:10:50 -07:00
rkuo-danswerandRichard Kuo 42938dcf62 Bugfix/gong tweaks (#4444) 
* gong debugging

* add retries via class level session, add debugging

* add gong connector test

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
 2025-04-03 22:22:45 +00:00
rkuo-danswerandRichard Kuo f08fa878a6 refactor file extension checking and add test for blob s3 (#4369) 
* refactor file extension checking and add test for blob s3

* code review

* fix checking ext

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
 2025-03-27 18:57:44 +00:00
evan-danswer fb79a9e700 Checkpointed GitHub connector (#4307) 
* WIP github checkpointing

* first draft of github checkpointing

* nit

* CW comments

* github basic connector test

* connector test env var

* secrets cant start with GITHUB_

* unit tests and bug fix

* connector failures

* address CW comments

* validation fix

* validation fix

* remove prints

* fixed tests

* 100 items per page
 2025-03-22 01:48:05 +00:00
SubashMohan ba514aaaa2 Highspot connector (#4277) 2025-03-17 08:36:02 -07:00
Chris Weaver 6ead9510a4 Small notion tweaks (#4244) 
* Small notion tweaks

* Add comment
 2025-03-10 15:51:12 +00:00
pablonyx a32f7dc936 Fix Connector tests (confluence) (#4221) 2025-03-06 17:00:01 -08:00
rkuo-danswerandRichard Kuo c9f618798e support scrolling before scraping (#4040) 
* support scrolling before scraping

* fix mypy

* install playwright deps

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>
 2025-02-19 17:54:58 +00:00
Weves 3a704f1950 Add new vars to github action 2025-02-13 18:33:17 -08:00
Chris Weaver 028e877342 Sharepoint fixes (#3826) 
* Sharepoint connector fixes

* Refactor sharepoint to be better

* Improve env variable naming

* Fix

* Add new secrets

* Fix unstructured failure
 2025-01-28 20:06:09 -08:00
SubashMohanandhagen-danswer c2444a5cff Slim connector for Zendesk (#3367) 
* Add SlimConnector support for Zendesk

* ZenDesk format changes

* code formating

---------

Co-authored-by: hagen-danswer <hagen@danswer.ai>
 2025-01-06 06:41:41 -08:00
Chris Weaver 3f92ed9d29 Airtable connector (#3564) 
* Airtable connector

* Improvements

* improve

* Clean up test

* Add secrets

* Fix mypy + add access token

* Mock unstructured call

* Adjust comments

* Fix ID in test
 2024-12-31 03:06:28 +00:00
hagen-danswer d14ef431a7 Improve Salesforce connector 2024-12-29 14:18:40 -08:00
hagen-danswer 5385bae100 Add slim connector description (#3303) 
* added docs example and test

* updated docs

* needed to make the tests run

* updated docs
 2024-12-02 19:52:13 +00:00
hagen-danswer 6e83fe3a39 reworked drive+confluence frontend and implied backend changes (#3143) 
* reworked drive+confluence frontend and implied backend changes

* fixed oauth admin tests

* fixed service account tests

* frontend cleanup

* copy change

* details!

* added key

* so good

* whoops!

* fixed mnore treljsertjoslijt

* has issue with boolean form

* should be done
 2024-11-16 03:38:30 +00:00
hagen-danswer 2cd1e6be00 gmail refactor + permission syncing (#3021) 
* initial frontend changes and shared google refactoring

* gmail connector is reworked

* added permission syncing for gmail

* tested!

* Added tests for gmail connector

* fixed tests and mypy

* temp fix

* testing done!

* rename

* test fixes maybe?

* removed irrelevant tests

* anotha one

* refactoring changes

* refactor finished

* maybe these fixes work

* dumps

* final fixes
 2024-11-04 18:06:23 +00:00
hagen-danswerandChris Weaver 71d4fb98d3 Refactored Google Drive Connector + Permission Syncing (#2945) 
* refactoring changes

* everything working for service account

* works with service account

* combined scopes

* copy change

* oauth prep

* Works for oauth and service account credentials

* mypy

* merge fixes

* Refactor Google Drive connector

* finished backend

* auth changes

* if its stupid but it works, its not stupid

* npm run dev fixes

* addressed change requests

* string fix

* minor fixes and cleanup

* spacing cleanup

* Update connector.py

* everything done

* testing!

* Delete backend/tests/daily/connectors/google_drive/file_generator.py

* cleaned up

---------

Co-authored-by: Chris Weaver <25087905+Weves@users.noreply.github.com>
 2024-11-01 02:25:00 +00:00
rkuo-danswer 7eafdae17f update several github actions to silence github deprecation warnings (#2730) 2024-10-12 23:40:20 +00:00
hagen-danswer 834c76e30a Added quotes to project name to handle reserved words (#2639) 2024-10-01 10:32:41 -07:00
rkuo-danswer b66514cd21 test self hosted runner (#2541) 
* test self hosted runner

* update more docker builds with self hosted runner

* convert everything to runs-on (except web container)
 2024-09-23 21:57:23 +00:00
rkuo-danswerandRichard Kuo 3884f1d70a Bugfix/larger test runner (#2508) 
* add pip retries to the github workflows too

* let's try running on amd64 ... docker builds are unusually flaky

* bump

* try large

* no yaml anchors

* switch back down to Amd64

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>
 2024-09-19 05:36:07 +00:00
pablodanswer c122be2f6a More explicit Confluence Connector (#2289) 2024-09-01 20:35:29 -07:00