* Implement fetching; still need to work on document parsing
* Add basic skeleton of parsing email bodies
* Add id field
* Add email body parsing
* Implement checkpointed imap-connector
* Add testing logic for basic iteration
* Add logic to get different header if "to" isn't present
- possible in mailing-list workflows
* Add ability to index specific mailboxes
* Add breaking when indexing has been fully exhausted
* Sanitize all mailbox names + add space between stripped strings after parsing
* Add multi-recipient parsing
* Change around semantic-identifier and title
* Add imap tests
* Add recipients and content assertions to tests
* Add envvars to github actions workflow file
* Remove encoding header
* Update logic to not immediately establish connection upon init of `ImapConnector`
* Add start and end datetime filtering + edit when connection is established / how login is done
* Remove content-type header
* Add note about guards
* Change default parameters to be `None` instead of `[]`
* Address comment on PR
* Implement more PR suggestions
* More PR suggestions
* Implement more PR suggestions
* Change up login/logout flow (PR suggestion)
* Move port number to be envvar
* Make globals variants in enum instead (PR suggestion)
* Fix more documentation related suggestions on PR
* Have the imap connector implement `CheckpointedConnectorWithPermSync` instead
* Add helper for loading all docs with permission syncing
* gong debugging
* add retries via class level session, add debugging
* add gong connector test
---------
Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
* refactor file extension checking and add test for blob s3
* code review
* fix checking ext
---------
Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
* refactoring changes
* everything working for service account
* works with service account
* combined scopes
* copy change
* oauth prep
* Works for oauth and service account credentials
* mypy
* merge fixes
* Refactor Google Drive connector
* finished backend
* auth changes
* if its stupid but it works, its not stupid
* npm run dev fixes
* addressed change requests
* string fix
* minor fixes and cleanup
* spacing cleanup
* Update connector.py
* everything done
* testing!
* Delete backend/tests/daily/connectors/google_drive/file_generator.py
* cleaned up
---------
Co-authored-by: Chris Weaver <25087905+Weves@users.noreply.github.com>
* add pip retries to the github workflows too
* let's try running on amd64 ... docker builds are unusually flaky
* bump
* try large
* no yaml anchors
* switch back down to Amd64
---------
Co-authored-by: Richard Kuo <rkuo@rkuo.com>
Evan Lohn