starred/onyx
1
0 Fork 0
mirror of https://github.com/onyx-dot-app/onyx.git synced 2026-10-22 19:32:55 -05:00
Code Issues Packages Projects Releases 10 Wiki Activity
5,294 Commits 2,113 Branches 2,543 Tags
4e7adcc9eec647d7290f22ef3671776216ee89de
Commit Graph
272 Commits
Author SHA1 Message Date
Chris Weaver 959b8c320d fix: don't leave redis ports exposed (#6814) 2025-12-17 12:06:10 -08:00
Yuhong Sun 24a0ceee18 chore: fix llm interface (#6691) 2025-12-11 15:44:44 -08:00
Wenxi fe514eada0 fix(docs): update admin docs links (#6611) 2025-12-04 23:05:09 +00:00
Yuhong Sun 7b6ae2b72a chore: Cleanup PreviousMessage class (#6570) 2025-12-03 12:37:02 -08:00
Jamison Lahman 9055691c38 chore(docker): explicitly default env to empty string (#6511) 2025-12-02 01:25:39 +00:00
Yuhong SunandVega c26da8dc75 feat: Updated Processing for Context to the LLM (#6485) 
Co-authored-by: Vega <33913017+weijia619@users.noreply.github.com>
 2025-12-01 14:41:13 -08:00
Wenxi bc35354ced feat(MCP): basic Onyx MCP server with search tools and indexed sources resource (#6309) 2025-11-25 02:30:55 +00:00
Wenxi e74cf14401 chore(docker): make container startup checks case-less-sensitive (#6412) 2025-11-24 20:48:23 +00:00
Chris Weaver 33fee46d71 feat: code interpreter (python) (#6136) 2025-11-22 07:19:25 +00:00
Jamison Lahman 72f5e3d38f chore(dev): docker-compose.multitenant-dev respects HOST_PORT (#6388) 2025-11-22 07:11:43 +00:00
Evan Lohn 9100afa594 feat: Allow attaching mcp tools to default assistant (#6343) 2025-11-21 17:29:34 -08:00
Wenxiandjustin-tahara 416c7fd75e chore(WebSearch): remove old web search env vars and update tooltip (#6365) 
Co-authored-by: justin-tahara <justintahara@gmail.com>
 2025-11-20 21:09:24 +00:00
mristau-alltrails 7eb13db6d9 SECURITY FIX: CVE-2023-38545 and CVE-2023-38546 (#6356) 2025-11-20 20:11:35 +00:00
Jamison Lahman 4ff28c897b chore(dev): nginx container port 80 respects HOST_PORT_80 (#6338) 2025-11-20 17:48:10 +00:00
Justin Tahara 6677e12e55 chore(vespa): Update version (#6299) 2025-11-18 09:50:38 -08:00
Jamison Lahman b367a60680 chore(gha): replace background docker pulls with docker-compose (#6287) 2025-11-17 17:11:56 +00:00
Evan Lohn 0d20140cad fix: mcp fixes (#6080) 2025-11-17 08:58:49 -08:00
SubashMohan e8da5722df feat(upload): increase token limit to 100k and configurable skip (#6187) 2025-11-12 09:53:37 -08:00
Yuhong Sun 2b19b84245 Upgrade when version latest (#6056) 2025-11-04 11:57:00 -08:00
Wenxi cf187e8f58 fix: stop redis from spawning anonymous volumes (#5969) 2025-10-29 01:22:12 +00:00
Justin Tahara bbb4b9eda3 fix(docker): Clean up USE_IAM_AUTH log (#5870) 2025-10-22 15:59:12 -07:00
Wenxi 248fe416e1 chore: update template reference to sso ee (#5830) 2025-10-21 11:39:12 -07:00
edwin-onyxandEdwin Luo 3a4bb239b1 fix(infra): consolidate heavy, monitoring, and user file worker into one (#5558) 
Co-authored-by: Edwin Luo <edwin@parafin.com>
 2025-10-14 01:19:47 +00:00
Chris Weaver d803b48edd feat: Increase nginx default timeout (#5677) 2025-10-09 22:13:18 +00:00
Chris Weaver a85a5a324e More prod fixes (#5556) 2025-09-30 14:43:21 -07:00
Chris Weaver 2c422215e6 Fix prod compose (#5553) 2025-09-30 10:41:38 -07:00
Yuhong Sun 6b39d8eed9 Docker Version Check (#5523) 2025-09-27 19:03:43 -07:00
Chris WeaverClaudejustin-tahara
 		d186c5e82e feat(docker): Add DEV_MODE flag for exposing service ports (#5499) 
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: justin-tahara <justintahara@gmail.com>
 2025-09-25 15:08:20 -07:00
Yuhong Sun 57908769f1 Port 80 (#5495) 2025-09-25 11:10:41 -07:00
Yuhong Sun 600cec7c89 Robust Install (#5494) 2025-09-25 10:08:52 -07:00
Yuhong Sun 2e0bc8caf0 feat: Easy Install (#5461) 2025-09-24 15:31:45 -07:00
Wenxiandgreptile-apps[bot] d248d2f4e9 refactor: update seeded docs (#5364) 
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
 2025-09-08 18:06:29 -07:00
Chris Weaver 427945e757 fix: model server build (#5362) 2025-09-08 14:00:33 -07:00
Wenxi e55cdc6250 fix: new docs links (#5363) 2025-09-08 13:49:19 -07:00
Evan Lohn cc48a0c38e fix: jira cloud api v3 (#5337) 2025-09-04 21:50:35 -07:00
Wenxi 255c2af1d6 feat: reorganize connectors pages (#5186) 
* Add popular connectors sections and cleanup connectors page

* Add other connectors env var

* other connectors env var to vscode env template

* update playwright tests

* sort by popuarlity

* recategorize and sort by popularity
 2025-08-29 16:59:00 -07:00
Sam Waddell c4076d16b6 fix: update all log paths to reflect change related to non-root user (#5244) 2025-08-25 14:11:18 -07:00
Sam WaddellandPhil Critchfield 5867ab1d7d feat: add non-root user to backend and model-server images (#5134) 
* feat: add non-root user to backend and model-server image

* feat: update values to support security context for index, inference, and celery_shared

* feat: add security context support for index and inference

* feat: add celery_shared security context support to celery worker templates

* fix: cache management strategy

* fix: update deployment files for volume mount

* fix: address comments

* fix: bump helm chart version for new security context template changes

* fix: bump helm chart version for new security context template changes

* feat: move useradd earlier in build for reduced image size

---------

Co-authored-by: Phil Critchfield <phil.critchfield@liatrio.com>
 2025-08-20 13:49:50 -07:00
Devin 508b456b40 fix: explicit api_server dependency on minio in docker compose files (#5066) 2025-07-23 13:37:42 -07:00
Wenxi 86b7beab01 fix: too many internet chunks (#5060) 
* minor internet search env vars

* add limit to internet search chunks

* note

* nits
 2025-07-22 23:11:10 +00:00
Evan Lohn bd06147d26 feat: connector indexing decoupling (#4893) 
* WIP

* renamed and moved tasks (WIP)

* minio migration

* bug fixes and finally add document batch storage

* WIP: can suceed but status is error

* WIP

* import fixes

* working v1 of decoupled

* catastrophe handling

* refactor

* remove unused db session in prep for new approach

* renaming and docstrings (untested)

* renames

* WIP with no more indexing fences

* robustness improvements

* clean up rebase

* migration and salesforce rate limits

* minor tweaks

* test fix

* connector pausing behavior

* correct checkpoint resumption logic

* cleanups in docfetching

* add heartbeat file

* update template jsonc

* deployment fixes

* fix vespa httpx pool

* error handling

* cosmetic fixes

* dumb

* logging improvements and non checkpointed connector fixes

* didnt save

* misc fixes

* fix import

* fix deletion of old files

* add in attempt prefix

* fix attempt prefix

* tiny log improvement

* minor changes

* fixed resumption behavior

* passing int tests

* fix unit test

* fixed unit tests

* trying timeout bump to see if int tests pass

* trying timeout bump to see if int tests pass

* fix autodiscovery

* helm chart fixes

* helm and logging
 2025-07-22 03:33:25 +00:00
WenxiandWenxi Onyx 0e79b96091 Feature/revised internet search (#4994) 
* remove unused pruning config

* add env vars

* internet search date time toggle

* revised internet search supporting multiple providers

* env var

* simplify retries and fix mypy issues

* greptile nits

* more mypy

* please mypy

* mypy final straw

* cursor vs. mypy

* simplify fields from provider results

* type-safe prompt, enum nit, provider enums, indexingdoc processing change

---------

Co-authored-by: Wenxi Onyx <wenxi-onyx@Wenxis-MacBook-Pro.local>
 2025-07-14 10:24:03 -07:00
Arun Philip e74a0398dc Update Docker Compose restart policy to unless-stopped 
Changed the restart policy to unless-stopped to ensure containers
automatically restart after failures or reboots but allow manual stop
without immediate restart.

This is preferable over always because it prevents containers from
restarting automatically after a manual stop, enabling controlled
shutdowns and maintenance without unintended restarts.
 2025-06-24 13:27:50 -07:00
joachim-danswer 3272050975 docker dev and prod template (#4936) 
* docker dev and prod template

* more dev files
 2025-06-23 21:43:42 +00:00
Chris Weaver 6f8176092e S3 like file store (#4897) 
* Move to an S3-like file store

* Add non-mocked test

* Add S3 tests

* Improve migration / add auto-running tests

* Refactor

* Fix mypy

* Small fixes

* Improve migration to handle downgrades

* fix file store tests

* Fix file store tests again

* Fix file store tests again

* Fix mypy

* Fix default values

* Add MinIO to other compose files

* Working helm w/ minio

* Fix test

* Address greptile comments

* Harden migration

* Fix README

* Fix it

* Address more greptile comments

* Fix it

* Rebase

* Handle multi-tenant case

* Fix mypy

* Fix test

* fix test

* Improve migration

* Fix test
 2025-06-20 14:22:05 -07:00
joachim-danswerandRei Meguro c5adbe4180 Knowledge Graph v1 (#4626) 
* db setup

* transfer 1 - incomplete

* more adjustments

* relationship table + query update

* temp view creation

* restructuring

* nits

* updates

* separate read_only engine

* extraction revamp

* focus on metadata relatonships 1

* dev

* migration downgrade fix

* rebase migration change

* a3+

* progress

* base

* new extraction

* progress

* fixed KG extraction

* nits

* updates

* simplifications & cleanup

* fixes

* updates

* more feature flag checks

* fixes

* extraction process fix

* read-only user creation as part of setup

* fix for missing entity attributes

* kg read-only user creation as part of migration

* typo

* EL initial comments

* initial Account/SF Connector chnges

* SF Connector update

 - include account information

* base w/ salesforce

* evan updates + quite a bit more

* kg-filtered search

* EL changes pt 2

* migrations and env vars

* quick migration fix

* migration update

* post_rebase fixes

* mypy fixes

* test fixes

* test fix

* test fix

* read_only pool + misc

* nf

* env vars

* test improvements

* salesforce fix

* test update

* small changes

* small adjustments

* SF Connector fix & kg_stage removal for one table

* mypy fix

* small fixes

* EL + RK (pt 1) comments

* nit

* setting updated

* Salesforce test update

* EL comments

* read-only user replacement & cleanup

* SQL View fix

* converting entity type-name separators

* sql view group ownership

* view fix

* SQL tweak

* dealing with docs that were skipped by indexing

* increased error handling

* more error handling

* Output formatting fix

* kg-incremental-reindexing

* 0-doc found improvement

* celery

* migration correction

* timeout adjustments

* nit

* Updated migration

* Entity Normalization for KG Dev 1 (#4746)

* feat: trigrams column

* fix: reranking and db

* feat: v1

* fix: convert to orm

* feat: parallel

* fix: default to id_name

* fix: renamed semantic_id and semantic_id_trigrams

* fix: scalar subquery

* fix: tuning + redundancy

* fix: threshold

* fix: typo

* fix: shorten names

* wip

* fix: reverted

* feat: config

* feat: works but it was dumb

* feat: clustering works

* fix: mypy

* normalization <-> language awareness for SQL generation

* small type fixes

---------

Co-authored-by: joachim-danswer <joachim@danswer.ai>

* mypy

* typo and dead code

* kg_time_fencing

* feat: remove temp views on migration downgrade

* remove functions and triggers for now

* rebase adjustments

* EL code review results

* quick fix + trigger/funcs for single tenant

* fix: typo, mypy, dead code

* fix: autoflake

* small updatesd

* nit

* fix: typo

* early + faster view creation

* Extension creation in MT migration

* nit changes to default ETs

* Incremental Clustering and KG Refactor V1 (#4784)

Optimized/restructured incremental clustering. New pipeline actually that moves vespa updates to clustering.
Also, celery configuration has been updated.
---------

Co-authored-by: joachim-danswer <joachim@danswer.ai>

* prompt tweak & ET extraction reset

* more general hierarchical structure

* feat: better vespa reset logic

* prompt optimization and entity replacemants

* small prompt changes

* KG Refactor V2 (#4814)

Clustering & Extraction improvements & various nits 

Co-authored-by: joachim-danswer <joachim@danswer.ai>

* add connector-level coverage days

* fix: nit

* initial  EL responses

* refactor: helper functions for formatting

* fix: more helper fns & comments

* fix: comment code that's been implemented elsewhere

* fix: tenant_id missing arg

* fix: removed debugging stuff

* fix: moved kg_interactions db query to helper fn

* fix: tenant_id

* fix: tenant_id & removed outdated helper fn

* fix always set entity class

* fix: typo

* fix alembic heads

* fix: celery logging

* fix: migrations fix

* fix: multi tenant permissions

* fix: temp connector fix

* fix: downgrade

* Fix upgrade migration

* fix: tenant for normalization

* added additional acl

* stray EL comments

* fix: connector test

* fix mypy

* fix: temporary connector test fix

* fix: jira connector test

* nit

* small nits

* fix: black

* fix: mypy

* fix: mypy

---------

Co-authored-by: Rei Meguro <36625832+Orbital-Web@users.noreply.github.com>
 2025-06-07 23:14:20 +00:00
rkuo-danswerandRichard Kuo 51be9000bb Feature/vespa bump (#4819) 
* bump cloudformation

* update kubernetes

* bump helm chart

* bump docker compose

* update chart.lock

* ai accident!

* bump vespa helm chart for fix

* increase timeout

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
 2025-06-04 00:03:01 +00:00
Evan Lohn 4c71a5f5ff drive perm sync logs + misc deployment improvements (#4788) 
* some logs

* give postgress more memory

* give postgress more memory

* give postgress more memory

* revert

* give postgress more memory

* bump external access limit

* vespa timeout

* deployment consistency

* bump vespa version

* skip upgrade check

* retry permission by ids

* logs

* fix temp docx file issue

* fix drive file deduping

* RK comments

* mypy

* aggregate logs
 2025-06-01 23:36:57 +00:00
rkuo-danswerandRichard Kuo 2282f6a42e fix restart (#4726) 
Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
 2025-05-17 17:02:27 +00:00
Chris Weaver 70df685709 Non default schema fix (#4667) 
* Use correct postgres schema

* Remove raw Session() use

* Refactor + add test

* Fix comment
 2025-05-06 20:35:59 -07:00