starred/onyx
1
0 Fork 0
mirror of https://github.com/onyx-dot-app/onyx.git synced 2026-10-22 11:22:49 -05:00
Code Issues Packages Projects Releases 10 Wiki Activity
9,292 Commits 2,073 Branches 2,538 Tags
6cf030d3dd87b79c73e239d527710eaf373ee467
Commit Graph
45 Commits
Author SHA1 Message Date
Jamison LahmanandClaude Opus 4.8 d557bd3702 refactor(model-server): gate DISABLE_MODEL_SERVER in python entrypoint (#12754) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-07 23:48:13 +00:00
Justin Tahara 3535f1ceb0 chore(deployment): prune dead env vars from templates & helm values (#12414) 2026-06-25 00:46:11 +00:00
Jamison LahmanandClaude Opus 4.8 26868070e6 fix(security): harden default MinIO/S3 object-storage credentials (#12003) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-06-12 19:27:18 +00:00
acaprau fa8fc678f9 feat(opensearch): Remove Vespa as an option entirely (#11207) 2026-05-20 02:03:45 +00:00
Evan Lohn 276261c96d fix: windows installer (#9507) 2026-03-20 22:53:46 +00:00
Jessica Singh 19b33e4d93 chore(auth): deployment docker cleanup (#8587) 2026-03-10 16:48:27 +00:00
Evan Lohn 367808951c chore: remove lightweight mode (#9014) 2026-03-04 18:26:05 +00:00
Justin Tahara 78c6ca39b8 fix(minio): No cURL in minio container (#8876) 2026-02-27 22:37:42 +00:00
Nikolas Garza cec37bff6a feat(ee): Enable license enforcement by default (#8270) 2026-02-10 02:48:55 +00:00
Jamison Lahman f36d15d924 chore(flags): remove unused NEXT_PUBLIC_DEFAULT_SIDEBAR_OPEN (#7984) 2026-01-30 00:35:08 +00:00
Raunak Bhagat 8a0ce4c294 feat: Feedback modals update (#7380) 2026-01-13 19:48:45 +00:00
Yuhong Sun 24a0ceee18 chore: fix llm interface (#6691) 2025-12-11 15:44:44 -08:00
Jamison Lahman 9055691c38 chore(docker): explicitly default env to empty string (#6511) 2025-12-02 01:25:39 +00:00
Wenxi e74cf14401 chore(docker): make container startup checks case-less-sensitive (#6412) 2025-11-24 20:48:23 +00:00
mristau-alltrails 7eb13db6d9 SECURITY FIX: CVE-2023-38545 and CVE-2023-38546 (#6356) 2025-11-20 20:11:35 +00:00
Justin Tahara 6677e12e55 chore(vespa): Update version (#6299) 2025-11-18 09:50:38 -08:00
Wenxi cf187e8f58 fix: stop redis from spawning anonymous volumes (#5969) 2025-10-29 01:22:12 +00:00
edwin-onyxandEdwin Luo 3a4bb239b1 fix(infra): consolidate heavy, monitoring, and user file worker into one (#5558) 
Co-authored-by: Edwin Luo <edwin@parafin.com>
 2025-10-14 01:19:47 +00:00
Yuhong Sun 2e0bc8caf0 feat: Easy Install (#5461) 2025-09-24 15:31:45 -07:00
Sam Waddell c4076d16b6 fix: update all log paths to reflect change related to non-root user (#5244) 2025-08-25 14:11:18 -07:00
Sam WaddellandPhil Critchfield 5867ab1d7d feat: add non-root user to backend and model-server images (#5134) 
* feat: add non-root user to backend and model-server image

* feat: update values to support security context for index, inference, and celery_shared

* feat: add security context support for index and inference

* feat: add celery_shared security context support to celery worker templates

* fix: cache management strategy

* fix: update deployment files for volume mount

* fix: address comments

* fix: bump helm chart version for new security context template changes

* fix: bump helm chart version for new security context template changes

* feat: move useradd earlier in build for reduced image size

---------

Co-authored-by: Phil Critchfield <phil.critchfield@liatrio.com>
 2025-08-20 13:49:50 -07:00
Devin 508b456b40 fix: explicit api_server dependency on minio in docker compose files (#5066) 2025-07-23 13:37:42 -07:00
Arun Philip e74a0398dc Update Docker Compose restart policy to unless-stopped 
Changed the restart policy to unless-stopped to ensure containers
automatically restart after failures or reboots but allow manual stop
without immediate restart.

This is preferable over always because it prevents containers from
restarting automatically after a manual stop, enabling controlled
shutdowns and maintenance without unintended restarts.
 2025-06-24 13:27:50 -07:00
Chris Weaver 6f8176092e S3 like file store (#4897) 
* Move to an S3-like file store

* Add non-mocked test

* Add S3 tests

* Improve migration / add auto-running tests

* Refactor

* Fix mypy

* Small fixes

* Improve migration to handle downgrades

* fix file store tests

* Fix file store tests again

* Fix file store tests again

* Fix mypy

* Fix default values

* Add MinIO to other compose files

* Working helm w/ minio

* Fix test

* Address greptile comments

* Harden migration

* Fix README

* Fix it

* Address more greptile comments

* Fix it

* Rebase

* Handle multi-tenant case

* Fix mypy

* Fix test

* fix test

* Improve migration

* Fix test
 2025-06-20 14:22:05 -07:00
joachim-danswerandRei Meguro c5adbe4180 Knowledge Graph v1 (#4626) 
* db setup

* transfer 1 - incomplete

* more adjustments

* relationship table + query update

* temp view creation

* restructuring

* nits

* updates

* separate read_only engine

* extraction revamp

* focus on metadata relatonships 1

* dev

* migration downgrade fix

* rebase migration change

* a3+

* progress

* base

* new extraction

* progress

* fixed KG extraction

* nits

* updates

* simplifications & cleanup

* fixes

* updates

* more feature flag checks

* fixes

* extraction process fix

* read-only user creation as part of setup

* fix for missing entity attributes

* kg read-only user creation as part of migration

* typo

* EL initial comments

* initial Account/SF Connector chnges

* SF Connector update

 - include account information

* base w/ salesforce

* evan updates + quite a bit more

* kg-filtered search

* EL changes pt 2

* migrations and env vars

* quick migration fix

* migration update

* post_rebase fixes

* mypy fixes

* test fixes

* test fix

* test fix

* read_only pool + misc

* nf

* env vars

* test improvements

* salesforce fix

* test update

* small changes

* small adjustments

* SF Connector fix & kg_stage removal for one table

* mypy fix

* small fixes

* EL + RK (pt 1) comments

* nit

* setting updated

* Salesforce test update

* EL comments

* read-only user replacement & cleanup

* SQL View fix

* converting entity type-name separators

* sql view group ownership

* view fix

* SQL tweak

* dealing with docs that were skipped by indexing

* increased error handling

* more error handling

* Output formatting fix

* kg-incremental-reindexing

* 0-doc found improvement

* celery

* migration correction

* timeout adjustments

* nit

* Updated migration

* Entity Normalization for KG Dev 1 (#4746)

* feat: trigrams column

* fix: reranking and db

* feat: v1

* fix: convert to orm

* feat: parallel

* fix: default to id_name

* fix: renamed semantic_id and semantic_id_trigrams

* fix: scalar subquery

* fix: tuning + redundancy

* fix: threshold

* fix: typo

* fix: shorten names

* wip

* fix: reverted

* feat: config

* feat: works but it was dumb

* feat: clustering works

* fix: mypy

* normalization <-> language awareness for SQL generation

* small type fixes

---------

Co-authored-by: joachim-danswer <joachim@danswer.ai>

* mypy

* typo and dead code

* kg_time_fencing

* feat: remove temp views on migration downgrade

* remove functions and triggers for now

* rebase adjustments

* EL code review results

* quick fix + trigger/funcs for single tenant

* fix: typo, mypy, dead code

* fix: autoflake

* small updatesd

* nit

* fix: typo

* early + faster view creation

* Extension creation in MT migration

* nit changes to default ETs

* Incremental Clustering and KG Refactor V1 (#4784)

Optimized/restructured incremental clustering. New pipeline actually that moves vespa updates to clustering.
Also, celery configuration has been updated.
---------

Co-authored-by: joachim-danswer <joachim@danswer.ai>

* prompt tweak & ET extraction reset

* more general hierarchical structure

* feat: better vespa reset logic

* prompt optimization and entity replacemants

* small prompt changes

* KG Refactor V2 (#4814)

Clustering & Extraction improvements & various nits 

Co-authored-by: joachim-danswer <joachim@danswer.ai>

* add connector-level coverage days

* fix: nit

* initial  EL responses

* refactor: helper functions for formatting

* fix: more helper fns & comments

* fix: comment code that's been implemented elsewhere

* fix: tenant_id missing arg

* fix: removed debugging stuff

* fix: moved kg_interactions db query to helper fn

* fix: tenant_id

* fix: tenant_id & removed outdated helper fn

* fix always set entity class

* fix: typo

* fix alembic heads

* fix: celery logging

* fix: migrations fix

* fix: multi tenant permissions

* fix: temp connector fix

* fix: downgrade

* Fix upgrade migration

* fix: tenant for normalization

* added additional acl

* stray EL comments

* fix: connector test

* fix mypy

* fix: temporary connector test fix

* fix: jira connector test

* nit

* small nits

* fix: black

* fix: mypy

* fix: mypy

---------

Co-authored-by: Rei Meguro <36625832+Orbital-Web@users.noreply.github.com>
 2025-06-07 23:14:20 +00:00
rkuo-danswerandRichard Kuo 51be9000bb Feature/vespa bump (#4819) 
* bump cloudformation

* update kubernetes

* bump helm chart

* bump docker compose

* update chart.lock

* ai accident!

* bump vespa helm chart for fix

* increase timeout

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
 2025-06-04 00:03:01 +00:00
Evan Lohn 4c71a5f5ff drive perm sync logs + misc deployment improvements (#4788) 
* some logs

* give postgress more memory

* give postgress more memory

* give postgress more memory

* revert

* give postgress more memory

* bump external access limit

* vespa timeout

* deployment consistency

* bump vespa version

* skip upgrade check

* retry permission by ids

* logs

* fix temp docx file issue

* fix drive file deduping

* RK comments

* mypy

* aggregate logs
 2025-06-01 23:36:57 +00:00
Chris Weaver 7648627503 Save all logs + add log persistence to most Onyx-owned containers (#4368) 
* Save all logs + add log persistence to most Onyx-owned containers

* Separate volumes for each container

* Small fixes
 2025-03-26 22:25:39 -07:00
Chris Weaver 0d3c72acbf Add basic memory logging (#4234) 
* Add basic memory logging

* Small tweaks

* Switch to monotonic
 2025-03-08 03:49:47 +00:00
pablodanswer 21ec5ed795 welcome to onyx 2024-12-13 09:56:10 -08:00
Yuhong Sun 0ff5180d7b Ensure tests don't use LLM (#2702) 2024-10-06 11:42:49 -07:00
Chris WeaverandRichard Kuo 1362d4b583 Allow config of background concurrency (#2648) 
* Allow config of background concurrency

* Add comment

* Fix light worker

* use backslashes to continue lines in supervisord with bash

---------

Co-authored-by: Richard Kuo (Danswer) <rkuo@danswer.ai>
 2024-10-04 00:55:28 +00:00
rkuo-danswer 140c34e59e ephemeral behavior for redis (#2373) 
* ephemeral behavior for redis

* notes for redis command line consistency
 2024-09-13 04:48:50 +00:00
pablodanswer f69922fff7 Add environment variable for setting vespa search threads (#2400) 2024-09-11 22:37:38 -07:00
rkuo-danswer c967f53c02 docker versions have been deprecated for a while, so fixing the annoying warning (#2372) 2024-09-09 18:26:12 +00:00
rkuo-danswerandRichard Kuo 2933c3598b first cut at redis (#2226) 
* first cut at redis

* fix startup dependencies on redis

* kombu cleanup - fail silently

* mypy

* add redis_host environment override

* update REDIS_HOST env var in docker-compose.dev.yml

* update the rest of the docker files

* update contributing guide

* renaming cache to cache_volume

* add redis password to various deployments

* try setting up pr testing for helm

* fix indent

* hopefully this release version actually exists

* fix command line option to --chart-dirs

* fetch-depth 0

* edit values.yaml

* try setting ct working directory

* bypass testing only on change for now

* move files and lint them

* update helm testing

* some issues suggest using --config works

* add vespa repo

* add postgresql repo

* increase timeout

* try amd64 runner

* fix redis password reference

* add comment to helm chart testing workflow

* rename helm testing workflow to disable it

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>
 2024-09-06 19:21:29 +00:00
Chris Weaver c0e1a02e8e Add it on merge queue (#2112) 
* Github action to run integration tests

* Improve

* Fix build

* Add pull

* Fix readiness script

* Add IT runner

* Add IT runner

* Add logs

* update

* Fix

* Fix path

* file path

* test

* fix

* fix

* fix

* test

* network

* fix

* cleanup

* fix

* test

* Fix downgrade

* Add OpenAI API key

* Add VESPA_HOST

* test pulling first

* Add API server host

* Cache tweak

* Fix pull/push settings:

* Stop pushing to latest tag

* test cache change

* test

* test

* test

* remove cache temporarily

* Fix

* Enable EE

* test

* Remove duplicate funcs

* add back build

* Update all

* Fix stop cmd

* Add to merge queue

* Cleanup image tag
 2024-08-26 07:20:28 +00:00
rkuo-danswer 288e6fa606 Bugfix/pg connections (#2002) 
* increase max_connections to 150 in all docker files

* lower celery worker concurrency to 6
 2024-07-31 19:49:20 +00:00
pablodanswer 807bef8ada Add environment variable for defaulted sidebar toggling (#1923) 
* add env variable for defaulted sidebar toggling

* formatting

* update naming
 2024-07-24 21:23:37 +00:00
hagen-danswer 1b864a00e4 Added support for multiple Eval Pipeline UIs (#1830) 2024-07-14 15:16:20 -07:00
Yuhong Sun f0888f2f61 Eval Script Incremental Write (#1784) 2024-07-06 15:43:40 -07:00
Yuhong Sun d35d7ee833 Evaluation Pipeline Touchup (#1783) 2024-07-06 13:17:05 -07:00
Yuhong Sun 79190030a5 New Env File for Eval (#1781) 2024-07-06 12:07:31 -07:00
Yuhong Sun 8e8f262ed3 Docker Compose Eval Pipeline Cleanup (#1780) 2024-07-06 12:04:57 -07:00
hagen-danswer ac14369716 Added search quality testing pipeline (#1774) 2024-07-06 11:51:50 -07:00