Commit Graph
36 Commits
Author SHA1 Message Date
Jamison Lahman 46af76e98a chore(fmt): remove force-single-line (#12996) 2026-07-20 17:15:00 +00:00
Jamison LahmanandClaude Opus 4.8 c7ff13bbbb fix(model-server): merge custom CA roots in the entrypoint for distroless (#12761)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-08 17:34:30 +00:00
Jamison LahmanandClaude Opus 4.8 d557bd3702 refactor(model-server): gate DISABLE_MODEL_SERVER in python entrypoint (#12754)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-07 23:48:13 +00:00
Justin Tahara 97b98eb338 fix(model_server): cap torch threads to cgroup CPU quota (#12351) 2026-06-23 22:28:11 +00:00
Nikolas Garza e92bddc9a5 fix(sentry): reduce captured content in error events (#12077) 2026-06-15 19:41:09 +00:00
WenxiandClaude Opus 4.6 ca216abe71 chore(logging): enforce ruff G004, convert f-strings to %-style (#10767)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-05-01 23:31:52 +00:00
Justin Tahara 2b04b2ec80 chore(sentry): make trace sample rates env-configurable, default celery to 0 (#10374) 2026-04-20 18:40:13 +00:00
Nikolas Garza 357bc91aee feat(indexing): capture swallowed per-doc exceptions in Sentry (#10149) 2026-04-14 23:01:42 +00:00
Nikolas Garza d177a833f0 feat(sentry): add release tracking to backend and frontend (#9773) 2026-03-30 22:35:38 +00:00
Yuhong Sun 1dfb62bb69 chore: Remove unused resources from model server (#7094) 2025-12-29 16:18:37 -08:00
Jamison Lahman 10ad536491 chore(mypy): enable warn-unused-ignores (#6893) 2025-12-19 12:00:30 -08:00
8c52444bda fix(infra): lazy load and don't warm up model server models (#5527)
Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-10-07 09:07:40 -07:00
Sam WaddellandPhil Critchfield 5867ab1d7d feat: add non-root user to backend and model-server images (#5134)
* feat: add non-root user to backend and model-server image

* feat: update values to support security context for index, inference, and celery_shared

* feat: add security context support for index and inference

* feat: add celery_shared security context support to celery worker templates

* fix: cache management strategy

* fix: update deployment files for volume mount

* fix: address comments

* fix: bump helm chart version for new security context template changes

* fix: bump helm chart version for new security context template changes

* feat: move useradd earlier in build for reduced image size

---------

Co-authored-by: Phil Critchfield <phil.critchfield@liatrio.com>
2025-08-20 13:49:50 -07:00
rkuo-danswerandRichard Kuo 3fc8027e73 pass through various id's and log them in the model server for better… (#4485)
* pass through various id's and log them in the model server for better tracking

* fix test

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
2025-04-10 00:40:57 +00:00
rkuo-danswerandRichard Kuo 8c3a953b7a add prometheus metrics endpoints via helper package (#4436)
* add prometheus metrics endpoints via helper package

* model server specific requirements

* mark as public endpoint

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
2025-04-03 16:52:05 +00:00
rkuo-danswerandRichard Kuo 81d04db08f Feature/request id middleware 2 (#4427)
* stubbing out request id

* passthru or create request id's in api and model server

* add onyx request id

* get request id logging into uvicorn

* no logs

* change prefixes

* fix comment

* docker image needs specific shared files

---------

Co-authored-by: Richard Kuo (Onyx) <rkuo@onyx.app>
2025-04-02 22:30:03 +00:00
Chris Weaver 52b96854a2 Handle move errors (#4317)
* Handle move errors

* Make a warning
2025-03-21 11:11:12 -07:00
joachim-danswer 463340b8a1 Reduce ranking scores for short chunks without actual information (#4098)
* remove title for slack

* initial working code

* simplification

* improvements

* name change to information_content_model

* avoid boost_score > 1.0

* nit

* EL comments and improvements

Improvements:
  - proper import of information content model from cache or HF
  - warm up for information content model

Other:
  - EL PR review comments

* nit

* requirements version update

* fixed docker file

* new home for model_server configs

* default off

* small updates

* YS comments - pt 1

* renaming to chunk_boost & chunk table def

* saving and deleting chunk stats in new table

* saving and updating chunk stats

* improved dict score update

* create columns for individual boost factors

* RK comments

* Update migration

* manual import reordering
2025-03-13 17:35:45 +00:00
Richard Kuo (Danswer) fb931ee4de fixes 2025-02-07 17:28:17 -08:00
Richard Kuo (Danswer) bc2c56dfb6 improve gpu detection functions and logging in model server 2025-02-07 16:59:02 -08:00
pablonyx 27acd3387a Auth specific rate limiting (#3463)
* k

* v1

* fully functional

* finalize

* nit

* nit

* nit

* clean up with wrapper + comments

* k

* update

* minor clean
2024-12-29 23:34:23 +00:00
Emerson Gomes b5d0df90b9 Remove hardcoded root path for HF models 2024-12-16 19:03:15 -08:00
pablodanswer 21ec5ed795 welcome to onyx 2024-12-13 09:56:10 -08:00
pablodanswer 848d86b886 feat: sentry updates (#2929) 2024-10-26 19:06:46 +00:00
pablodanswer 61424de531 add sentry (#2786)
* add sentry

* nit

* nit

* add requirement to ee

* try to ensure sentry is installed in integration tests
2024-10-17 23:20:37 +00:00
Yuhong Sun 8de04acb7f k 2024-08-20 14:06:49 -07:00
Yuhong Sun 5ab4d94d94 Logging Level Update (#2165) 2024-08-18 21:53:40 -07:00
hagen-danswer bbb8c5ff0b Speed up docker launch (#2099)
* use move instead of copy

* added logging

* fix overwrites

* tested throughly

* fixes

* clearer commenting
2024-08-13 00:45:05 +00:00
Yuhong Sun 386b229ed3 Cohere Rerank (#2109) 2024-08-11 14:22:42 -07:00
Yuhong Sun 8cd1eda8b1 Rework Rerankers (#2093) 2024-08-08 21:33:49 -07:00
hagen-danswer 1be1959d80 Changed default local model to nomic (#1943) 2024-07-31 18:54:02 -07:00
Yuhong Sun e361e92230 Healthcheck for model server (#1350) 2024-04-18 16:22:38 -07:00
Yuhong Sun b59912884b Fix Model Server (#1320) 2024-04-10 23:13:22 -07:00
Yuhong Sun 2db906b7a2 Always Use Model Server (#1306) 2024-04-07 21:25:06 -07:00
Yuhong Sun 4b45164496 Background Index Attempt Creation (#1010) 2024-01-28 23:14:20 -08:00
Yuhong Sun 7433dddac3 Model Server (#695)
Provides the ability to pull out the NLP models into a separate model server which can then be hosted on a GPU instance if desired.
2023-11-06 16:36:09 -08:00