onyx/backend/model_server/constants.py at b4caa85cd4e5ba8ea2d53fcdaa413db739eabf82 - onyx - Gitea: Git with a cup of tea

starred/onyx

0 Fork 0

mirror of https://github.com/onyx-dot-app/onyx.git synced 2026-10-23 03:42:59 -05:00

Files

T

a5a516fa8a refactor(model): move api-based embeddings/reranking calls out of model server (#5216 )

* move api-based embeddings/reranking calls to api server out of model server, added/modified unit tests

* ran pre-commit

* fix mypy errors

* mypy and precommit

* move utils to right place and add requirements

* precommit check

* removed extra constants, changed error msg

* Update backend/onyx/utils/search_nlp_models_utils.py

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

* greptile

* addressed comments

* added code enforcement to throw error

---------

Co-authored-by: Jessica Singh <jessicasingh@Mac.attlocal.net>
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

2025-08-20 21:50:21 +00:00

9 lines

164 B

Python

Raw Blame History

 MODEL_WARM_UP_STRING = "hi " * 512
 INFORMATION_CONTENT_MODEL_WARM_UP_STRING = "hi " * 16
 class GPUStatus:
     CUDA = "cuda"
     MAC_MPS = "mps"
     NONE = "none"