Commit Graph
19 Commits
Author SHA1 Message Date
Timothy Jaeryang Baek 1469f73b31 refac 2026-10-10 21:47:06 +04:00
Timothy Jaeryang Baek 0ffd86967f refac 2026-10-08 23:21:57 +04:00
Timothy Jaeryang Baek 91853205e8 refac 2026-10-08 23:06:53 +04:00
Timothy Jaeryang Baek 24e30d1cbd refac 2026-10-05 12:17:25 +04:00
Timothy Jaeryang Baek f50f9e6252 refac 2026-10-01 03:31:20 +04:00
Classic298 7fa705f3b8 feat: let operators expose chosen file metadata to the model in retrieved sources (#29696)
Custom metadata attached to a file upload now reaches the vector DB, but the model still never sees it. Both prompt-assembly paths build their output from a fixed field set: the classic RAG <source> tag carries only id, name and resource type, and the retrieval tools return only content, source and file id per chunk. A scraper that records where each document came from therefore cannot get that origin in front of the model, so answers cannot state it.

RAG_SOURCE_METADATA_KEYS names the chunk metadata keys allowed through to the model. Configured keys are emitted as extra attributes on the <source> tag and as extra fields on tool result chunks, covering both retrieval paths. It is empty by default, so nothing changes for existing deployments.

An allowlist instead of passing everything through, because chunk metadata also carries file hashes, collection names, embedding config and relevance scores, which would then be added to every retrieved chunk of every request. Values are attacker-controllable through an uploaded file, so they are escaped before they go into the tag, and a configured key can never displace a field the tag or the chunk already defines.

Reported in open-webui/open-webui#29486.
2026-09-19 17:02:59 -05:00
Timothy Jaeryang Baek 363ad352fe refac 2026-08-24 17:12:56 -04:00
Timothy Jaeryang Baek 1b72899f24 refac 2026-08-10 00:26:44 -06:00
Timothy Jaeryang Baek 9951fbe549 refac 2026-07-09 17:37:04 -05:00
Timothy Jaeryang Baek bd6e0b61c2 refac 2026-07-09 17:28:05 -05:00
Timothy Jaeryang Baek 4067e357b2 refac 2026-06-29 21:31:49 -05:00
rileydes-improving 567c4aabe9 feat: add support for Valkey vector database (#24769)
* feat: add support for Valkey vector database

Signed-off-by: Riley Des <riley.desserre@improving.com>

* feat: add CLIENT SETNAME to Valkey vector store connections

Set client_name on GlideClientConfiguration for both the main client
and batch client so connections are identifiable in CLIENT LIST,
monitoring dashboards, and CloudWatch metrics.

Signed-off-by: Riley Des <riley.desserre@improving.com>

---------

Signed-off-by: Riley Des <riley.desserre@improving.com>
2026-06-01 12:20:01 -07:00
Duncan Ogilvie 5e73fd569d Improve local development setup 2025-06-08 15:17:08 +02:00
Timothy J. Baek 79f440f302 refac: byebye litellm 2024-05-25 14:43:35 -07:00
Silentoplayz 563377a58a fix 2024-04-30 20:04:30 +00:00
Silentoplayz b763535c92 Added: Environment Variable ANONYMIZED_TELEMETRY=False to .env.example & Dockerfile files to prevent/disable the creation of telemetry_user_id file created by Chroma in Docker installation methods. 2024-04-30 19:10:44 +00:00
Self Denial 802eb3beec Use locally bundled version of the LiteLLM cost map json
Intended to avoid repetitive startup connections by setting `LITELLM_LOCAL_MODEL_COST_MAP="True"`
2024-04-05 16:27:31 -06:00
Timothy J. Baek f741adc6c9 refac: OLLAMA_API_BASE_URL deprecated 2024-03-06 11:44:00 -08:00
Timothy J. Baek cc50cc10e6 feat: sd frontend integration 2024-02-21 18:36:40 -08:00