Commit Graph
1 Commits
Author SHA1 Message Date
8ec1a07bfb feat: TurboQuant, KV cache compressor, utils, distortion suite #6 #7 #8 #10
TurboQuant (Algorithm 2): PolarQuant(b-1) + QJL(1) = b bits total.
19 tests, 93% coverage.

KVCacheCompressor: TurboQuant for K cache (IP), TurboQuantMSE for V cache (MSE).
5 tests, 100% coverage.

Utils: bit packing, memory footprint calculation.
9 tests, 98% coverage.

Distortion validation suite: MSE bounds, IP bounds, monotonicity.
20 tests verifying against paper Table 2.

Full suite: 127 tests, 98% total coverage.

Codex review on TurboQuant:
- Noted that double-side IP estimation is biased (documented, tested)
- True bit rate is b + 32/d (norm overhead documented)
- QJL correction factor is inside QJL.dequantize (verified)

Co-Authored-By: tturney@psyguard.ai
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-24 21:04:56 -05:00