Commit Graph
6 Commits
Author SHA1 Message Date
05fde211c0 Add head_dim=64 limitation warning to getting-started guide
Models with head_dim=64 (e.g., GPT-OSS-120B) may crash or produce
degraded output with turbo compression. WHT requires sufficient
dimensionality for CLT convergence. Reported by NigelTufnel12345.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: tturney@psyguard.ai
2026-04-01 12:17:43 -05:00
c760dc58d1 Update docs with community validation and benchmarking guide improvements
- Add compression reference table and config warning to getting-started.md
- Add independent validation from sztlink, Madreag, and mudler (APEX/LocalAI) across asymmetric, layer-aware, MoE, and sparse V papers
- Update sparse-v-dequant.md with Madreag 4-GPU cross-validation
- Minor README wording fix (branch -> repository)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: tturney@psyguard.ai
2026-04-01 11:25:15 -05:00
81360216b5 Fix wikitext download link in getting started guide
Replace parquet link with direct raw text download. Add HF CLI as
alternative. Credit: @henkiespenkie44

Co-Authored-By: tturney@psyguard.ai
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-31 13:38:15 -05:00
14280a6f91 Add missing branch checkout step to getting started guide
Users were building from main instead of feature/turboquant-kv-cache,
resulting in "Unsupported cache type: turbo4" errors.

Co-Authored-By: tturney@psyguard.ai
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-31 13:07:45 -05:00
c122fd0320 Add Sparse V and Boundary V sections to getting started guide
Document built-in optimizations: Sparse V dequant (Metal, auto-enabled),
Boundary V (auto-enabled with turbo2-V), and maximum V compression config.

Co-Authored-By: tturney@psyguard.ai
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-31 11:13:55 -05:00
7f5043ba2f Add getting started guide for new testers
Standalone doc with build instructions (Metal, CUDA, HIP, Windows),
config selection table, benchmarking steps, and how to share results.
Community requested.

Co-Authored-By: tturney@psyguard.ai
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-31 11:00:21 -05:00