3 people fcdc6e4abf docs: M2 Pro 4-mag + sparse V confirmed stacking — 0.45x → 0.73x ...

Combined K+V dequant optimizations on M2 Pro: 62% improvement from
unoptimized baseline. Prefill blended at 90% of q8_0. Moved from
future work to results in paper Section 7.2.

Co-Authored-By: tturney@psyguard.ai
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-27 08:01:48 -05:00

..

papers

docs: M2 Pro 4-mag + sparse V confirmed stacking — 0.45x → 0.73x

2026-03-27 08:01:48 -05:00

threshold-ablation-logs

docs: M2 Pro 4-mag + sparse V confirmed stacking — 0.45x → 0.73x

2026-03-27 08:01:48 -05:00

context-scaling-deep-dive.md

docs: extended context scaling verified — 0.99x q8_0 through 32K context

2026-03-25 20:21:22 -05:00

decode-speed-hardware-analysis.md

docs: M5 long-context discovery — turbo3 ceiling 28% faster than q8_0 at 32K

2026-03-27 00:11:44 -05:00

decode-speed-status.md

docs: Mario PDF test confirms decode scaling — 0.66x q8_0 at 48K context

2026-03-25 22:08:23 -05:00

experiment-context-scaling-fix.md

docs: group-32 rotation failed (PPL 7.06)

2026-03-25 19:31:11 -05:00

experiment-layer-adaptive-extended.md

docs: layer-adaptive mode 2 verified 2K-32K — q8_0 quality at 3.5x compression

2026-03-26 00:17:35 -05:00

experiment-layer-adaptive.md

docs: layer-adaptive results — last 8 layers at q8_0 matches q8_0 quality at 3.5x compression

2026-03-25 18:44:37 -05:00

hardware-comparison-matrix.md

docs: update comparison matrix with 10 community testers from X post

2026-03-26 12:03:57 -05:00

niah-results-m5max-multikey.json

docs: NIAH multi-key distractor results — 100% both cache types through 32K

2026-03-26 15:33:30 -05:00

niah-results-m5max-multikey.md

docs: NIAH multi-key distractor results — 100% both cache types through 32K

2026-03-26 15:33:30 -05:00

niah-results-m5max-single.json

docs: NIAH v2 single-needle results — M5 Max baseline

2026-03-26 15:30:11 -05:00

niah-results-m5max-single.md

docs: NIAH v2 single-needle results — M5 Max baseline

2026-03-26 15:30:11 -05:00

pre-rotate-queries-investigation.md

docs: move engineering docs here from llama.cpp fork

2026-03-25 16:16:58 -05:00

pre-rotate-queries-plan.md

docs: move engineering docs here from llama.cpp fork

2026-03-25 16:16:58 -05:00

quality-benchmarks.md

docs: update all docs with q8_0 parity results (2747 tok/s, 4.6x compression)

2026-03-25 18:01:14 -05:00

speed-experiments.md

docs: block-32 breakthrough — q8_0 parity at 4.6x compression

2026-03-25 17:34:27 -05:00

threshold-ablation.md

docs: threshold ablation sweep (τ=1e-4 to 1e-8) for sparse V paper

2026-03-27 07:07:07 -05:00

turbo-speed-investigation.md

docs: update all docs with q8_0 parity results (2747 tok/s, 4.6x compression)

2026-03-25 18:01:14 -05:00

turboquant-plus-experiments.md

docs: comprehensive experiment status update — all 2026-03-26 results

2026-03-26 18:25:59 -05:00

upstream-pr-plan.md

fix: address Codex + Gemini review findings

2026-03-26 09:34:29 -05:00