3 people 86bcbbe59a Add norm correction to Python prototype quantization path ...

PolarQuant.dequantize() now re-normalizes reconstructed rotated
coordinates to unit norm before inverse rotation, matching the
production llama.cpp grp_norm / recon_norm correction.

On Qwen2.5-3B, this drops 4-bit PPL from 19.39 to 8.47 (near-lossless)
and 3-bit from 1369 to 70.6. No regression on TinyLlama or Mistral.

Includes benchmark scripts for TQ vs IsoQuant/RotorQuant comparison
and norm correction A/B testing.

Co-Authored-By: tturney@psyguard.ai
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-30 10:57:38 -05:00

..

__init__.py

infra: project scaffold — CI, pyproject, CLAUDE.md, PLAN.md #1

2026-03-24 20:43:16 -05:00

benchmark_llama.sh

feat: README overhaul, Apache 2.0 license, benchmark script #22

2026-03-25 00:09:59 -05:00

benchmark_norm_correction.py

Add norm correction to Python prototype quantization path

2026-03-30 10:57:38 -05:00

benchmark_ppl_tq_vs_rq.py

Add norm correction to Python prototype quantization path

2026-03-30 10:57:38 -05:00

benchmark_results.md

feat: benchmark results — turbo3/turbo4 vs q8_0/q4_0 on M5 Max #22

2026-03-25 01:06:59 -05:00

demo.py

feat: add demo benchmark script for quick validation

2026-03-24 21:05:53 -05:00

run_benchmark.py

feat: benchmark results — turbo3/turbo4 vs q8_0/q4_0 on M5 Max #22

2026-03-25 01:06:59 -05:00

temporal_decay_prototype.py

experiment: temporal decay prototype — 3→2 requant VIABLE

2026-03-26 17:29:58 -05:00

test_outlier_comparison.py

feat: outlier comparison benchmark — matches Prince Canuma's ratios

2026-03-24 21:21:53 -05:00

test_with_llama.py

feat: integration test at real Qwen 3.5 KV cache dimensions #16

2026-03-24 21:15:14 -05:00

validate_real_model.py

feat: validate rotation Gaussianization on real KV tensors #18 #20

2026-03-24 21:36:34 -05:00