TheTomandClaude Opus 4.6 e1d4ff8d23 docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models ...

Symmetric turbo4 is catastrophic on dense models (KLD=6.86, NIAH 0/15).
Asymmetric K=FP16 fixes everything (KLD=0.003, NIAH 15/15, top-1 98.1%).

Tested on Qwen2.5-7B-Instruct-8bit (28 layers, all KV cache).
Quality test suite added: scripts/mlx_quality_suite.py

Co-Authored-By: Tom Turney <tturney1@gmail.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-05 09:32:30 -05:00

..

mlx_quality_Qwen2.5-7B-Instruct-8bit_20260405_090645.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00

mlx_quality_Qwen2.5-7B-Instruct-8bit_20260405_090759.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00

mlx_quality_Qwen2.5-7B-Instruct-8bit_20260405_091743.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00

mlx_quality_Qwen2.5-7B-Instruct-8bit_20260405_091833.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00

mlx_quality_Qwen3.5-2B-8bit_20260405_090355.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00

mlx_quality_Qwen3.5-2B-8bit_20260405_090444.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00

mlx_quality_Qwen3.5-2B-8bit_20260405_090504.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00

mlx_quality_Qwen3.5-2B-8bit_20260405_090514.md

docs: add NIAH/KLD quality validation — asymmetric mandatory for dense models

2026-04-05 09:32:30 -05:00