mirror of
https://github.com/TheTom/turboquant_plus.git
synced 2026-10-23 03:22:55 -05:00
19-version kernel optimization log proves CUDA TQ4_1S decode gap is fundamental (float32 bandwidth + FMA density), not an optimization gap. Q4_K_M is the practical CUDA runtime answer. TQ4_1S optimal for Metal, storage/distribution format on CUDA. Co-Authored-By: tturney@psyguard.ai Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>