mirror of
https://github.com/TheTom/turboquant_plus.git
synced 2026-10-22 11:02:42 -05:00
7e469a0dc9
Results on Qwen 3.5 35B-A3B MoE and Qwopus v2 27B: - turbo3: 4.9× compression, 2.4 tok/s MoE / 1.3 tok/s Dense - q8_0 baseline: 85.0 tok/s MoE / 17.6 tok/s Dense - Speed regression: 13-35× (unoptimized Metal shader, tracked in #23) - Compression ratio target met, speed optimization needed Codex review corrections applied: - Fixed methodology description (was inconsistent with actual test params) - Changed "~35×" to "13-35×" (varies by model) - Marked quality claims as qualitative/unquantified - Noted compression ratios are theoretical not empirically measured - Added missing analysis caveats (single run, no stddev, no warm-up) Co-Authored-By: tturney@psyguard.ai Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>