Skip to content

fix: inverse WHT in test-turbo-quant.c round-trip (#59) - #93

Merged
TheTom merged 1 commit into
feature/turboquant-kv-cachefrom
fix/test-turbo-quant-inverse-wht
Apr 20, 2026
Merged

fix: inverse WHT in test-turbo-quant.c round-trip (#59)#93
TheTom merged 1 commit into
feature/turboquant-kv-cachefrom
fix/test-turbo-quant-inverse-wht

Conversation

@TheTom

@TheTom TheTom commented Apr 20, 2026

Copy link
Copy Markdown
Owner

Rebased cherry-pick of #63 by @seanrasch onto current feature/turboquant-kv-cache tip.

Adds turbo_cpu_fwht_inverse() and applies it in the test so round-trip metrics are computed in the correct domain. No runtime impact — test-only fix.

See #63 for full discussion and test results.

Co-Authored-By: seanrasch

@TheTom
TheTom merged commit f4ffeb4 into feature/turboquant-kv-cache Apr 20, 2026
20 of 49 checks passed
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
…-wht

fix: inverse WHT in test-turbo-quant.c round-trip (AtomicBot-ai#59)
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Aug 2, 2026
…AtomicBot-ai#5)

4 parallele Subagents (Vulkan/AMD, CUDA/MoE, arXiv Papers, Multi-GPU/Batching).
51 Items gesammelt, dedupliziert, 5 Quick-Wins verifiziert.

Verifikation: 3/5 Quick-Wins bereits im Fork (ggml-org#15524=AtomicBot-ai#6, ggml-org#16391=--cram, ggml-org#19754= warmup).
PR ggml-org#25479 (Pascal MMVQ) bereits als AtomicBot-ai#3 ✅. PR ggml-org#22887 (4K per Iter) bereits im Fork.

9 neue ROADMAP-Items hinzugefügt:
- TheTom#89 Transfer Queue AMD RDNA3 (PR ggml-org#19976)
- TheTom#90 MUL_MAT_ID Non-Square Tile (Discussion ggml-org#22598)
- TheTom#91 Internal AllReduce Kernel (PR ggml-org#22299)
- TheTom#92 RateQuant KV Cache (arXiv:2605.06675)
- TheTom#93 InnerQ KV Cache (arXiv:2602.23200)
- TheTom#94 FineMoE Expert Offloading (arXiv:2502.05370)
- TheTom#95 Shared Expert Aux Stream (TensorRT-LLM)
- TheTom#96 Speculative Checkpointing (PR ggml-org#19493)
- TheTom#97 Backend-agnostic TP Meta Device (PR ggml-org#19378)

Vollständiger Report: docs/fork/2026-07-26_OPTIMIZATION_RESEARCH.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant