fp16/GQA export fixes + capture-safe static-cache attention (supersedes #328) - #340

Closed

titaiwangms wants to merge 30 commits into

mainfrom

fix/gqa-fp16-fold-salvage

Commits on Jun 5, 2026

Fix fp16 GQA export emitting fp32 packed weights in fold passes

titaiwangms
and
Copilot
committed
7aaff4c
Strip dead pre-pack weights in FoldConcatInitializersPass

titaiwangms
and
Copilot
committed
a5684d7
test(fold-concat): name the live-packed-result invariant in DCE assert

titaiwangms
and
Copilot
committed
b9d78d2
test(fold-concat): assert survived packed-QKV values are exact after DCE

titaiwangms
and
Copilot
committed
c4c3b18
test(fold-concat): gate packed-QKV values through serialize→reload

titaiwangms
and
Copilot
committed
b7f7c16
test(fold-concat): add mean|abs| degeneracy assert + poison negative control

titaiwangms
and
Copilot
committed
14623f4
test: use IR-native ir.save instead of onnx.save in _fold_concat_test

titaiwangms
and
Copilot
committed
cb6272d
test(dtype): assert warning fires on declared/const_value dtype disagreement

titaiwangms
and
Copilot
committed
f415e3d
test(fp16): add e2e regression test guarding df203cc fold-pass dtype retention

titaiwangms
and
Copilot
committed
0639a82
test(fp16): make fp16 fold e2e fixture function-scoped for hermetic, xdist-safe runs

titaiwangms
and
Copilot
committed
390cb30
fix(tasks): stamp explicit present KV-cache output shapes for GQA

titaiwangms
and
Copilot
committed
be84ece
Warn on partial present-shape param set in _register_kv_cache_outputs

titaiwangms
and
Copilot
committed
98352ff
docs: add fp16/GQA ONNX-export gotchas skill + fp16 GQA fold-fix changelog

titaiwangms
and
Copilot
committed
bafbab2
style: apply lintrunner (ruff format + D205) to salvaged tests

titaiwangms
and
Copilot
committed
8dbb30d
docs: re-add GQA present-KV changelog entry + de-anchor SKILL.md from cherry-pick SHAs

titaiwangms
and
Copilot
committed
0832016
fix(static-cache): use is_causal=0 + explicit causal mask for opset-24 Attention

titaiwangms
and
Copilot
committed
3b33532
test(static-cache): add always-masked decode frontier-bound guard (Option Y)

titaiwangms
and
Copilot
committed
a0c987a
style: apply lintrunner (ruff-format) to Option-Y cherry-picked files

titaiwangms
and
Copilot
committed
e1922e9
docs(skill): add graph-capture compatibility section (no in-graph control flow)

titaiwangms
and
Copilot
committed
d4b2f5d
docs: document the shipped static-cache causal-mask change (review findings 1/2/5)

titaiwangms
and
Copilot
committed
184d30c
test(static-cache): isolate causal mask from padding bound (review findings 3/4)

titaiwangms
and
Copilot
committed
08038ed
test(static-cache): rename test_static_cache_attention_is_causal -> _causal_via_explicit_mask

titaiwangms
and
Copilot
committed
c87d776
fix(static-cache): apply PR #340 review findings (docs, MLA test, mask contract)

titaiwangms
and
Copilot
committed
bf7cbf2
fix(static-cache tests): fold in Copilot-bot review items for #340

titaiwangms
and
Copilot
committed
bbc03e7
test(static-cache): clarify tolerance comment + explicit present-shape assert

titaiwangms
and
Copilot
committed
c2bedd6

Commits on Jun 6, 2026

perf(static-cache): hoist layer-invariant causal mask to build-once

titaiwangms
and
Copilot
committed
36617c9
chore(static-cache): fold in 4 triple-review Minors

titaiwangms
and
Copilot
committed
3b3fe9c

Commits on Jun 8, 2026

fix(kv-cache): fail-closed on partial present-shape parameter sets

titaiwangms
and
Copilot
committed
9fafc6e
chore(kv-cache): fold in 3 readability Minors on the fail-closed change

titaiwangms
and
Copilot
committed
9464e49
Merge branch 'main' into fix/gqa-fp16-fold-salvage
titaiwangms
authored
8e4ae19