Skip to content

CI: add numerical parity coverage for the static-cache export path #329

Description

@titaiwangms

Gap

PR #328 adds the static-cache ONNX Attention export path (is_causal=0 + a phase-split If). Its correctness is covered in CI on two axes, but a third is missing:

Proposed follow-up

Author a synthetic static-cache parity test:

  • Build a tiny in-memory synthetic model (same approach static_cache_decode_test.py uses).
  • Export the static-cache variant and a dynamic reference.
  • Assert token-id and/or logit parity within tolerance over N decode steps.
  • Wire it into a GPU CI tier (static-cache decode requires CUDA).

This complements the runtime-kernel routing test added in #328 — that test checks the right kernel runs; this one would check the numbers are right.

Refs: #328

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions