Skip to content

Fix HiCache with DeepSeek-V4.1 encoder SWA replay - #38957

Merged
kpham-sgl merged 3 commits into
sgl-project:dsv4.1from
kpham-sgl:fix/dsv41-encoder-replay-hicache
Sep 11, 2026
Merged

kpham-sgl merged 3 commits into
sgl-project:dsv4.1from
kpham-sgl:fix/dsv41-encoder-replay-hicache

Conversation

@kpham-sgl

@kpham-sgl kpham-sgl commented Sep 10, 2026

Copy link
Copy Markdown
Collaborator

Enable HiCache with DeepSeek-V4.1 encoder SWA bounded replay. Handle request-local SWA and select the HiCache consumer before replay.

Validation:

  • 39 focused tests and 16 GPU restore cases passed.
  • Host-cache reload passed.
  • AIME 2026: 465/480 (96.875%), 16 repeats, 10 capped outputs, zero request errors; 4× B300, TP4 + EP4, both replay flags enabled.

CI States

Latest PR Test (Base): ❌ Run #34546041788
Latest PR Test (Extra): ❌ Run #34546041689
Latest PR Test (AMD ROCm 10): ❌ Run #34546041800

@kpham-sgl
kpham-sgl merged commit 33e847d into sgl-project:dsv4.1 Sep 11, 2026
81 of 91 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

deepseek hicache Hierarchical Caching for SGLang

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant