Repository navigation

fix(inference): DeepSeek V4 C128 compressor and attn_sink loading patches - #4040

Merged

garrett361 merged 3 commits into

mainfrom

fix/dsv4-vllm-serving-patches

Oct 12, 2026

Merged

fix(inference): DeepSeek V4 C128 compressor and attn_sink loading patches#4040
garrett361 merged 3 commits into
mainfrom
fix/dsv4-vllm-serving-patches

Commits on Oct 12, 2026
- fix(inference): always run DeepSeek V4's C128 compressor store under CUDA graphs
  
  garrett361
  and
  claude
  committed
  150657f
- fix(inference): route DeepSeek V4 attn_sink loading through vLLM's weight loaders
  
  garrett361
  and
  claude
  committed
  372b9a4
- docs(inference): lead the DeepSeek V4 patch docstrings with the issue
  
  garrett361
  and
  claude
  committed
  cb0c693