Skip to content

[Fix] Adapt to transformers 5.18 / 5.19 changes - #43688

Merged
Fridge003 merged 1 commit into
mainfrom
mmangkad/transformers-5.19-compat
Oct 12, 2026
Merged

Fridge003 merged 1 commit into
mainfrom
mmangkad/transformers-5.19-compat

Conversation

@mmangkad

@mmangkad mmangkad commented Oct 11, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Keep up with transformers: adapt to the 5.18 / 5.19 changes on top of the 5.19 pin.

  • DeepSeek GGUF tokenizer: build the BPE with tokenizers directly. The converter it used moved, and the new one shifts special-token ids.
  • Drop the nested rope_parameters validation backport, now upstream.
  • Accept indexed_attention (the renamed DSA layer type) in HY-V4 / Qwen4-Exp.
  • Drop the removed _commit_hash read and the NPU MiniMax-M3 do_convert_rgb arg.
  • Correct stale comments: the Dinov2 layout change in Hunyuan3D landed in 5.18, not 5.19, and Granite's layer types are rewritten during config init.
  • Fix a stale GLM-5.3-Flash cookbook note.

Verification

B300 with cookbook flags, 5.18/5.19 vs 5.17. GSM8K (chat, 1319q):

Model New 5.17
Qwen3.8-Flash-Next 97.95 97.95
Hy4-preview-FP8 96.58 96.73
MiniMax-M2 95.89 96.04
GLM-5.3-Flash (image/video also OK) 97.34 97.11

DeepSeek-V4-Flash MXFP4 GGUF via expert_pack: tokenizer files byte-identical to before, outputs identical. 5.19 vs 5.18: config, tokenizer and image/video processor outputs identical across 51 checkpoints; Gemma 4 single/multi-video and Qwen-Image outputs identical; Transformers backend GSM8K unchanged.


CI States

Latest PR Test (Base): ✅ Run #38139344726
Latest PR Test (Extra): ❌ Run #38139344235
Latest PR Test (AMD ROCm 10): ❌ Run #38139344618

@mintlify

mintlify Bot commented Oct 11, 2026 •

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated
sglang-doc 🟢 Ready View Preview Oct 11, 2026, 12:32 PM

💡 Tip: Enable Automations to automatically generate PRs for you.

@github-actions github-actions Bot added documentation Improvements or additions to documentation diffusion SGLang Diffusion labels Oct 11, 2026
@mmangkad

Copy link
Copy Markdown
Collaborator Author

/tag-and-rerun-ci

@github-actions github-actions Bot added the run-ci CI: run the baseline test suite on this PR label Oct 11, 2026
@mmangkad

Copy link
Copy Markdown
Collaborator Author

/rerun-test registered/e2e/models_large/test_laguna_nvfp4_nightly.py

@github-actions

github-actions Bot commented Oct 11, 2026 •

Copy link
Copy Markdown
Contributor

🚀 4-gpu-b200 (1 test): ✅ View workflow run

cd test/ && python3 registered/e2e/models_large/test_laguna_nvfp4_nightly.py

@Fridge003
Fridge003 merged commit 166b4ae into main Oct 12, 2026
382 of 471 checks passed
@Fridge003
Fridge003 deleted the mmangkad/transformers-5.19-compat branch October 12, 2026 06:25
Liwansi added a commit to Liwansi/sglang_vans that referenced this pull request Oct 13, 2026
…n_allgather

* 'main' of https://github.com/sgl-project/sglang: (236 commits)
  [NPU] Stabilize HiCache and registered CI tests (sgl-project#43308)
  [Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) (sgl-project#43799)
  [Docs] Update GLM-5.3-Flash playground: B300 default, CP8, EP and PD (sgl-project#43802)
  [DSV4.1][PD][1/N] Support prefill node use cp parallel strategy (sgl-project#40323)
  [BCG][DSV4-Flash][CP] Support DeepSeek V4 prefill with interleave CP and breakable CUDA graphs (sgl-project#38603)
  [XPU] Support decode context parallelism (DCP) on Intel XPU (sgl-project#34355)
  Keep NIXL Mamba checkpoint keys separate by TP rank (sgl-project#43594)
  Capture KV host transfer buffers (sgl-project#43711)
  [CI] Move tests that do not need GB300 off the per-PR GB300 suite (sgl-project#43784)
  [HiCache] Preserve all MTP KV and recurrent state (sgl-project#40223)
  [HiCache] Support Mamba in buffer-only host memory mode (sgl-project#36345)
  [PD] Poison the deferred abort ack when a Mooncake send fails (sgl-project#43719)
  [Perf] Route BF16 mixed-batch decode tails through decode attention (sgl-project#43238)
  [Fix] Link cuda_ipc JIT against CUDA driver stubs dir (sgl-project#43764)
  docs: clarify prefill CP terminology and simplify wording (sgl-project#43787)
  [diffusion][xpu] FLUX.2: enable the bit-exact Triton SwiGLU on XPU (sgl-project#41940)
  [Fix] Adapt to transformers 5.18 / 5.19 changes (sgl-project#43688)
  [XPU CI] Optimize PR CI per-file timeouts and fail hanging tests fast (sgl-project#42048)
  [Deps] Bump FlashInfer to 0.7.1 (sgl-project#43494)
  docs: sync LMSYS SGLang blog cards (sgl-project#43462)
  ...

This branch was successfully deployed

1 active deployment
staging - docs — b6019800 Deployed Oct 11, 2026 by mintlify[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

diffusion SGLang Diffusion documentation Improvements or additions to documentation release-highlight Candidate PR for release note highlight run-ci CI: run the baseline test suite on this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants