Skip to content

fix(recipes): pin transformers in deepseek-v32-fp4 perf jobs (cherry-pick #8690) - #8951

Merged
pvijayakrish merged 1 commit into
release/1.1.0from
dagil/cherrypick-DYN-2878-deepseek-v32-perf
May 1, 2026
Merged

fix(recipes): pin transformers in deepseek-v32-fp4 perf jobs (cherry-pick #8690)#8951
pvijayakrish merged 1 commit into
release/1.1.0from
dagil/cherrypick-DYN-2878-deepseek-v32-perf

Conversation

@dagil-nvidia

Copy link
Copy Markdown
Collaborator

Summary

Cherry-pick of #8690 to release/1.1.0. Pins transformers==4.57.6 in the deepseek-v32-fp4 perf recipes so the aiperf install step does not silently upgrade transformers to 5.x, which lacks model_type=deepseek_v32 support and breaks tokenizer load.

Fixes DYN-2878
Fixes https://nvbugs/6109655

Conflict resolution

release/1.1.0 already shipped aiperf==0.7.0 (vs. main's 0.6.0), so the cherry-pick conflicted on the install line in both agg-round-robin/perf.yaml and disagg-kv-router/perf.yaml. Resolved by keeping aiperf==0.7.0 from the release branch and adding the transformers==4.57.6 pin from the upstream fix. Final line in both files:

pip install "aiperf==0.7.0" "transformers==4.57.6"

The transformers pin is the actual fix; aiperf version is unchanged from what release/1.1.0 already had.

Original PR

Test plan

  • CI passes
  • QA re-runs recipes/deepseek-v32-fp4/trtllm/disagg-kv-router/perf.yaml and agg-round-robin/perf.yaml against the rc9 build and confirms perf job exits 0

Made with Cursor

@dagil-nvidia
dagil-nvidia requested review from a team as code owners April 30, 2026 21:56
@github-actions github-actions Bot added the fix label Apr 30, 2026
@pvijayakrish
pvijayakrish merged commit 6685067 into release/1.1.0 May 1, 2026
64 of 65 checks passed
@pvijayakrish
pvijayakrish deleted the dagil/cherrypick-DYN-2878-deepseek-v32-perf branch May 1, 2026 00:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants