[CI Failure]: Nightly B200 LM Eval Failure

[robertgshaw2-redhat]

Name of failing test

FAILED evals/gsm8k/test_gsm8k_correctness.py::test_gsm8k_correctness_param[Qwen1.5-MoE-W4A16-CT-tp1] - AssertionError: Accuracy too low: 0.000 < 0.450 - 0.080

Basic information

• Flaky test
• Can reproduce locally
• Caused by external libraries (e.g. bug in transformers)

🧪 Describe the failing test

Crash

📝 History of failing test

https://buildkite.com/vllm/ci/builds/38163#019a66fd-11a1-407d-8b8e-047044b28f45

CC List.

No response

[zhewenl]

should be fixed by #28324