[CI/Build] Update Llama4 eval yaml

[zhewenl]

Purpose

Fix some missing pieces in #21810

Test Plan

ChartQA:

> bash .buildkite/lm-eval-harness/run-lm-eval-chartqa-vllm-vlm-baseline.sh -m meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8 -l 100 -t 8
...
| Tasks |Version|Filter|n-shot|     Metric      |   |Value|   |Stderr|
|-------|------:|------|-----:|-----------------|---|----:|---|-----:|
|chartqa|      0|none  |     0|anywhere_accuracy|↑  | 0.81|±  |0.0394|
|       |       |none  |     0|exact_match      |↑  | 0.51|±  |0.0502|
|       |       |none  |     0|relaxed_accuracy |↑  | 0.81|±  |0.0394|

MMLU-Pro:

bash .buildkite/lm-eval-harness/run-lm-eval-mmlupro-vllm-baseline.sh -m meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8 -l 250 -t 8 -f 5
...
|       Tasks       |Version|    Filter    |n-shot|  Metric   |   |Value |   |Stderr|
|-------------------|------:|--------------|-----:|-----------|---|-----:|---|-----:|
|mmlu_pro           |    2.0|custom-extract|      |exact_match|↑  |0.7743|±  |0.0069|
| - biology         |    2.1|custom-extract|     5|exact_match|↑  |0.8920|±  |0.0197|
| - business        |    2.1|custom-extract|     5|exact_match|↑  |0.8360|±  |0.0235|
| - chemistry       |    2.1|custom-extract|     5|exact_match|↑  |0.8280|±  |0.0239|
| - computer_science|    2.1|custom-extract|     5|exact_match|↑  |0.8040|±  |0.0252|
| - economics       |    2.1|custom-extract|     5|exact_match|↑  |0.8800|±  |0.0206|
| - engineering     |    2.1|custom-extract|     5|exact_match|↑  |0.6640|±  |0.0299|
| - health          |    2.1|custom-extract|     5|exact_match|↑  |0.7680|±  |0.0268|
| - history         |    2.1|custom-extract|     5|exact_match|↑  |0.7240|±  |0.0283|
| - law             |    2.1|custom-extract|     5|exact_match|↑  |0.5480|±  |0.0315|
| - math            |    2.1|custom-extract|     5|exact_match|↑  |0.8640|±  |0.0217|
| - other           |    2.1|custom-extract|     5|exact_match|↑  |0.6840|±  |0.0295|
| - philosophy      |    2.1|custom-extract|     5|exact_match|↑  |0.7080|±  |0.0288|
| - physics         |    2.1|custom-extract|     5|exact_match|↑  |0.8360|±  |0.0235|
| - psychology      |    2.1|custom-extract|     5|exact_match|↑  |0.8040|±  |0.0252|

| Groups |Version|    Filter    |n-shot|  Metric   |   |Value |   |Stderr|
|--------|------:|--------------|------|-----------|---|-----:|---|-----:|
|mmlu_pro|      2|custom-extract|      |exact_match|↑  |0.7743|±  |0.0069|

[chatgpt-codex-connector]

💡 Codex Review

https://github.com/vllm-project/vllm/blob/45f1d12f2b8c11143ee308e7c2b7586377e9735a/.buildkite/lm-eval-harness/configs/Meta-Llama-4-Maverick-17B-128E-Instruct-FP8.yaml#L7-L12
Update MMLU baseline to measured accuracy

The updated instructions and test plan document MMLU‑Pro results of about 0.7743 exact_match, yet the YAML still asserts a ground truth of 0.80. test_lm_eval_correctness.py consumes this file and checks np.isclose against the value field, so the regression test will continue to fail even when the model reproduces the numbers reported in this commit. Please lower the expected value (or justify raising the actual score) so the baseline reflects the measured metric.

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR.

• @codex fix this CI failure
• @codex address that feedback