Repository navigation

test(e2e): add Llama-4 and Llama-3.3 70b to nightly benchmarks - #900

Merged

key4ng merged 15 commits into

smg-project:mainfrom

paxiaatucsdedu:pan/llama-nightly-benchmark

Apr 1, 2026

Merged

test(e2e): add Llama-4 and Llama-3.3 70b to nightly benchmarks#900
key4ng merged 15 commits into
smg-project:mainfrom
paxiaatucsdedu:pan/llama-nightly-benchmark

Commits on Mar 27, 2026
- Add Llama-4 and Llama-3.3 to nightly benchmarks
  paxiaatucsdedu
  committed
  e3b68ab
- Replace mem-frac arg
  paxiaatucsdedu
  committed
  922aa74
- Drop HF_TOKEN and HF_HOME env vars
  paxiaatucsdedu
  committed
  812cf0d
- Select genai-bench api backend from E2E_RUNTIME
  paxiaatucsdedu
  committed
  8bdbbf2
- Temply test nighly bench in pr[do not merge]
  
  key4ng
  authored and
  paxiaatucsdedu
  committed
  a091cec
- Add startup_timeout for large MoE models in model_specs.py
  
  key4ng
  authored and
  paxiaatucsdedu
  committed
  d721496
- Update attention backend in model_specs.py from FLASHINFER to FLASH_ATTN
  
  key4ng
  authored and
  paxiaatucsdedu
  committed
  90543e6
- test done, revert changes for testing
  
  key4ng
  authored and
  paxiaatucsdedu
  committed
  a8ae4a6
- feat(e2e): add HiCache/flashinfer args for Llama-70B and disable ignore_eos for SGLang
  paxiaatucsdedu
  committed
  43247f5
- test(e2e): enable PR trigger for benchmark testing [do not merge]
  paxiaatucsdedu
  committed
  a4175e2
- Auto-answer genai-bench prompt for sglang
  paxiaatucsdedu
  committed
  17da2dc
- fix(e2e): revert conftest.py to main, remove HiCache flags, fix duplicate Scout entry
  paxiaatucsdedu
  committed
  e73a6c5
- test(e2e): remove unnecessary --trust-remote-code from Llama model specs
  paxiaatucsdedu
  committed
  91d1775
- revert: remove PR trigger for benchmark testing (revert e3afaad1)
  paxiaatucsdedu
  committed
  02a457e
Commits on Mar 30, 2026
- Merge branch 'main' into pan/llama-nightly-benchmark
  paxiaatucsdedu
  authored
  4edab60

Commits

Commits on Mar 27, 2026

Commits on Mar 30, 2026