[CI Failure]: V1 Test

[DarkLight1337]

Name of failing test

v1/spec_decode/test_max_len.py::test_eagle_max_len[TREE_ATTN-3]

Basic information

• Flaky test
• Can reproduce locally
• Caused by external libraries (e.g. bug in transformers)

🧪 Describe the failing test

RuntimeError: CUDA error: an illegal memory access was encountered

📝 History of failing test

Failing since #21496

https://buildkite.com/organizations/vllm/analytics/suites/ci-1/tests/54aa326d-c77c-8e84-8830-f9de1705b80a?period=14days&execution_id=019887e7-f764-79cb-b985-f8f6897849aa

CC List.

cc @tjtanaa

[tjtanaa]

Hi, @TheEpicDolphin , do you know if TREE ATTN is intended to be compatible with this unit test v1/spec_decode/test_max_len.py::test_eagle_max_len[TREE_ATTN-3] when the num_speculative_tokens > 1?
In this initial enablement PR #20401 , only test_eagle.py and test_tree_attention.py are testing the TREE ATTN backend.