Main2main 0324#7610

Closed

22dimensions wants to merge 6 commits intovllm-project:mainfrom

22dimensions:main2main_0324

Commits on Mar 30, 2026

upgrade to 0324
22dimensions
committed
fix: add vllm_is_batch_invariant compatibility wrapper

claude
authored and
22dimensions
committed
fix issued caused by [Async][Spec Decoding]

22dimensions
and
claude
committed
Fix kv_cache and batch inference issues and Fix MLA kv_cache IndexError and kv_offload import

leo-pony
authored and
22dimensions
committed
fix: adapt to upstream vLLM buffer and initialization changes

claude
authored and
22dimensions
committed
fix: properly handle input_ids and positions buffer types for PCP/DCP

claude
authored and
22dimensions
committed