Skip to content

Fix TurboQuant get_kv_cache_shape crash with hybrid models on cache_dtype_str='auto' - #52745

Open
vzografos wants to merge 1 commit into
vllm-project:mainfrom
vzografos:fix-turboquant-hybrid-auto-cache-dtype
Open

Fix TurboQuant get_kv_cache_shape crash with hybrid models on cache_dtype_str='auto'#52745
vzografos wants to merge 1 commit into
vllm-project:mainfrom
vzografos:fix-turboquant-hybrid-auto-cache-dtype

Commits

Commits on Aug 18, 2026