[Spec Decode] Update extract_hidden_states to use deferred kv_connector clear#37013

mgoin merged 6 commits into

vllm-project:mainvllm-project/vllm:mainfrom

fynnsu:extract_hidden_states_updatefynnsu/vllm:extract_hidden_states_updateCopy head branch name to clipboard