server : disable embeddings/pooling on the speculative draft/MTP context - #24942
Closed
liminfei-amd wants to merge 1 commit into
Closed
server : disable embeddings/pooling on the speculative draft/MTP context#24942liminfei-amd wants to merge 1 commit into
liminfei-amd wants to merge 1 commit into
background
wait
wait-all
cancel
parallel
Loading