Skip to content

[Bugfix][Model Runner V2] Honor use_fp64_gumbel when FlashInfer sampling is available - #62612

Open
cycancode wants to merge 1 commit into
vllm-project:mainfrom
cycancode:fix-mrv2-fp64-gumbel-flashinfer
Open

cycancode wants to merge 1 commit into
vllm-project:mainfrom
cycancode:fix-mrv2-fp64-gumbel-flashinfer