Skip to content

fix: sanitize non-finite logprobs in vllm async worker - #2962

Open
yuchenwang3 wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
yuchenwang3:fix-nonfinite-logprobs
Open

fix: sanitize non-finite logprobs in vllm async worker#2962
yuchenwang3 wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
yuchenwang3:fix-nonfinite-logprobs