Misc inference fixes - #4397

Merged

sidsingh-nvidia merged 16 commits into

NVIDIA:mainfrom

sidsingh-nvidia:siddharth/misc-inference-fixes

Apr 23, 2026

Commits on Apr 20, 2026

tune mamba kernel like vllm
sidsingh-nvidia
committed
1376e4b
add attribution to vllm
sidsingh-nvidia
committed
658454b
fix the completions API to return usage statistics and accept ignore_eos
sidsingh-nvidia
committed
d5c5001
sq relu fix
sidsingh-nvidia
committed
65caf92
Revert "fix the completions API to return usage statistics and accept ignore_eos"
sidsingh-nvidia
committed
b199aa1
fix completions API to return usage stats and accept ignore_eos
sidsingh-nvidia
committed
61c62b8

Commits on Apr 21, 2026

Merge branch 'main' into siddharth/misc-inference-fixes
sidsingh-nvidia
authored
c1b5c26

Commits on Apr 22, 2026

format
sidsingh-nvidia
committed
2b1e854
Merge branch 'main' into siddharth/misc-inference-fixes
sidsingh-nvidia
authored
cd10037
align completions to chat completions
sidsingh-nvidia
committed
c744556
format
sidsingh-nvidia
committed
908d772
Merge branch 'main' into siddharth/misc-inference-fixes
sidsingh-nvidia
authored
823aa26
minor
sidsingh-nvidia
committed
9a98c55
Merge branch 'main' into siddharth/misc-inference-fixes
sidsingh-nvidia
authored
131286f
format
sidsingh-nvidia
committed
6df6a9c
Merge branch 'main' into siddharth/misc-inference-fixes
sidsingh-nvidia
authored
93244f8