Skip to content

fix: don't use cuda-graphs for vllm generation#187

Merged
parthchadha merged 1 commit intomainfrom
pchadha/disable-cuda-graph
Apr 15, 2025
Merged

fix: don't use cuda-graphs for vllm generation#187
parthchadha merged 1 commit intomainfrom
pchadha/disable-cuda-graph

Commits

Commits on Apr 15, 2025