Skip to content

[TRTLLM-7263][fix] Prevent recreation of cublas handles in lora_grouped_gemm every call - #6968

Merged
amitz-nv merged 1 commit into
NVIDIA:mainfrom
amitz-nv:dev-fix-lora-grouped-gemm-cublas-handle-lifetime
Aug 19, 2025
Merged

[TRTLLM-7263][fix] Prevent recreation of cublas handles in lora_grouped_gemm every call#6968
amitz-nv merged 1 commit into
NVIDIA:mainfrom
amitz-nv:dev-fix-lora-grouped-gemm-cublas-handle-lifetime

Change the lifetime of cublasWrapper in lora_grouped_gemm to the thre…

245bb0c
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 19, 2025 in 1s

DCO

All commits are signed off!

View more details on DCO