Skip to content

[Kernel] Pass a device pointer into the quantize kernel for the scales#5159

Merged
simon-mo merged 3 commits intovllm-project:mainfrom
neuralmagic:tms/quantize_kernel_scale_ptr
Jun 3, 2024
Merged

[Kernel] Pass a device pointer into the quantize kernel for the scales#5159
simon-mo merged 3 commits intovllm-project:mainfrom
neuralmagic:tms/quantize_kernel_scale_ptr

Commits

Commits on Jun 1, 2024

Commits on Jun 3, 2024