This repository was archived by the owner on Oct 11, 2024. It is now read-only.

Use cutlass kernels#202

Merged

varun-sundar-rabindranath merged 7 commits intovllm-quantizationfrom

vllm-quantization-cutlass

Apr 24, 2024

Commits on Apr 22, 2024

cutlass fused dq
Varun Sundar Rabindranath
committed
move cutlass stuff to cutlass_gemm.py
Varun Sundar Rabindranath
committed
Use only cutlass gemm and dq
Varun Sundar Rabindranath
committed
Remove dequant and cublas i8gemm
Varun Sundar Rabindranath
committed
add cutlass to requirements
Varun Sundar Rabindranath
committed
fix cutlass package naming
Varun Sundar Rabindranath
committed

Commits on Apr 24, 2024

Remove log_str that triggers device to host transfer
Varun Sundar Rabindranath
committed