This repository was archived by the owner on Oct 11, 2024. It is now read-only.

vllm - quantization : DO NOT MERGE#180

Closed

varun-sundar-rabindranath wants to merge 8 commits intoupstream-mainfrom

vllm-quantization

Commits on Apr 11, 2024

rebased w8a8
Varun Sundar Rabindranath
committed
add offline quantized inference
Varun Sundar Rabindranath
committed
use hf-model
Varun Sundar Rabindranath
committed

Commits on Apr 16, 2024

Cleanup / Refactor to support non-uniform quantization via config.
robertgshaw2-redhat
authored
refactor experiments.sh and profiling fixes
Varun Sundar Rabindranath
committed

Commits on Apr 22, 2024

[3/N] rs/vllm quantization - Adding models to non-uniform refactor (#189)
robertgshaw2-redhat
authored

Commits on Apr 24, 2024

Use cutlass kernels (#202)

varun-sundar-rabindranath
and
Varun Sundar Rabindranath
authored
format.sh
Varun Sundar Rabindranath
committed