Skip to content
This repository was archived by the owner on Oct 11, 2024. It is now read-only.

[3/N] rs/vllm quantization - Adding models to non-uniform refactor#189

Merged
varun-sundar-rabindranath merged 6 commits intovllm-quantizationfrom
rs/vllm-quantization-config-refactor-other-models
Apr 22, 2024
Merged

[3/N] rs/vllm quantization - Adding models to non-uniform refactor#189
varun-sundar-rabindranath merged 6 commits intovllm-quantizationfrom
rs/vllm-quantization-config-refactor-other-models

Commits

Commits on Apr 22, 2024

  • added gemma, llama, phi

    Robert ShawVarun Sundar Rabindranath
    Robert Shaw
    authored and
    Varun Sundar Rabindranath
    committed
    63e9e5b

  • deepseek

    Robert ShawVarun Sundar Rabindranath
    Robert Shaw
    authored and
    Varun Sundar Rabindranath
    committed
    6e4e1c9

  • added baichuan

    Robert ShawVarun Sundar Rabindranath
    Robert Shaw
    authored and
    Varun Sundar Rabindranath
    committed
    577ea97

  • added qwen

    Robert ShawVarun Sundar Rabindranath
    Robert Shaw
    authored and
    Varun Sundar Rabindranath
    committed
    cdc523c

  • gpt2 work

    Robert ShawVarun Sundar Rabindranath
    Robert Shaw
    authored and
    Varun Sundar Rabindranath
    committed
    1a5ef5f

  • starcoder2

    Robert ShawVarun Sundar Rabindranath
    Robert Shaw
    authored and
    Varun Sundar Rabindranath
    committed
    bed3d83