Initial fused `GPTQ` implementation#141

Closed

jeromeku wants to merge 144 commits into

unslothai:mainfrom

jeromeku:gptq-draft

Commits on Nov 29, 2023

Commits on Nov 30, 2023

Commits on Dec 1, 2023

Commits on Dec 5, 2023

Pre-release 2023 December version (Mistral, Prelim DPO, WSL, bug fixes) (#16)
danielhanchen
authored

Commits on Dec 6, 2023

Fix generation
danielhanchen
committed

Commits on Dec 11, 2023

Commits on Dec 12, 2023

Update llama.py
danielhanchen
committed

Commits on Dec 14, 2023

Commits on Dec 15, 2023

Commits on Dec 16, 2023

Fix Mistral
danielhanchen
committed

Commits on Dec 17, 2023

Torch version, docs, readme, general loader
danielhanchen
committed

Commits on Dec 18, 2023

Update __init__.py

shimmyshimmer
authored and
danielhanchen
committed
Fix typo
danielhanchen
committed

Commits on Dec 22, 2023

Small fixes (#48)
danielhanchen
authored

Commits on Dec 25, 2023

Commits on Dec 26, 2023

Commits on Dec 27, 2023

Nightly (#56)
danielhanchen
authored

Commits on Dec 28, 2023

DPO, SWA fixes (#57)
danielhanchen
authored

Commits on Dec 29, 2023

Prelim Qwen, Deepseek support (#58)
danielhanchen
authored

Commits on Dec 30, 2023

Fix Kaggle issues
danielhanchen
committed

Commits on Dec 31, 2023

Commits on Jan 1, 2024

Commits on Jan 4, 2024

Fix tokenizer + docs (#62)
danielhanchen
authored

Commits on Jan 5, 2024

Commits on Jan 6, 2024

Fix tokenizer, bias, dropout supported for LoRA (#69)
danielhanchen
authored

Commits on Jan 7, 2024

Fix PEFT downcasting (#70)
danielhanchen
authored

Commits on Jan 18, 2024

Commits on Jan 21, 2024

Hotfix (#118)
danielhanchen
authored

Commits on Jan 22, 2024

2-4x faster native HF inference (#119)
danielhanchen
authored

Commits on Jan 25, 2024

Fix bugs (#129)
danielhanchen
authored

Commits on Jan 26, 2024

Commits on Jan 27, 2024

Commits on Jan 29, 2024

Commits on Feb 5, 2024