Skip to content

Supporting llama int4 inference using AutoGPTQ in HPU (#166)#1125

Closed
HolyFalafel wants to merge 3 commits into
huggingface:mainfrom
HabanaAI:dev/danny/uint4_readme_us
Closed

Supporting llama int4 inference using AutoGPTQ in HPU (#166)#1125
HolyFalafel wants to merge 3 commits into
huggingface:mainfrom
HabanaAI:dev/danny/uint4_readme_us

Commits

Commits on Jul 4, 2024