Add KV-Cache int8 quant support#10354
Closed
YanyunDuanIEI wants to merge 19 commits intovllm-project:mainfrom
Closed
Add KV-Cache int8 quant support#10354YanyunDuanIEI wants to merge 19 commits intovllm-project:mainfrom
YanyunDuanIEI wants to merge 19 commits intovllm-project:mainfrom
Commits
Commits on Nov 15, 2024
- committed
Yanyun Duan
Commits on Nov 18, 2024
Commits on Nov 20, 2024
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- authored
- committed
Commits on Dec 20, 2024
Commits on Jan 21, 2025
- committed