Support mixtral kvcache reuse and remove kv_cache_fp8#898

Merged

regisss merged 8 commits into

huggingface:mainfrom

jychen21:support-mixtral-kvcache-reuse

May 4, 2024

Commits on Apr 16, 2024

Commits on Apr 17, 2024

Support mixtral kv-cache reuse and remove kv_cache_fp8
Jinyan Chen
committed
Modify white/black list to allow/block list
Jinyan Chen
committed

Commits on Apr 23, 2024

add mixtral fp8 test case
Jinyan Chen
committed

Commits on Apr 28, 2024

merge main branch
Jinyan Chen
committed
fix merge conflict
Jinyan Chen
committed

Commits on May 4, 2024

Merge branch 'main' into support-mixtral-kvcache-reuse
regisss
authored