Skip to content

[TRTLLM-10657][fix] Resolve MIXED_PRECISION quant config for DeepSeek W4A8 MoE experts - #18393

Open
brnguyen2 wants to merge 4 commits into
NVIDIA:mainfrom
brnguyen2:fix-deepseek-w4a8-mixed-precision-moe
Open

[TRTLLM-10657][fix] Resolve MIXED_PRECISION quant config for DeepSeek W4A8 MoE experts#18393
brnguyen2 wants to merge 4 commits into
NVIDIA:mainfrom
brnguyen2:fix-deepseek-w4a8-mixed-precision-moe

[TRTLLM-10657][test] Relocate DeepSeek-V3 mixed-precision quant unit …

11c3b3e
Select commit
Loading
Failed to load commit list.