Skip to content

[WIP][LoRA] BF16 support for the experimental_sgl_trtllm MoE-LoRA path & lora expert_outer_shared - #4

Closed
yushengsu-thu wants to merge 9 commits into
trtllm-lora-bf16from
qwen3-30b-a3b-2507-bf16
Closed

[WIP][LoRA] BF16 support for the experimental_sgl_trtllm MoE-LoRA path & lora expert_outer_shared#4
yushengsu-thu wants to merge 9 commits into
trtllm-lora-bf16from
qwen3-30b-a3b-2507-bf16

[LoRA] opt5: prefill routing reuse — unify A/B stage routing block size

850faa8
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar