Skip to content

[OUTDATED] perf: optimize fused AllReduce + RMSNorm (custom_all_reduce) - #3462

Closed
ftyghome wants to merge 2 commits into
ROCm:mainfrom
RadeonFlow:rf-ar
Closed

[OUTDATED] perf: optimize fused AllReduce + RMSNorm (custom_all_reduce)#3462
ftyghome wants to merge 2 commits into
ROCm:mainfrom
RadeonFlow:rf-ar

perf(custom_all_reduce): FLAT reduce-scatter stage1 + decode win-gate…

80fd821
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs