Skip to content

MoE Overlap: Add 2 CUDA Events to Synchronize Computation & Communication Operations for Forward and Backward Respectively - #2630

Closed
yanminjia wants to merge 1 commit into
NVIDIA:mainfrom
yanminjia:moe_overlap
Closed

MoE Overlap: Add 2 CUDA Events to Synchronize Computation & Communication Operations for Forward and Backward Respectively#2630
yanminjia wants to merge 1 commit into
NVIDIA:mainfrom
yanminjia:moe_overlap

split the CUDA event for synchronization into 2 events with regard to…

badc400
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs