Skip to content

remove unused moe changes , modify _q_kv_without_cu_seqlens and _SplitForwardGatherBackward #1180

remove unused moe changes , modify _q_kv_without_cu_seqlens and _SplitForwardGatherBackward

remove unused moe changes , modify _q_kv_without_cu_seqlens and _SplitForwardGatherBackward #1180

Annotations

1 error and 1 warning

training_16GPU_4DP2TP2PP_FSP (910B)

failed Nov 1, 2024 in 1m 28s