[Dev] Changes to support multimodule pipelining - #2092

Closed

yashaswikarnati wants to merge 17 commits into

yashaswikarnati:yash/dev_1f1b_multimodule_pipelining

Commits on Nov 2, 2025

add stage checkers to p2p comm
yashaswikarnati
committed
fb5ff3d
ensure 3d tensor in multimodule comm
yashaswikarnati
committed
ccfc4a4
changes to 1f1b schedule to support multimodule comm
yashaswikarnati
committed
77bd063
remove unsued imports
yashaswikarnati
committed
0ea94c3
remove extra debug log
yashaswikarnati
committed
d81d90d
schedule changes to support 1F1B pipelineing
yashaswikarnati
committed
6340fb2
wrap with DDP added to transformer block
yashaswikarnati
committed
fb36fd2
multimodule schedule tests
yashaswikarnati
committed
35d3d43

Commits on Nov 3, 2025

set batch p2p comm False for reliable pp communication
yashaswikarnati
committed
7ef2a33
precommit hooks
yashaswikarnati
committed
2068929
add copyright header
yashaswikarnati
committed
00dd7b0
fix multimodule test
yashaswikarnati
committed
1ff716f

Commits on Nov 4, 2025

add test cases for different dp
yashaswikarnati
committed
6c96ab1
format
yashaswikarnati
committed
6418dac
format
yashaswikarnati
committed
113283f
Merge branch 'dev' into yash/dev_1f1b_multimodule_pipelining
yashaswikarnati
authored
1efd80a

Commits on Nov 5, 2025

change back to pp_rank
yashaswikarnati
committed
4f8dff6