Hybrid cp example#1

Closed

AndyBug0 wants to merge 40 commits into

hybrid-cp-example

Commits on Nov 12, 2025

support hybrid-cp+fsdp and support pp
xiaoyao0115
committed

Commits on Dec 3, 2025

Commits on Dec 4, 2025

add hotswitch solver
wuguohao
committed
add only_packing_no_scheduling for hybrid-cp
xiaoyao0115
committed

Commits on Dec 8, 2025

Commits on Dec 9, 2025

merge remote branch
wuguohao
committed
merge remote branch
wuguohao
committed

Commits on Dec 10, 2025

hybrid-cp feature for dev branch (Author: Parth Kunlun Tailai)
xiaoyao0115
committed
clean code, need to fix thd+fsdp nan issue and vpp input tensor out-of-index issue
xiaoyao0115
committed

Commits on Dec 11, 2025

add profile memory; add multiprocess solver
wuguohao
committed

Commits on Dec 22, 2025

interface change
wuguohao03
committed

Commits on Dec 23, 2025

fix solver
wuguohao03
committed
resolver merge remote conflict
wuguohao03
committed
merge conflict
wuguohao03
committed

Commits on Dec 24, 2025

fix mem simulation for hotcp samples && fix TP bcast
Wang.Chenyu
committed
simplify indexed dataset code
Wang.Chenyu
committed

Commits on Dec 25, 2025

Merge branch 'hybrid-cp-example' of https://github.com/AndyBug0/Megatron-LM into wcy/hybrid_cp_example
Wang.Chenyu
committed

Commits on Dec 30, 2025

adaptation
root
committed
modify script
wuguohao03
committed
add stash commit
wuguohao03
committed
optimize packing perf
Wang.Chenyu
committed
optimize packing perf
Wang.Chenyu
committed
add flag for async scheduler and new scheduler
wuguohao03
committed
fix launch script
Wang.Chenyu
committed
resolver merge conflict and fix some bugs
wuguohao03
committed
Merge pull request #1 from AndyBug0/wcy/hybrid_cp_example
AndyBug0
authored

Commits on Jan 20, 2026

limit thread number in background process
wuguohao03
committed