deps: bump deep_ep pin to V2 merge commit b306af0 - #2411
Conversation
Bumps the deep_ep git pin in pyproject.toml from bfded348 (2025-10-29, pre-V2) to b306af0 (2026-04-29), which is the merge commit of DeepEP PR NVIDIA-NeMo#605 "Introducing EPv2". Why --- The current pin predates the DeepEP V2 API (ElasticBuffer, PP/CP/Engram support). Consumers of NeMo-RL's Megatron backend that follow NVIDIA/Megatron-LM#4632 ("Shape Y" Megatron V2 adoption) cannot resolve deep_ep.ElasticBuffer with the current pin; the virtualenv still installs the pre-V2 tree. This change bumps only the pin. It does not by itself change any NeMo-RL code path. Paired with Megatron-LM#4632, it enables the end-to-end V2 path that is already running on AWS p5en.48xlarge 2x H200 in the reproduction repo below. Upstream references ------------------- * deepseek-ai/DeepEP#605 (V2 merge 2026-04-29) * NVIDIA/Megatron-LM#4632 (Megatron-side V2 adoption) Reproduction ------------ End-to-end reproduction (Dockerfile + K8s manifests + smoke bench) is public at: https://github.com/antonai-work/nemo-rl-deepep-v2-efa Related NeMo-RL PR (separate concern, same fleet): NVIDIA-NeMo#2410 (Dockerfile LD_LIBRARY_PATH for EFA OFI discovery) Signed-off-by: Anton Alexander <antonai@users.noreply.github.com>
|
Closing as superseded. This PR bumped the Rebasing this PR as-is would regress that — it would drop the |
Summary
Bumps
deep_epgit pin inpyproject.tomlfrombfded348(2025-10-29, pre-V2) tob306af0(2026-04-29), the merge commit of deepseek-ai/DeepEP#605 "Introducing EPv2: faster EP, and Engram/PP/CP supports".Why
The current pin predates the DeepEP V2 API reshape (
Buffer->ElasticBuffer, PP/CP/Engram support). Without this bump, consumers who follow the Megatron-side V2 adoption (NVIDIA/Megatron-LM#4632, "Shape Y") cannot importdeep_ep.ElasticBufferbecause the NeMo-RL virtualenv still installs the pre-V2 tree.This PR is intentionally scoped to the pin only - it does not change any NeMo-RL code path. End-to-end V2 enablement requires pairing this bump with Megatron-LM#4632.
Scope
Single-file change to
pyproject.toml:deep_ep @ git+.../DeepEP.git@bfded348...pins become...@b306af06afd412c88e51e71802951606e40b7358.Validation / reproduction
End-to-end reproduction (Dockerfile, Kubernetes manifests, 2-node p5en.48xlarge dispatch+combine smoke bench, vLLM MoE end-to-end chat completion) is public at:
Verified inside the reproduction tree:
deep_epinstalls at commitb306af0withElasticBufferimport succeeding.DeepEP/tests/elastic/test_ep.pyruns on 2x H200 EFA at p50 ~740us dispatch+combine.Related PRs
LD_LIBRARY_PATHso AWS EFA's OFI plugin is discoverable. Same fleet, different concern - filed independently so each can be reviewed on its own merits.Risk / compatibility
deep_ep.Buffersymbol is gone in V2. If a downstream NeMo-RL code path still imports it, that path breaks with or without Megatron#4632. Searches ofNVIDIA-NeMo/RLshow DeepEP is consumed through Megatron-Core, not directly, so NeMo-RL itself has no directdeep_ep.Buffercall sites.