DeepSeek-V3 recipes for H100

[scsudhakaran]

This PR updates the DeepSeek-V3 H100 recipes with a configuration that provides better performance numbers.

Summary by CodeRabbit

Release Notes

• Configuration Updates

  • Updated DeepSeek V3 pretraining configuration parameters for H100 GPU environments with adjusted model parallelization strategy
  • Added pipeline layout parameters to optimize resource distribution across training nodes
  • Refined secondary pretraining configuration variant for improved performance characteristics

• Performance Enhancements

  • Enabled expandable memory segment allocation for DeepSeek V3 pretraining on H100 hardware to optimize GPU memory utilization

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[malay-nagda]

@scsudhakaran can you remove the draft tag?
was this tested with v2 configs (GBS=16384)

[coderabbitai]

📝 Walkthrough

Walkthrough

The changes modify DeepSeek V3 pretraining configurations for H100 GPUs by adjusting tensor and pipeline model parallelism settings, propagating pipeline layout configurations conditionally, and adding targeted environment variable configuration for specific hardware and model combinations.

Changes

Cohort / File(s)	Summary
Pipeline Layout Configuration scripts/performance/configs/deepseek/deepseek_llm_pretrain.py	Modified pipeline_model_parallel_layout assignment to use base_cfg.pp_layout when provided; otherwise recompute via set_deepseek_v3_pipeline_model_parallel_layout().
Workload Base Configurations scripts/performance/configs/deepseek/deepseek_workload_base_configs.py	Updated DEEPSEEK_V3_PRETRAIN_CONFIG_H100_V1 with tensor_model_parallel_size reduced from 4 to 2 and added pp_layout="Et
Environment Configuration scripts/performance/perf_plugins.py	Added conditional branch to set PYTORCH_CUDA_ALLOC_CONF="expandable_segments:True" for deepseek v3 pretraining on h100 GPU.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

• #2186: Sets gb200 to use base_cfg.pp_layout in deepseek_llm_pretrain.py, parallel to base_cfg.pp_layout propagation in this PR.
• #2076: Directly modifies deepseek LLM pretrain config to propagate base_cfg.pp_layout and introduces pp_layout field in workload configs.
• #2060: Modifies model-specific environment variable gating in perf_plugins.py for different model cases.

Suggested labels

Run CICD

Suggested reviewers

• malay-nagda
• dingqingy-nv

🚥 Pre-merge checks | ✅ 3 | ❌ 1

❌ Failed checks (1 warning)

Check name	Status	Explanation	Resolution
Test Results For Major Changes	⚠️ Warning	PR aims to improve DeepSeek-V3 H100 performance through configuration changes but provides no performance test results, benchmarks, or before-and-after metrics.	Add documented performance test results comparing old (TP=4) and new (TP=2) configurations, including throughput numbers, testing environment details, and convergence metrics.

✅ Passed checks (3 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title 'DeepSeek-V3 recipes for H100' directly and clearly describes the main change: adding/updating DeepSeek-V3 configuration recipes optimized for H100 hardware.
Docstring Coverage	✅ Passed	Docstring coverage is 100.00% which is sufficient. The required threshold is 80.00%.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing touches

• 📝 Generate docstrings

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch scsudhakaran/deepseekv3-h100

---

No actionable comments were generated in the recent review. 🎉

🧹 Recent nitpick comments

scripts/performance/perf_plugins.py (1)

270-276: Minor style nit: missing space after elif.

Line 270 uses elif( while the preceding if ( on line 262 has a space before the parenthesis. This is inconsistent and may be flagged by ruff.

Proposed fix

-        elif(
+        elif (

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[scsudhakaran]

/ok to test 3bdd232

[scsudhakaran]

/ok to test 724e50c