Conversation
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
📝 WalkthroughWalkthroughThis PR disables two GPU functional tests by commenting out their execution commands in a test script. Changes are minimal and affect only test invocations with no functional logic modifications. Changes
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~2 minutes Possibly related PRs
Suggested labels
Suggested reviewers
🚥 Pre-merge checks | ✅ 4✅ Passed checks (4 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches
🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Actionable comments posted: 1
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.
Inline comments:
In `@tests/functional/L1_Functional_Tests_GPU.sh`:
- Around line 55-56: Restore the two commented-out run_test lines for
./tests/functional/grpo_megatron_lora.sh and
./tests/functional/grpo_megatron_lora_async.sh and wrap them with an explicit
gate (e.g., check SKIP_L1_GRPO_MEGATRON_LORA environment variable or a
--skip-l1-grpo flag) so the tests remain in CI but can be skipped; when
skipping, emit a clear log message that includes the tracking PR/issue
identifier (e.g., "Skipping L1 GRPO+Megatron+LoRA tests per PR#1234/issue#5678")
so re-enable criteria are visible. Ensure the gate logic is placed where the
original run_test invocations were removed and that the skip variable defaults
to false so coverage runs unless explicitly set.
ℹ️ Review info
⚙️ Run configuration
Configuration used: Path: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
Run ID: 26743456-3b95-440f-878a-c2ee6df553d1
📒 Files selected for processing (1)
tests/functional/L1_Functional_Tests_GPU.sh
| # run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora.sh | ||
| # run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora_async.sh |
There was a problem hiding this comment.
Avoid silently removing unique CI coverage; gate these tests with an explicit temporary switch.
Line 55 and Line 56 currently remove the only L1 coverage for GRPO+Megatron+LoRA (including async), which means these paths won’t run in the main CI flow (.github/workflows/cicd-main.yml:310-327, plus main/scheduled L1 behavior in lines 100-120 of that workflow). Please keep these invocations in place behind an explicit skip flag and log the tracking PR/issue so re-enable criteria stays visible.
Proposed change
-# run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora.sh
-# run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora_async.sh
+if [[ "${DISABLE_GRPO_MEGATRON_LORA_TESTS:-1}" == "1" ]]; then
+ echo "Temporarily skipping GRPO Megatron LoRA tests (tracking fix: PR `#1889`)"
+else
+ run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora.sh
+ run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora_async.sh
+fi📝 Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.
| # run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora.sh | |
| # run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora_async.sh | |
| if [[ "${DISABLE_GRPO_MEGATRON_LORA_TESTS:-1}" == "1" ]]; then | |
| echo "Temporarily skipping GRPO Megatron LoRA tests (tracking fix: PR `#1889`)" | |
| else | |
| run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora.sh | |
| run_test uv run --no-sync bash ./tests/functional/grpo_megatron_lora_async.sh | |
| fi |
🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.
In `@tests/functional/L1_Functional_Tests_GPU.sh` around lines 55 - 56, Restore
the two commented-out run_test lines for
./tests/functional/grpo_megatron_lora.sh and
./tests/functional/grpo_megatron_lora_async.sh and wrap them with an explicit
gate (e.g., check SKIP_L1_GRPO_MEGATRON_LORA environment variable or a
--skip-l1-grpo flag) so the tests remain in CI but can be skipped; when
skipping, emit a clear log message that includes the tracking PR/issue
identifier (e.g., "Skipping L1 GRPO+Megatron+LoRA tests per PR#1234/issue#5678")
so re-enable criteria are visible. Ensure the gate logic is placed where the
original run_test invocations were removed and that the skip variable defaults
to false so coverage runs unless explicitly set.
What does this PR do ?
Temp disable megatron lora grpo tests
These tests were failing and a fix is being worked on. In the mean time, let's skip the tests.
#1889
Issues
List issues that this PR closes (syntax):
Usage
# Add a code snippet demonstrating how to use thisBefore your PR is "Ready for review"
Pre checks:
Additional Information
Summary by CodeRabbit