fix(ci): allow exhaustive Rust studies to finish - #1071
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
Included review availability: Your plan provides up to 1 included review per hour; 0 remain after this review. 📝 WalkthroughWalkthroughThe ChangesStatistical studies timeout
Estimated code review effort: 1 (Trivial) | ~5 minutes Merge Risk: ⚪ Minimal · up to This localized CI change extends the allowed runtime for exhaustive statistical studies and adds a deadline-boundary regression test; no actionable merge-blocking risk remains beyond normal checks and review. Possibly related PRs
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Exact-head validation is queued for
Please publish an independent current-head review after the hosted evidence completes. Normal squash auto-merge is armed; no self-approval or bypass. @opencode-agent review @cwl-noema-review review |
|
The current head advanced to https://github.com/ContextualWisdomLab/fast-mlsirm/actions/runs/32361489065 Please review only this exact head and regenerate all protected evidence. Auto-merge remains normal squash, with no bypass or self-approval. @opencode-agent review @cwl-noema-review review |
|
Current-head follow-up: pushed |
|
Root-cause repair pushed at 527c50e: the failed Strix report was a preventive HIGH finding claiming future secret exposure while also stating no active hardcoded secret existed. The statistical-study workflow now declares a no-secret boundary and requires reviewed |
|
@opencode-agent review Please review exact current head |
|
Current-head validation for 527c50e: statistical workflow tests pass 7 tests, changed workflow passes actionlint, changed test Ruff and interrogate are both 100%, and git diff check passes. Local Rust Mokken compilation reached the dependency phase but stopped at the host disk ceiling with No space left on device; generated target output was removed, and hosted Rust Checks remain authoritative for the exact head. Please review 527c50e and merge only after terminal-success Checks and the protected review gate. |
seonghobae
left a comment
There was a problem hiding this comment.
Current-head review for 527c50e768b7ee8d42703153e86af026ae8ebb5a against protected main@04d0bc21a2a20693bcf16108cd76d394fe844d23.
Reviewed the changed statistical-study workflow, deadline contract, secret boundary, Mokken regression, and their callers. No actionable correctness or security finding was found. Focused proof: 7 workflow tests passed, actionlint passed, Interrogate 100%, and git diff --check passed. This is a comment-only review; normal protected review and terminal Checks remain required.
seonghobae
left a comment
There was a problem hiding this comment.
Current-head review update for 47c1af6.
Root cause of the two failing Python matrix jobs was identified from run 32382836237: the new changelog fragment omitted its required ## Fixed section, causing test_every_repository_fragment_matches_the_authoritative_format and the fail-closed CLI assertion to fail. Added the missing section only. Focused changelog/statistical workflow tests now pass (15), Ruff, Interrogate 100%, actionlint, and diff checks pass. This is a source/documentation fix; regenerate Checks at the new exact HEAD.
|
@opencode-agent review @cwl-noema-review review Please review exact current HEAD 47c1af6 and revalidate the repaired changelog contract. |
|
Exact-head validation note for |
|
@opencode-agent Please perform a review-only formal review of exact current PR head |
|
Manual current-head review completed for |
|
@opencode-agent @cwl-noema-review please review exact current head |
|
Reviewed current HEAD 47c1af6 after CodeGraph impact analysis. The exhaustive ignored-Rust study now has an explicit 7,200-second operation bound plus independent 180-minute job ceiling, keeps the workflow secret-free, and preserves terminal evidence. The Mokken Monte Carlo contract correctly keeps normal-trait recovery calibrated while treating skewed traits as distribution-sensitivity evidence rather than requiring an invariant AISP c=0.3 cutoff; the PR adds the supporting APA references. Python workflow/deadline tests: 19 passed; actionlint, Ruff, compileall, and diff checks passed. Hosted Rust Checks are green; no source change is required. |
|
Caution Review failedAn error occurred during the review process. Please try again later. Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Important Review skippedAuto incremental reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Pull request was converted to draft
Summary
Root cause
Protected
main@04d0bc21a2a20693bcf16108cd76d394fe844d23has two independent Statistical Studies failures.1.5 * (1.2 * |Z| - 0.9)had theoretical SD1.5 * 1.2 * sqrt(1 - 2/pi) ≈ 1.085, versus SD1.5in the normal condition. Because Loevinger's H is a normed covariance defined relative to observed item marginals/test-score distribution, the fixture was confounding skewness with an approximately 28% narrower latent spread. The deterministic failing valuemean H = 0.2555332676is reproduced by that fixture; this is not evidence by itself of a defect in the Rust H arithmetic.The skew condition now standardizes the half-normal draw with its analytic mean
sqrt(2/pi)and SDsqrt(1 - 2/pi)before the shared1.5scale factor. This isolates distribution shape while retaining the same latent location/scale target. The study verifies the aggregate simulated theta moments and requires the calibrated H band under both normal and moment-matched skew conditions. AISP full-recovery acceptance remains calibrated on the normal condition rather than asserting that a user-selectedc = 0.3item-selection cutoff is distribution-invariant.An independent deterministic reference diagnostic using the test RNG and the documented covariance/max-covariance equations reproduced:
0.3894676911;0.2555332676;0.3814238617.This changes the simulation contract, not production Mokken arithmetic.
Literature basis
The repository's Rust implementation follows van der Ark (2007) and the
mokkenreference mechanics. Loevinger's H is defined from observed covariance relative to the maximum covariance given the item marginals; contemporary methodological descriptions likewise characterize H/Hi in relation to the score distribution. The0.3value is an interpretation/AISP lower-bound rule of thumb, not an invariance theorem across differently dispersed latent populations.Validation
Predecessor-head evidence is historical only. Exact current head is
0f143a300c11a963b958eec9bacb0acf0deca15e; regenerate acceptance evidence for this SHA.Previously established focused workflow proof:
actionlint .github/workflows/statistical-studies.ymlpytest -q tests/test_statistical_studies_workflow.py tests/test_subprocess_deadlines.py tests/test_ignored_rust_subprocess_deadlines.py tests/test_ignored_rust_shard.py tests/test_subprocess_deadline_edges.py tests/test_subprocess_deadline_bounded_reap.py tests/test_subprocess_deadline_process_group_leak.py— 48 passedgit diff --checkCurrent-head CI/security/static-analysis runs were regenerated after the scientific-fixture correction and must complete normally. No gate bypass, secret injection, or release is included.
Closes #1276 when merged.
@opencode-agent review @cwl-noema-review review
Summary by CodeRabbit
Chores
Tests