Repository navigation
test(OMN-10474): cover node quality scoring golden chain - #497
Conversation
29 tests covering handle_quality_scoring_compute and score_code_quality: all six dimension presence/range, empty input, syntax errors, unsupported languages, preset thresholds (strict/standard/lenient), custom weights, compliance threshold logic, metadata fields, and frozen-model invariant.
|
Warning Rate limit exceeded
To keep reviews running without waiting, you can enable usage-based add-on for your organization. This allows additional reviews beyond the hourly cap. Account admins can enable it under billing. ⌛ How to resolve this issue?After the wait time has elapsed, a review can be triggered using the We recommend that you space out your commits to avoid hitting the rate limit. 🚦 How do rate limits work?CodeRabbit enforces hourly rate limits for each developer per organization. Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout. Please see our FAQ for further information. ℹ️ Review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: 📒 Files selected for processing (1)
✨ Finishing Touches🧪 Generate unit tests (beta)
Review rate limit: 0/5 reviews remaining, refill in 5 minutes and 30 seconds. Comment |
|
| Verdict | Meaning | Blocks merge? |
|---|---|---|
passed |
No critical/error findings | No |
blocked |
CRITICAL or ERROR findings found | Yes |
degraded |
All models unavailable (infra) | No (pilot) |
Powered by omniintelligence.review_pairing.cli_review — node-based adversarial review via HandlerLlmCliSubprocess (OMN-8524)
Summary
tests/test_golden_chain_quality_scoring_compute.pywith 29 unit tests covering the full handler stack fornode_quality_scoring_computeTestQualityScoringGoldenChain(exerciseshandle_quality_scoring_computeend-to-end via Pydantic models) andTestScoreCodeQualityPure(exercises the purescore_code_qualityfunction directly)below_thresholdvscompletedmetadata status, frozen-model invariantContext
The handler was already fully implemented — this PR adds the missing golden-chain test layer. The only existing tests were contract tests (topic names, schema refs); there were no behavioral tests exercising the scoring logic.
Related: OMN-10474
Test plan
uv run pytest tests/test_golden_chain_quality_scoring_compute.py -v— 29/29 passuv run pytest tests/ -m "not kafka" -q— 2966 pass, 4 pre-existing Postgres integration failures (require live DB, unrelated to this change)uv run ruff format+uv run ruff check— cleanpre-commit run --files tests/test_golden_chain_quality_scoring_compute.py— all hooks pass