docs(context): document the live HF discovery chain subjects - #2862
Conversation
|
Important Review skippedAuto reviews are limited based on label configuration. 🏷️ Required labels (at least one) (1)
Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Team Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: d6f56240f3
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| **`compute.vllm.load.v1`** — Model load command (GPU orchestrator → vLLM worker) | ||
| **`compute.vllm.status.v1`** — vLLM instance status (vLLM worker → GPU orchestrator) | ||
| **`hf.model.discovered.v1`** — HuggingFace model discovery (hf-agent → hf-research-agent; live 2026-08-31, 2275+ models seen) | ||
| **`hf.model.evaluated.v1`** — Discovery scored against benchmark criteria (hf-research-agent → model-registry G4 auto-register; threshold 110) |
There was a problem hiding this comment.
Document the actual 50-point registration threshold
For operators using this catalog to predict G4 registration, 110 is the maximum attainable evaluation score, not the auto-registration threshold. At this commit, HF_MIN_SCORE defaults to 50 in both Compose and hf-research-agent, while model-registry independently registers every evaluation scoring at least 50 and does not inspect passed; therefore models scoring 50–109 are auto-registered despite this entry. State 50 here, or distinguish the 110-point scale maximum from the pass and G4 thresholds.
Useful? React with 👍 / 👎.
Adds
hf.model.discovered.v1(hf-agent → hf-research-agent) andhf.model.evaluated.v1(hf-research-agent → model-registry G4) to the NATS subjects context — both missing despite the chain being live-validated on SPARK 2026-08-31 (2275 models discovered, scoring active at threshold 110). Companion to the PMOVES-autoresearch dossier fill (its fork PR #1).💘 Generated with Crush