Report Skippy artifact cold-start costs - #815
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
🚧 Files skipped from review as they are similar to previous changes (2)
📝 WalkthroughWalkthroughThis PR adds artifact cold-start diagnostics to the skippy-topology planning pipeline. A new ChangesArtifact Cold-Start Diagnostics
Estimated code review effort🎯 3 (Moderate) | ⏱️ ~20 minutes 🚥 Pre-merge checks | ✅ 4 | ❌ 1❌ Failed checks (1 warning)
✅ Passed checks (4 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Comment |
|
@michaelneale could you review this one when you get a chance? |
* origin/main: Add transport-aware Skippy stage ordering (#814) Share Skippy stage wire byte accounting (#818) Report Skippy artifact cold-start costs (#815) fix: debug output capturing for TUI / panics (#827) fix(hero): visual corrections for iPhone SE size devices (#838) Add Skippy stage role metadata (#816) Add Skippy request cache epoch telemetry (#817) Consolidate agent skills and fix stale docs (Windows deploy, repo map, design docs) (#836) feature(version): normalize version markers for different build types (#831) fix(website): fix visual regressions (#835) fix(gh): change micn to michaelneale in auto_assign.yml Revert "fix(gh): replace micn with IvGolovach in auto_assign.yml (not a collaborator)" fix(gh): replace micn with IvGolovach in auto_assign.yml (not a collaborator)
* origin/main: (29 commits) MoA: don't let small-model consensus pre-empt a still-running large model (#837) fix(console): render thinking traces as markdown Add bounded direct path repair (#846) Fix skippy smoke PR gate (#850) Stabilize skippy smoke chain startup (#849) fix(ci): switch back to auto-assign workflow fix(website): polish longform visual explainer (#843) fix: gemma thinking Carry GLM llama MTP patches (#840) Refresh llama.cpp canary patch queue (#839) Add transport-aware Skippy stage ordering (#814) Share Skippy stage wire byte accounting (#818) Report Skippy artifact cold-start costs (#815) fix: debug output capturing for TUI / panics (#827) fix(hero): visual corrections for iPhone SE size devices (#838) Add Skippy stage role metadata (#816) Add Skippy request cache epoch telemetry (#817) Consolidate agent skills and fix stale docs (Windows deploy, repo map, design docs) (#836) feature(version): normalize version markers for different build types (#831) fix(website): fix visual regressions (#835) ... # Conflicts: # AGENTS.md
Summary
Add cold-start artifact cost diagnostics to Skippy topology planning.
This PR is only about explaining the artifact cost of an accepted package-aware plan. It does not change stage ordering, stage roles, runtime loading, or the binary protocol.
Before
Package-aware planning could use cache and missing-artifact signals to affect placement, but the accepted plan did not summarize what startup would cost.
That left operators with a plan but not an explanation:
How It Works
artifact_diagnosticsruns after stages are selected.It aggregates selected stages:
cached_slice_bytesmissing_artifact_bytesIt emits a single info diagnostic when artifact signals are present:
Plain weighted plans without artifact signals stay quiet, so non-package topology planning does not get noisy diagnostics.
Why This Is Good
This makes package-aware planning explainable.
The planner can already choose a node because it has cached layers or because missing artifacts are cheap to transfer. This PR lets the accepted topology say that out loud. That matters for Skippy cold starts because slow startup is often artifact movement, not model execution.
It also prepares the next step toward metadata-first package planning: resolve package inventory, plan from cache/transfer signals, then materialize only the accepted stage artifacts.
Validation
cargo fmt --all -- --checkcargo test -p skippy-topology --libcargo clippy -p skippy-topology --all-targets -- -D warningsSummary by CodeRabbit
New Features
Tests