Skip to content

feat(4090-profile): update model inventory to 8b variants + add SPARK peer - #1442

Merged
POWERFULMOVES merged 5 commits into
mainfrom
feat/4090-profile-spark-peer
May 11, 2026
Merged

POWERFULMOVES merged 5 commits into
mainfrom
feat/4090-profile-spark-peer

Conversation

@POWERFULMOVES

@POWERFULMOVES POWERFULMOVES commented May 10, 2026

Copy link
Copy Markdown
Owner

Summary

  • Updates laptop-4090.yaml to match actual Ollama inventory: qwen3-embedding:8b (4.7GB) and qwen3-vl:8b (6.1GB) are installed; original profile specified 4b variants
  • Recalculates all co-residency VRAM budgets for 8b embedding footprint
  • Adds pmoves-spark (DGX Spark GB10 Grace-Blackwell 128GB) as a fleet_inference cross-node peer — primary 120B+ model host
  • Adds Phase 4b Ollama health checks to node-4090-laptop.tac.yaml: service health, embedding residency, coder availability, stale model audit
  • Adds SPARK ping check and Tailscale SSH check to Phase 4 mesh section

Release Note

Profile update for laptop-4090.yaml (suit-class change): acknowledges 8b embedding/VL model variants already installed, recalculates VRAM co-residency budgets, adds DGX Spark (pmoves-spark) as fleet_inference cross-node peer. TAC tree extended with Ollama health + SPARK connectivity verification phases.

Operator Actions Required (not in code)

```bash

Enable Tailscale SSH on 4090 laptop (so SPARK can SSH without Windows password)

tailscale set --ssh

Tag SPARK in Tailscale admin: add tag:gpu to pmoves-spark

Delete 14 stale models (~67GB freed)

ollama rm nomic-embed-text embeddinggemma gemma3:latest gemma3:12b gemma2:latest
ollama rm llama3.2:latest llama3.2-vision qwen2.5:7b qwen2.5vl:7b
ollama rm deepseek-r1:latest deepseek-coder-v2:latest phi4:latest
ollama rm jina-embeddings-v2-base-code functiongemma

Pull 4 profile-expected models (~42GB)

ollama pull qwen3-coder:30b # ~18GB coding fallback
ollama pull qwen3.5:9b # ~6GB general fallback
ollama pull qwen3.5:4b # ~3GB multimodal minimal
ollama pull lfm2:24b # ~15GB research focus
```

Emperor-CHIT-Humility Disclosure

Have: laptop-4090.yaml full read, dgx-spark profile, TAC tree current state, Tailscale ACL policy, tailscale status verified (SPARK hostname confirmed as pmoves-spark)
Missing: Ollama running state verified 2026-05-10 (qwen3-embedding:8b and qwen3-vl:8b confirmed present)

🤖 Generated with Claude Code

Summary by CodeRabbit

  • Chores
    • Upgraded embedding to a larger model and adjusted VRAM allocations for better capacity and performance.
    • Extended distributed inference by adding a new peer node and exposing additional services for remote model access.
    • Added operational health checks to validate local model inventory, confirm service availability, and verify network/connectivity.
    • Updated announced embedding capability to reflect the larger embedding model.

Review Change Stack

@coderabbitai

coderabbitai Bot commented May 10, 2026

Copy link
Copy Markdown
Contributor

Warning

Rate limit exceeded

@POWERFULMOVES has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 31 minutes and 56 seconds before requesting another review.

You’ve run out of usage credits. Purchase more in the billing tab.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: d60752fc-4af3-4586-ba00-e0353fa5d5dc

📥 Commits

Reviewing files that changed from the base of the PR and between fdce045 and 4a4efec.

📒 Files selected for processing (2)
  • pmoves/config/profiles/laptop-4090.yaml
  • pmoves/configs/tac_trees/node-4090-laptop.tac.yaml
📝 Walkthrough

Walkthrough

The PR upgrades the laptop-4090 profile to qwen3-embedding:8b with recalculated VRAM budgets, adds a pmoves-spark fleet_inference peer, updates NATS embedding capability, extends Phase 4 mesh checks to include SPARK, and inserts Phase 4b Ollama inventory health checks.

Changes

Laptop 4090 Profile & Operational Health

Layer / File(s) Summary
VRAM Budget & Embedding Upgrade
pmoves/config/profiles/laptop-4090.yaml
Embedding model upgraded from qwen3-embedding:4b to qwen3-embedding:8b; always-resident VRAM allocation increased to 4700MB; co-residency group model sets and total VRAM budgets recalibrated to reflect the larger embedding footprint.
Cross-node Peer Configuration
pmoves/config/profiles/laptop-4090.yaml
New pmoves-spark peer added as fleet inference node with hardware descriptor, services (ollama, nim), access methods (tailscale, NATS), and routing notes for full-precision model workloads.
Mesh Connectivity Scope
pmoves/configs/tac_trees/node-4090-laptop.tac.yaml
Phase 4 mesh connectivity extended to include SPARK in addition to 5090 and Z890; new child checks added to verify Tailscale SSH is enabled on 4090 laptop and confirm direct reachability to SPARK via tailscale ping.
Ollama Inventory & Capability Declaration
pmoves/config/profiles/laptop-4090.yaml, pmoves/configs/tac_trees/node-4090-laptop.tac.yaml
New Phase 4b TAC section validates Ollama service is running and resident model inventory matches expected profile, confirming presence of qwen3-embedding:8b and qwen3-coder:30b while excluding pre-2025 stale models; NATS announcement updated to advertise qwen3-embed-8b capability.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

Poem

🐰 A bigger brain for embeddings fine,
SPARK joins the mesh in perfect line,
Health checks bloom where VRAM once was tight,
Four-point-seven gigs—the embedding's right! 🚀

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly and specifically summarizes the main changes: updating model inventory to 8b variants and adding the SPARK peer, which aligns with the primary objectives.
Description check ✅ Passed The description is comprehensive and well-structured, covering summary, testing context, required checks, release notes, and operator actions; it substantially exceeds the template requirements.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feat/4090-profile-spark-peer

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: ab8609a0dd

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread pmoves/configs/tac_trees/node-4090-laptop.tac.yaml Outdated
Comment thread pmoves/configs/tac_trees/node-4090-laptop.tac.yaml Outdated

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@pmoves/config/profiles/laptop-4090.yaml`:
- Around line 148-156: The profile defines a new agent "pmoves-spark" but the
canonical agent registry (agent_registry.yaml) is missing that entry; add a
registry entry named pmoves-spark in pmoves/config/agent_registry.yaml with the
same canonical fields as the profile (role: fleet_inference, tailscale_host:
pmoves-spark, hardware: "GB10 Grace-Blackwell 128GB unified — ARM64", services:
[ollama:11434, nim:8200] or equivalent list form, access_via: [tailscale, nats],
and notes: "Primary 120B+ inference node...") so the registry remains the single
source of truth and matches the laptop-4090.yaml pmoves-spark definition.

In `@pmoves/configs/tac_trees/node-4090-laptop.tac.yaml`:
- Around line 192-197: Summary: The ping check uses the old hostname
pmoves-gb10-spark causing false negatives; update it to pmoves-spark. Edit the
node with id n4090.mesh.reach-spark: in the action.command field replace
"pmoves-gb10-spark" with "pmoves-spark", and update the action.expect string to
match the new host (e.g., "Pong from pmoves-spark via direct connection") so the
command and expected output stay consistent.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 76296877-0bb8-4f22-a1d6-522201070e71

📥 Commits

Reviewing files that changed from the base of the PR and between 6cf00bb and e0ffb31.

📒 Files selected for processing (2)
  • pmoves/config/profiles/laptop-4090.yaml
  • pmoves/configs/tac_trees/node-4090-laptop.tac.yaml

Comment thread pmoves/config/profiles/laptop-4090.yaml
Comment thread pmoves/configs/tac_trees/node-4090-laptop.tac.yaml Outdated
POWERFULMOVES and others added 5 commits May 11, 2026 05:41
… peer

- laptop-4090.yaml: swap qwen3-embedding:4b → :8b (4700MB, installed),
  swap qwen3-vl:4b → :8b in multimodal_minimal group; recalculate all
  co-residency VRAM budgets to match actual 8b footprint; update
  nats_announce.caps.embeddings to qwen3-embed-8b
- laptop-4090.yaml: add pmoves-gb10-spark as fleet_inference peer
  (GB10 Grace-Blackwell 128GB — primary 120B+ inference node)
- node-4090-laptop.tac.yaml: add Phase 4b Ollama health phase (service
  health, embedding resident check, coder check, stale model audit);
  extend Phase 4 mesh with SPARK ping check and Tailscale SSH check

Operator actions required (not in code):
  tailscale set --ssh              # enable SPARK → 4090 SSH
  ollama rm <14 stale models>      # free ~67GB
  ollama pull qwen3-coder:30b qwen3.5:9b qwen3.5:4b lfm2:24b

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
cross_node.peers key and tailscale_host were using pmoves-gb10-spark
which doesn't resolve in Tailscale. Actual registered device name is
pmoves-spark (verified via tailscale status 2026-05-10).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…idation

- Fix SPARK ping check: pmoves-gb10-spark → pmoves-spark (hostname fix)
- Fix SSH enabled check: Self.Capabilities reflects ACL grants not SSH
  state; use tailscale debug features | grep ssh with TailscaleSSHEnabled
  JSON fallback for accurate indicator
- Fix Ollama running check: count check can pass with wrong models; replace
  with set-intersection against required model names so MISSING:<name>
  surfaces when any profile model is absent

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@POWERFULMOVES
POWERFULMOVES force-pushed the feat/4090-profile-spark-peer branch from fdce045 to 4a4efec Compare May 11, 2026 09:41
@POWERFULMOVES
POWERFULMOVES merged commit 6afdb0d into main May 11, 2026
15 of 16 checks passed
@POWERFULMOVES
POWERFULMOVES deleted the feat/4090-profile-spark-peer branch May 11, 2026 09:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant