Repository navigation
vLLM 0.30.0 for the production embeddings role on WSL (pin, receipt, docs) - #260
Merged
Merged
Conversation
…docs) vLLM 0.25.0 was in range of GHSA-25q3-v2hm-8vpf (high, fixed 0.28.0) and GHSA-5fj9-pfhr-6j48 (fixed 0.30.0); 0.29.0 failed WSL startup (no UVA). 0.30.0 carries the WSL pinned-memory fallback (vllm PR #56908). On the NativeStack RTX 4090 host, 0.30.0 was qualified on an owned instance against production 0.25.0 with the same model files and flags (gate-set min cosine 0.999999999999998, identical NVIDIA-example top-1, 10/10 top-10 on a 10x50 corpus, batch invariance >= 0.99997), reviewed independently, then switched in production by a drop-in that changes only the binary path. The live service returned identical gate embeddings (cosine 1.0) and identical top-10 results for 5 code-index queries after the switch; 0.25.0 is kept for rollback. - manifests/stack.json vllm 0.30.0 @ ced6857a (v0.30.0); saturation-audit row and the upstream-snapshot row from a fresh run of its four gh api endpoints - evidence/receipts/vllm-030-switch-20260925.json (native_model_e2e) - adoption/platforms/linux-wsl2.md, adoption/lifecycle.md, docs/token-native-saturation.md and recipes/README.md dated updates Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
seathatflowsinourveins
enabled auto-merge (squash)
September 25, 2026 16:22
This was referenced Sep 25, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The WSL embeddings route ran vLLM 0.25.0. That version is in range of two advisories:
/v1/embeddingsor/poolingkills the engine. Fixed in 0.28.0.0.29.0 had failed WSL startup with
UVA is not available(evidence/receipts/vllm-compatibility.json). 0.30.0 carries the WSL pinned-memory fallback (vllm PR #56908).What was done on the NativeStack host (RTX 4090, WSL2)
Qualified on an owned instance. 0.30.0 was installed in a new
tools/vllm-0.30.0prefix (uv pip install vllm==0.30.0 --exclude-newer 2026-09-25T23:59:59Z, wheel sha256ef52ee58…). It served the same Nemotron-3-Embed-1B-BF16 files, hash-identical before and after, on127.0.0.1:38231with production's flags. Compared with production 0.25.0:A separate reviewer agent re-ran the checks and rated it switch-ready.
Switched in production. A
systemd --userdrop-in changes only theExecStartbinary path. The unit was healthy after 48 s with 0 restarts. On the live unit, before vs after:0.25.0 stays installed. Rollback is to delete the drop-in, then
daemon-reloadand restart.Repository changes
manifests/stack.json:vllmis now 0.30.0 @ced6857a(thev0.30.0tag), with the new evidence id.blueprints/token-native-focus/saturation-audit.jsonrow updated. Thecatalogs/landscape/upstream-snapshot.jsonrow comes from a fresh run of its fourgh apiendpoints, the same method as Bump the application-delivery lock to Next.js 16.3.6 for GHSA-vcvr-r3jv-pc5j #252. The selected version now matches the latest stable release.evidence/receipts/vllm-030-switch-20260925.json(native_model_e2e): the claim, limitations, numbers and artifact hashes. Raw machine output is retained privately.adoption/platforms/linux-wsl2.md,adoption/lifecycle.md,docs/token-native-saturation.mdand therecipes/README.mdvllm row.Checks
validate.py,landscape.py,validate_catalogs.pyandvalidate_foundation.pypass.component_matrix.py --checkandnew_host_grand_list.py --checkpass.Limitations
/v1/embeddingsroute. NVIDIA's model card still names vllm==0.25.0 for BF16/v2/embed, a route that is not used here.vllm usehost receipt will be recorded from this commit on main after merge. The other session's Workstation lane wave A: systemd re-record, SPY/LEAN parity host replay, Nemotron qualification on the RTX 4090, ai-memory 2.4.0 review #256 receipt stays a point-in-time record of 0.25.0.Lane:
lane:foundation🤖 Generated with Claude Code