Skip to content

docs(providers): document CoreWeave custom endpoint setup - #113356

Open
crwvrosenblum wants to merge 2 commits into
NousResearch:mainfrom
crwvrosenblum:codex/hermes-coreweave-provider-setup
Open

crwvrosenblum wants to merge 2 commits into
NousResearch:mainfrom
crwvrosenblum:codex/hermes-coreweave-provider-setup

Conversation

@crwvrosenblum

@crwvrosenblum crwvrosenblum commented Sep 16, 2026

Copy link
Copy Markdown

What does this PR do?

Add a CoreWeave Serverless Inference recipe to the existing custom-provider cookbook. It uses providers.coreweave / custom:coreweave, the W&B inference endpoint and WANDB_API_KEY, with optional endpoint-scoped project attribution.

The guide distinguishes the models.dev metadata entry from a registered runtime provider. It recommends v2026.9.21 or later for auxiliary headers, credits the shipped #113969 fix, and explains using a separate named provider when changing endpoints. Sending a project header is separate from checking billing/usage attribution.

Related Issue

#43964 and #44250. This documents the supported custom-provider route and adds no vendor plugin. The remaining auxiliary endpoint-override correction is tracked separately in #113397.

Changes Made

Only website/docs/integrations/providers.md changes. The existing cookbook anchor is preserved.

Validation

  • Both YAML variants parse. Real config/runtime resolution, main-client construction, model discovery and auxiliary resolution passed offline on v2026.9.21 and current main. Bare provider: wandb is rejected as expected.
  • Bounded live checks on unmodified v2026.9.21 passed authentication, 30-model discovery, a native read_file dispatch and tool-result roundtrip, synchronous auxiliary streaming, asynchronous auxiliary chat and the expected unavailable-model 404. Every request carried the configured project header to the inference endpoint.
  • This verifies the provider/client route and real tool dispatch. Interactive CLI behavior, a full autonomous coding task, streamed tool arguments, other models and billing-UI attribution were not tested.
  • The prior 83 offline runtime/header checks remain recorded. The full website build and full repository suite were not run.

Checklist

  • Existing custom-provider configuration used.
  • Released-header caveat updated from verified behavior.
  • Cookbook anchor and one-file scope preserved.
  • Full website build and full repository suite.

@crwvrosenblum
crwvrosenblum marked this pull request as ready for review September 16, 2026 19:45
@alt-glitch alt-glitch added type/docs Documentation improvements P3 Low — cosmetic, nice to have area/config Config system, migrations, profiles labels Sep 16, 2026
@crwvrosenblum

Copy link
Copy Markdown
Author

@teknium1

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/config Config system, migrations, profiles P3 Low — cosmetic, nice to have type/docs Documentation improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants