Skip to content

feat(ai): add native Vercel AI Gateway language models - #52643

Merged
rekram1-node merged 19 commits into
v2from
native-vercel-gateway
Oct 5, 2026
Merged

rekram1-node merged 19 commits into
v2from
native-vercel-gateway

Conversation

@rekram1-node

@rekram1-node rekram1-node commented Oct 2, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • Extend the existing evaluation-only Gateway facade with native Messages, Responses, and Chat Completions APIs, reusing shared protocols.
  • Default openai/gpt-* and spacexai/grok-* models to Responses, meta/muse-* to Chat, and all other model families to Messages, preserving full Gateway model IDs and explicit API selectors.
  • Add typed reasoning/thinking controls, Gateway routing and upstream options, automatic caching, cache affinity, and Gateway metadata preservation.
  • Preserve existing evaluation support; leave Core provider remapping, variants, and attribution integration for a later change.

Verification

  • AI package: 1,755 tests passed; package typecheck and oxlint passed.
  • Recorded live two-step tool loops: Claude/Gemini/DeepSeek Messages, GPT/Grok Responses, and Muse/Claude Chat.
  • Repeated Claude prompt reported 4,512 cache-read tokens.
  • Live invalid-key request returned non-retryable HTTP 401; fixtures also cover 403, OIDC fallback, and encrypted/signed reasoning replay.
  • Checked recordings for Gateway credential leakage.

Scope

HTTP/SSE language-model support only. Gateway WebSocket, native compaction, and additional media modalities are not exposed yet. No Core wiring changes.

@rekram1-node
rekram1-node force-pushed the native-vercel-gateway branch 2 times, most recently from f1bba12 to 4b24c27 Compare October 5, 2026 18:20
@rekram1-node
rekram1-node force-pushed the native-vercel-gateway branch from 4b24c27 to 668ee8b Compare October 5, 2026 18:36
@rekram1-node
rekram1-node merged commit c2d4db6 into v2 Oct 5, 2026
6 of 9 checks passed
@rekram1-node
rekram1-node deleted the native-vercel-gateway branch October 5, 2026 20:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant