Skip to content

feat(models): add routeway models and metadata - #712

Merged
steebchen merged 2 commits into
mainfrom
feat/routeway
Sep 2, 2025
Merged

feat(models): add routeway models and metadata#712
steebchen merged 2 commits into
mainfrom
feat/routeway

Conversation

@steebchen

@steebchen steebchen commented Sep 2, 2025

Copy link
Copy Markdown
Member

Added multiple free models under the RouteWay provider, including metadata such as pricing, context size, and streaming capabilities. Removed llama-3.3-70b-instruct-free model entry from Meta models.

Summary by CodeRabbit

  • New Features

    • Added six free Routeway models: DeepSeek R1T2 Chimera, GLM 4.5 Air, Kimi K2, GPT-OSS 20B, GPT-4.1 (Free), and Llama 3.3 70B Instruct (Free). All support streaming and JSON output.
  • Changes

    • Removed the previous Meta Llama 3.3 70B Instruct (Free) entry from the Meta catalog; a Routeway-based equivalent is now available.

Added multiple free models under the RouteWay provider, including metadata such as
pricing, context size, and streaming capabilities.
Removed llama-3.3-70b-instruct-free model entry from Meta models.
@coderabbitai

coderabbitai Bot commented Sep 2, 2025

Copy link
Copy Markdown
Contributor

Walkthrough

Adds a new routewayModels module and includes it in the exported models array; removes the Meta "Llama 3.3 70B Instruct (Free)" entry from metaModels. No type/interface changes.

Changes

Cohort / File(s) Summary
Models registry update
packages/models/src/models.ts
Imports routewayModels from ./models/routeway and spreads them into the exported models array.
New routeway models module
packages/models/src/models/routeway.ts
Adds routewayModels export: six model definitions targeted at the routeway provider (marked free, zero pricing, large context, streaming enabled, jsonOutput: true).
Meta models cleanup
packages/models/src/models/meta.ts
Removes the "Meta Llama 3.3 70B Instruct (Free)" entry from metaModels.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

Suggested reviewers

  • smakosh

📜 Recent review details

Configuration used: CodeRabbit UI

Review profile: CHILL

Plan: Pro

💡 Knowledge Base configuration:

  • MCP integration is disabled by default for public repositories
  • Jira integration is disabled by default for public repositories
  • Linear integration is disabled by default for public repositories

You can enable these sources in your CodeRabbit configuration.

📥 Commits

Reviewing files that changed from the base of the PR and between 1b24d54 and 97c5596.

📒 Files selected for processing (1)
  • packages/models/src/models/routeway.ts (1 hunks)
🚧 Files skipped from review as they are similar to previous changes (1)
  • packages/models/src/models/routeway.ts
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (1)
  • GitHub Check: e2e / run
✨ Finishing Touches
  • 📝 Generate Docstrings
🧪 Generate unit tests
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch feat/routeway

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

CodeRabbit Commands (Invoked using PR/Issue comments)

Type @coderabbitai help to get the list of available commands.

Other keywords and placeholders

  • Add @coderabbitai ignore or @coderabbit ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Status, Documentation and Community

  • Visit our Status Page to check the current availability of CodeRabbit.
  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@steebchen steebchen changed the title feat(models): add RouteWay models and metadata feat(models): add routeway models and metadata Sep 2, 2025

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Nitpick comments (3)
packages/models/src/models/routeway.ts (3)

1-1: Avoid potential self-import cycles; use a relative type import.

Importing ModelDefinition from the package entry can create circular type deps with models.ts. Prefer a relative import.

Apply:

-import type { ModelDefinition } from "@llmgateway/models";
+import type { ModelDefinition } from "../models";

9-10: Drop explicit undefined fields for noise reduction.

deprecatedAt/deactivatedAt default to undefined; omitting them keeps objects terse.

Example (apply to all blocks):

-        deprecatedAt: undefined,
-        deactivatedAt: undefined,

Also applies to: 33-34, 57-58, 81-82, 105-106, 129-130


3-148: Consider marking RouteWay free models as non-stable initially.

If these are newly integrated/free-tier routes, set stability: "beta" (or appropriate level) to avoid over-preference by selection heuristics.

Example (apply to each model object):

  {
     id: "deepseek-r1t2-chimera-free",
     name: "DeepSeek R1T2 Chimera (Free)",
     family: "deepseek",
     free: true,
+    stability: "beta",
📜 Review details

Configuration used: CodeRabbit UI

Review profile: CHILL

Plan: Pro

💡 Knowledge Base configuration:

  • MCP integration is disabled by default for public repositories
  • Jira integration is disabled by default for public repositories
  • Linear integration is disabled by default for public repositories

You can enable these sources in your CodeRabbit configuration.

📥 Commits

Reviewing files that changed from the base of the PR and between 8c99902 and 1b24d54.

📒 Files selected for processing (3)
  • packages/models/src/models.ts (2 hunks)
  • packages/models/src/models/meta.ts (0 hunks)
  • packages/models/src/models/routeway.ts (1 hunks)
💤 Files with no reviewable changes (1)
  • packages/models/src/models/meta.ts
🧰 Additional context used
📓 Path-based instructions (3)
**/*.{js,jsx,ts,tsx}

📄 CodeRabbit inference engine (.github/copilot-instructions.md)

Use localStorage instead of cookies for client-side data persistence

Files:

  • packages/models/src/models.ts
  • packages/models/src/models/routeway.ts
**/*.{js,ts}

📄 CodeRabbit inference engine (.github/copilot-instructions.md)

**/*.{js,ts}: Use drizzle with the latest object syntax for database operations
For read queries, always use db().query.<table>.findMany() or db().query.<table>.findFirst()

Files:

  • packages/models/src/models.ts
  • packages/models/src/models/routeway.ts
**/*.{ts,tsx}

📄 CodeRabbit inference engine (.cursor/rules/general.mdc)

Never use as any or : any in TypeScript files.

Files:

  • packages/models/src/models.ts
  • packages/models/src/models/routeway.ts
🧬 Code graph analysis (2)
packages/models/src/models.ts (1)
packages/models/src/models/routeway.ts (1)
  • routewayModels (3-148)
packages/models/src/models/routeway.ts (1)
packages/models/src/models.ts (1)
  • ModelDefinition (104-157)
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (1)
  • GitHub Check: build / run
🔇 Additional comments (5)
packages/models/src/models.ts (1)

13-13: LGTM: routeway models import is wired correctly.

No issues with the new import.

packages/models/src/models/routeway.ts (4)

26-26: Validate and adjust jsonOutput flags
Ensure each model listed in routeway.ts truly supports strict JSON output under RouteWay; only leave jsonOutput: true where you’ve verified compliance, and disable it for models that don’t.


19-19: Verify each model’s contextSize against RouteWay documentation
All six RouteWay-backed models in packages/models/src/models/routeway.ts (lines 19, 43, 67, 91, 115, 139) are set to 128000. Confirm these values match each provider’s supported context window and adjust per-model if needed.


3-148: Provider entry and routing verified. No action required.


7-7: No action needed — all family labels match the supported set. Verified that "deepseek" (and the families at lines 31, 55, 79, 103, and 127) appear in the repo-wide inventory of family values and align with existing selection logic.

Comment thread packages/models/src/models.ts
Comment thread packages/models/src/models/routeway.ts Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant