Skip to content

feat: chat params e2e - #1591

Merged
steebchen merged 1 commit into
mainfrom
feat/param-e2e
Feb 4, 2026
Merged

steebchen merged 1 commit into
mainfrom
feat/param-e2e

Conversation

@steebchen

@steebchen steebchen commented Feb 4, 2026

Copy link
Copy Markdown
Member

Summary by CodeRabbit

  • Tests
    • Added comprehensive end-to-end testing for chat parameters across multiple models, including temperature, max_tokens, top_p, and penalty configurations, to ensure reliable parameter handling and validation.

Copilot AI review requested due to automatic review settings February 4, 2026 16:43
@steebchen
steebchen enabled auto-merge February 4, 2026 16:43
@coderabbitai

coderabbitai Bot commented Feb 4, 2026

Copy link
Copy Markdown
Contributor

Walkthrough

Adds a new end-to-end test file to validate chat completion parameter handling across multiple models. Tests are generated from parameter/value matrices, gated by RUN_PARAM_TESTS, send POST /v1/chat/completions requests, assert 200 responses, validate payloads and logs, and include a basic placeholder test.

Changes

Cohort / File(s) Summary
E2E Chat Param Tests
apps/gateway/src/chat-params.e2e.ts
Introduces parameterized e2e tests for chat completions (temperature, max_tokens, top_p, penalties, combined), using shared helpers, conditional execution via RUN_PARAM_TESTS, response and log validation.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Possibly related PRs

Suggested labels

auto-merge

🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title 'feat: chat params e2e' directly aligns with the main change—adding a new end-to-end test file for chat parameters, with clear indication of the feature type and scope.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing touches
  • 📝 Generate docstrings
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch feat/param-e2e

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@steebchen
steebchen added this pull request to the merge queue Feb 4, 2026

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a new end-to-end test suite for chat completion parameters. The test file validates that various API parameters (temperature, max_tokens, top_p, frequency_penalty, presence_penalty, and combinations thereof) work correctly across all configured models.

Changes:

  • Added comprehensive e2e test suite for chat API parameters with 6 different parameter configurations
  • Tests are gated behind RUN_PARAM_TESTS environment variable to allow selective execution
  • Tests verify both successful responses and proper logging for all parameter combinations

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

} from "@/chat-helpers.e2e.js";

// Use all testModels - filter via TEST_MODELS env var for specific providers
const paramTestModels = testModels;

Copilot AI Feb 4, 2026

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The variable paramTestModels is assigned the value of testModels but serves no purpose other than aliasing. It would be clearer to use testModels directly throughout the file, including in the console.log statement on line 21 and in the flatMap on line 40. This reduces unnecessary indirection and makes the code more maintainable.

Copilot uses AI. Check for mistakes.
Merged via the queue into main with commit a7f5e94 Feb 4, 2026
19 checks passed
@steebchen
steebchen deleted the feat/param-e2e branch February 4, 2026 16:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants