Skip to content

Conversation

@shyamnamboodiripad
Copy link
Contributor

@shyamnamboodiripad shyamnamboodiripad commented Nov 3, 2025

Fixes #7002

Microsoft Reviewers: Open in CodeFlow

@shyamnamboodiripad shyamnamboodiripad requested a review from a team as a code owner November 3, 2025 21:10
Copilot AI review requested due to automatic review settings November 3, 2025 21:10
@github-actions github-actions bot added the area-ai-eval Microsoft.Extensions.AI.Evaluation and related label Nov 3, 2025
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR removes the MaxOutputTokens limitation from the EquivalenceEvaluator to address compatibility issues with certain AI models. The change allows the evaluator to work with models that don't support the MaxOutputTokens parameter or handle it differently.

Key changes:

  • Removed the MaxOutputTokens = 16 setting from the ChatOptions
  • Added documentation explaining why MaxOutputTokens is intentionally not set
  • Updated comments to reference three related GitHub issues

@shyamnamboodiripad shyamnamboodiripad merged commit 607269f into dotnet:main Nov 3, 2025
7 checks passed
@shyamnamboodiripad shyamnamboodiripad deleted the tokens branch November 3, 2025 22:17
This was referenced Nov 11, 2025
This was referenced Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area-ai-eval Microsoft.Extensions.AI.Evaluation and related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[AI Evaluation] EquivalenceEvaluator does not appear to support reasoning models due to very low MaxOutputTokens value

2 participants