Skip to content

Conversation

@kdestin
Copy link
Member

@kdestin kdestin commented Oct 17, 2024

Description

This pull request resolves a regression introduced by #37615 that causes evaluation to fail because promptflow rejects evaluators with "complex" type hints.

All SDK Contribution checklist:

  • The pull request does not introduce [breaking changes]
  • CHANGELOG is updated for new features, bug fixes or other significant changes.
  • I have read the contribution guidelines.

General Guidelines and Best Practices

  • Title of the pull request is clear and informative.
  • There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

  • Pull request includes test coverage for the included changes.

@kdestin kdestin requested a review from a team as a code owner October 17, 2024 17:06
@github-actions github-actions bot added the Evaluation Issues related to the client library for Azure AI Evaluation label Oct 17, 2024
@kdestin kdestin enabled auto-merge (squash) October 17, 2024 17:12
@azure-sdk
Copy link
Collaborator

API change check

API changes are not detected in this pull request.

    This introduced a regression where promptflow rejected the evaluators
    because they were of types promptflow doesn't support.
@kdestin kdestin force-pushed the evaluation/mypy/remove-evaluator-type-hints branch from 289343e to 1b3bd98 Compare October 22, 2024 18:08
@kdestin kdestin force-pushed the evaluation/mypy/remove-evaluator-type-hints branch from 1b3bd98 to de38ee8 Compare October 22, 2024 19:40
@needuv
Copy link
Member

needuv commented Oct 22, 2024

/check-enforcer override

@kdestin kdestin merged commit 0e400d0 into Azure:main Oct 22, 2024
l0lawrence pushed a commit to l0lawrence/azure-sdk-for-python that referenced this pull request Feb 19, 2025
…ure#37964)

* fix: Remove "complex" type hints from AsyncEvaluators

    This introduced a regression where promptflow rejected the evaluators
    because they were of types promptflow doesn't support.

* style: Run isort
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Evaluation Issues related to the client library for Azure AI Evaluation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants