-
Notifications
You must be signed in to change notification settings - Fork 4.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix data validator ignore_warnings logic #11844
Conversation
Fix failing tests logic Add test_verify_utterances_does_not_error_when_no_utterance_template_provided
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks a lot for that bug fix and adding a test for it 🔥
Head branch was pushed to by a user without write access
My pleasure. I fixed one linter issue but I see some other validation errors in CI which I am not aware of... |
@tmbo What needs to happen for this PR to get merged? |
I've just approved the CI runs. Once they go green the PR should be automatically merged. Thanks for your contribution 🙏🏻 |
Could not update branch. Most likely this is due to a merge conflict. Please update the branch manually and fix any issues. Error: HttpError: user doesn't have permission to update head repository |
Head branch was pushed to by a user without write access
@m-vdb I think I've fixed the issue in the integration test. |
This is strange, if I run the tests locally they pass:
|
@m-vdb One change I observed is that I am using Python 3.10 and the failing test uses 3.8. Not sure if that is intended, but different tests in the set use different Python versions (integration tests are using 3.10, so I installed that locally). |
but it seems these tests are failing on Ubuntu for all the python versions we support: 3.7, 3.8, 3.9 and 3.10 😬 |
Right, then I don't know what is happening. The tests pass on my local Ubuntu system. Furthermore, this seems to be unrelated to my PR since I only changed validation logic. |
@m-vdb I've re-tested on Ubuntu 22.04.1 LTS / Python 3.10 and the tests still succeed:
|
@m-vdb I just found similarly failing tests in PR #12074, for example: https://github.com/RasaHQ/rasa/actions/runs/4232026432/jobs/7351360693 |
@timidri I'm going to go ahead and merge this PR, thanks for putting up with our flaky CI checks. We'll make sure to address these pains in the near future |
Thank you! |
Proposed changes:
ignore_warnings
parameter insidevalidator.py
ignore_warnings=False
intest_validator.py
test_verify_utterances_does_not_error_when_no_utterance_template_provided
to make sure that utterances specified without a template are not considered a validation errorStatus (please check what you already did):
black
(please check Readme for instructions)This PR resolves 11843