Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Overlapping graphs in NLU model comparison graph #8800

Closed
razvanra2 opened this issue Jun 3, 2021 · 2 comments
Closed

Overlapping graphs in NLU model comparison graph #8800

razvanra2 opened this issue Jun 3, 2021 · 2 comments
Labels
area:rasa-oss 🎡 Anything related to the open source Rasa framework area:rasa-oss/model-testing Issues focused around testing models (e.g. via `rasa test`) type:bug 🐛 Inconsistencies or issues which will cause an issue or problem for users or implementors.

Comments

@razvanra2
Copy link

Rasa version: 2.6.1

Rasa SDK version (if used & relevant): 2.6.0

Rasa X version (if used & relevant): 2.6.0

Python version: 3.7

Operating system (windows, osx, ...): mac os 11.3.1

Issue: Two graphs are overlapped in the final output of the nlu model comparison graph when testing over five folds for 4 pipelines. See: https://twitter.com/razvan_radoi/status/1399438547938066435 for the issue.
See https://github.com/razvanra2/ChatBot for the source code.
Run:

Error (including full traceback):

See image in tweet

Command or request that led to error:

 rasa test nlu --nlu data/nlu.yml --config test_configs/config_1.yml test_configs/config_2.yml test_configs/config_3.yml test_configs/config_4.yml  

Content of configuration file (config.yml) (if relevant):

see in repo

Content of domain file (domain.yml) (if relevant):

see in repo
@razvanra2 razvanra2 added area:rasa-oss 🎡 Anything related to the open source Rasa framework type:bug 🐛 Inconsistencies or issues which will cause an issue or problem for users or implementors. labels Jun 3, 2021
@sara-tagger
Copy link
Collaborator

Thanks for the issue, @TyDunn will get back to you about it soon!

You may find help in the docs and the forum, too 🤗

@TyDunn
Copy link
Contributor

TyDunn commented Jun 3, 2021

Hi @razvanra2. Thanks for opening this issue. I'm going to close it because it is a duplicate of #8200. We plan to tackle it this sprint, so it should be fixed soon

@TyDunn TyDunn closed this as completed Jun 3, 2021
@TyDunn TyDunn added the area:rasa-oss/model-testing Issues focused around testing models (e.g. via `rasa test`) label Jun 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:rasa-oss 🎡 Anything related to the open source Rasa framework area:rasa-oss/model-testing Issues focused around testing models (e.g. via `rasa test`) type:bug 🐛 Inconsistencies or issues which will cause an issue or problem for users or implementors.
Projects
None yet
Development

No branches or pull requests

3 participants