Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rasa interactive breaks on main #9949

Closed
koaning opened this issue Oct 21, 2021 · 3 comments
Closed

rasa interactive breaks on main #9949

koaning opened this issue Oct 21, 2021 · 3 comments
Assignees
Labels
3.0.0rc-QA-issue A problem found during the QA of rasa==3.0.0 release candidate feature:rasa-3.0/architecture

Comments

@koaning
Copy link
Contributor

koaning commented Oct 21, 2021

These are the results from running rasa interactive on main on the rasa init project. When introducing a new entity, it seems to break.

gitpod /workspace/rasa-examples/rasa-ini $ rasa interactive
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'CountVectorsFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'CountVectorsFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'CountVectorsFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'CountVectorsFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'DIETClassifierGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'DIETClassifierGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'EntitySynonymMapperGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'EntitySynonymMapperGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'LexicalSyntacticFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'LexicalSyntacticFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'MemoizationPolicyGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'MemoizationPolicyGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'RegexFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'RegexFeaturizerGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'ResponseSelectorGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'ResponseSelectorGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'RulePolicyGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'RulePolicyGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'TEDPolicyGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'TEDPolicyGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Starting to train component 'UnexpecTEDIntentPolicyGraphComponent'.
2021-10-21 11:37:50 INFO     rasa.engine.training.hooks  - Finished training component 'UnexpecTEDIntentPolicyGraphComponent'.
Your Rasa model is trained and saved at 'models/20211021-113748-feldspar-valley.tar.gz'.
2021-10-21 11:38:22 WARNING  rasa.shared.utils.common  - The UnexpecTED Intent Policy is currently experimental and might change or be removed in the future 🔬 Please share your feedback on it in the forum (https://forum.rasa.com) to help us make this feature ready for production.
2021-10-21 11:38:33 INFO     root  - Rasa server is up and running.
Processed story blocks: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:00<00:00, 1316.48it/s, # trackers=1]
Processed rules: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 2418.16it/s, # trackers=1]
Bot loaded. Visualisation at http://localhost:5006/visualization.html .
Type a message and press enter (press 'Ctrl-c' to exit).
? Your input -> what is the price for tesla stock today                                                                                                                      
? Your NLU model classified 'what is the price for tesla stock today' with intent 'goodbye' and there are no entities, is this correct? No                                   
? What intent is it? <create_new_intent>                                                                                                                                     
? Please type the intent name: ask_stock                                                                                                                                     
? Please mark the entities using [value](type) notation what is the price for [tesla](ticker) stock today                                                                    
2021-10-21 11:40:18 ERROR    rasa.server  - An unexpected error occurred. Error: Error running graph component for node run_UnexpecTEDIntentPolicy2.
2021-10-21 11:40:18 ERROR    rasa.core.training.interactive  - An exception occurred while recording messages.
Traceback (most recent call last):
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py", line 1505, in record_messages
    plot_file,
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py", line 954, in _predict_till_next_listen
    result = await request_prediction(endpoint, conversation_id)
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py", line 173, in request_prediction
    method="post", subpath=f"/conversations/{conversation_id}/predict"
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/utils/endpoints.py", line 174, in request
    response.status, response.reason, await response.content.read()
rasa.utils.endpoints.ClientResponseError: 500, Internal Server Error, body='b'{"version":"2.8.8","status":"failure","message":"An unexpected error occurred. Error: Error running graph component for node run_UnexpecTEDIntentPolicy2.","reason":"ConversationError","details":{},"help":null,"code":500}''
2021-10-21 11:40:18 ERROR    asyncio  - Task exception was never retrieved
future: <Task finished coro=<_serve_application.<locals>.run_interactive_io() done, defined at /workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py:1591> exception=ClientResponseError('500, Internal Server Error, body=\'b\'{"version":"2.8.8","status":"failure","message":"An unexpected error occurred. Error: Error running graph component for node run_UnexpecTEDIntentPolicy2.","reason":"ConversationError","details":{},"help":null,"code":500}\'\'')>
Traceback (most recent call last):
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py", line 1598, in run_interactive_io
    conversation_id=conversation_id,
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py", line 1505, in record_messages
    plot_file,
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py", line 954, in _predict_till_next_listen
    result = await request_prediction(endpoint, conversation_id)
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/core/training/interactive.py", line 173, in request_prediction
    method="post", subpath=f"/conversations/{conversation_id}/predict"
  File "/workspace/.pip-modules/lib/python3.7/site-packages/rasa/utils/endpoints.py", line 174, in request
    response.status, response.reason, await response.content.read()
rasa.utils.endpoints.ClientResponseError: 500, Internal Server Error, body='b'{"version":"2.8.8","status":"failure","message":"An unexpected error occurred. Error: Error running graph component for node run_UnexpecTEDIntentPolicy2.","reason":"ConversationError","details":{},"help":null,"code":500}'
@koaning koaning assigned koaning, joejuzl and wochinge and unassigned koaning Oct 21, 2021
@tayfun tayfun assigned tayfun and unassigned joejuzl and wochinge Oct 22, 2021
tayfun pushed a commit that referenced this issue Oct 25, 2021
New intent creation using `rasa interactive` was failing with server
returning 500. Upon closer inspection we found this was due to
prediction in unexpected intent policy; new intent is not in the domain
yet and this was raising an exception.

This is fixed by preventing predictions inside unexpected intent policy
for new intents.
@tayfun
Copy link
Contributor

tayfun commented Oct 25, 2021

Actually duplicate of #9517

Once this is fixed and merged I'll close the other duplicate ticket as well.

@tayfun
Copy link
Contributor

tayfun commented Oct 26, 2021

This has been fixed and merged to 2.8.x branch. Soon coming to main. Closing this issue manually as it is not closed automatically (because 2.8.x is not the default branch?).

@tayfun tayfun closed this as completed Oct 26, 2021
@joejuzl joejuzl added the 3.0.0rc-QA-issue A problem found during the QA of rasa==3.0.0 release candidate label Nov 10, 2021
@indam23
Copy link
Contributor

indam23 commented Nov 15, 2021

@tayfun This issue persists in 3.0.0rc2
It does not if one actually installs 3.0.0rc2 🤦‍♀️

@indam23 indam23 reopened this Nov 15, 2021
@indam23 indam23 closed this as completed Nov 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3.0.0rc-QA-issue A problem found during the QA of rasa==3.0.0 release candidate feature:rasa-3.0/architecture
Projects
None yet
Development

No branches or pull requests

5 participants