Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

slu test fails with error "AttributeError: 'DataFrame' object has no attribute 'intent_pred'" on Dialogy 0.8.8 #65

Open
keshav47 opened this issue Nov 23, 2021 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@keshav47
Copy link
Contributor

Describe the bug
Functions: make_critical_intent_report(), update_confidence_scores() in test.py requires additional column intent_pred in predictions_df , instead they should retrieve actual model predictions from intent column:

predictions.append(
            {
                "data_id": row["data_id"],
                const.INTENT: intents[0][const.NAME] if intents else "_no_preds_",
                const.SCORE: intents[0][const.SCORE] if intents else 0,
            }
        )

To Reproduce

  1. use s3://plute-data-store/keshav-onboarding/test_small.csv , it has 3 columns alternatives, tag, data_id
  2. Run 'slu test --version --lang '
  3. See error

Expected behavior
saves intent error analysis results inside metrics folder

Screenshots

image

Desktop

  • OS: Ubuntu
  • Python version 3.8.6
@keshav47 keshav47 added the bug Something isn't working label Nov 23, 2021
@biswaroop1547 biswaroop1547 self-assigned this Dec 3, 2021
ltbringer added a commit that referenced this issue Jun 14, 2022
bug: strict usage of state and intent column while test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants