Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix small data erroring out on mutual info score for error analysis guidance #1907

Merged
merged 1 commit into from
Jan 15, 2023

Conversation

imatiach-msft
Copy link
Contributor

Description

With a recent update in scikit-learn some tests started failing that used 3 rows of data when calculating mutual information score for the feature guidance score in the error analysis features list.

Since the dashboard is useful even when evaluating for a few instances, this PR resolved the exceptions by still calculating the score, either by replicate the row for n=1 or setting a lower number of nearest neighbors for KNN used by mutual information.

Checklist

  • I have added screenshots above for all UI changes.
  • I have added e2e tests for all UI changes.
  • Documentation was updated if it was needed.

@codecov-commenter
Copy link

codecov-commenter commented Jan 13, 2023

Codecov Report

Merging #1907 (a75a59f) into main (cac5590) will increase coverage by 0.00%.
The diff coverage is 100.00%.

❗ Current head a75a59f differs from pull request most recent head 606c025. Consider uploading reports for the commit 606c025 to get more accurate results

@@           Coverage Diff           @@
##             main    #1907   +/-   ##
=======================================
  Coverage   93.31%   93.32%           
=======================================
  Files          93       93           
  Lines        4578     4582    +4     
=======================================
+ Hits         4272     4276    +4     
  Misses        306      306           
Flag Coverage Δ
unittests 93.32% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ranalysis/erroranalysis/analyzer/error_analyzer.py 95.48% <100.00%> (+0.10%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@imatiach-msft imatiach-msft force-pushed the ilmat/fix-ea-mutual-inf-sm-data-err branch from a75a59f to 83ac0e3 Compare January 13, 2023 23:04
@imatiach-msft imatiach-msft force-pushed the ilmat/fix-ea-mutual-inf-sm-data-err branch from 83ac0e3 to 606c025 Compare January 13, 2023 23:07
2 similar comments
@imatiach-msft imatiach-msft merged commit 527bc6b into main Jan 15, 2023
@imatiach-msft imatiach-msft deleted the ilmat/fix-ea-mutual-inf-sm-data-err branch January 15, 2023 16:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants