Update `raiutils` to 0.3.0 in `raiwidgets`, `responsibleai`, `erroranalysis` and `nlp_feature_extractors` #1873

gaugup · 2023-01-03T19:58:02Z

Description

Update raiutils to 0.3.0 in raiwidgets, responsibleai, erroranalysis and nlp_feature_extractors

Checklist

I have added screenshots above for all UI changes.
I have added e2e tests for all UI changes.
Documentation was updated if it was needed.

…nd `nlp_feature_extractors` Signed-off-by: Gaurav Gupta <[email protected]>

github-actions · 2023-01-03T20:30:04Z

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/gaugup/UpdateRaiUtils/dashboard/index.html

codecov-commenter · 2023-01-05T21:40:14Z

Codecov Report

Merging #1873 (5044947) into main (a4920bf) will decrease coverage by 2.68%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #1873      +/-   ##
==========================================
- Coverage   93.33%   90.64%   -2.69%     
==========================================
  Files          93       46      -47     
  Lines        4559     1881    -2678     
==========================================
- Hits         4255     1705    -2550     
+ Misses        304      176     -128

Flag	Coverage Δ
unittests	`90.64% <ø> (-2.69%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
responsibleai/responsibleai/_config/__init__.py
...ibleai/responsibleai/managers/explainer_manager.py
...ponsibleai/responsibleai/_tools/shared/versions.py
...ponsibleai/responsibleai/_tools/shared/__init__.py
...sponsibleai/responsibleai/rai_insights/__init__.py
...onsibleai/_tools/shared/attribute_serialization.py
...sponsibleai/responsibleai/managers/base_manager.py
...ai/databalanceanalysis/feature_balance_measures.py
...ponsibleai/responsibleai/rai_insights/constants.py
...leai/responsibleai/modelanalysis/model_analysis.py
... and 37 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

github-actions · 2023-01-05T23:15:44Z

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/gaugup/UpdateRaiUtils/dashboard/index.html

…nd `nlp_feature_extractors` (#1873) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]>

* Add missing property 'id' in ICounterfactualData Signed-off-by: Gaurav Gupta <[email protected]> * Update some sample notebooks to include dropped_features (#1836) * update some notebooks to include dropped_features * update some notebooks to include dropped_features * update some notebooks to include dropped_features * remove unused changes * remove unused changes * address comments * upgrade setup-python github action from v2 to v4 and pin to older ubuntu image for python 3.6 to fix build error (#1838) * Gate call to probability distribution end point (#1839) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Revert "Update some sample notebooks to include dropped_features (#1836)" (#1837) This reverts commit d89b03a. * fix cf error on unable to update text (#1842) * Disable partial dependence plots for large data scenarios (#1843) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Remove redundant call to serialize_json_safe() in raiwidgets causal tests (#1840) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Fetching global causal effects and global policy from SDK backend (#1753) * Add callback for global causal effects Signed-off-by: Gaurav Gupta <[email protected]> * Query SDK backend to get global causal effects Signed-off-by: Gaurav Gupta <[email protected]> * Fix bug in causal serialization Signed-off-by: Gaurav Gupta <[email protected]> * Adding callback for causal ploicy Signed-off-by: Gaurav Gupta <[email protected]> * propagate global and local effects only Signed-off-by: Gaurav Gupta <[email protected]> * Add support for getting global causal effects from SDK backend Signed-off-by: Gaurav Gupta <[email protected]> * lint fix Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> * Fix Signed-off-by: Gaurav Gupta <[email protected]> * Fix bug Signed-off-by: Gaurav Gupta <[email protected]> * Modify the cohort message Signed-off-by: Gaurav Gupta <[email protected]> * Move to state Signed-off-by: Gaurav Gupta <[email protected]> * Fix imports Signed-off-by: Gaurav Gupta <[email protected]> * Remove console.log Signed-off-by: Gaurav Gupta <[email protected]> * Change the if condition Signed-off-by: Gaurav Gupta <[email protected]> * Add postga build trigger (#1755) (#1756) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Add model wrapper for wrapping predictions and test data (#1762) * Add model wrapper for wrapping predictions and test data Signed-off-by: Gaurav Gupta <[email protected]> * Fix failing tests Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> * Remove force update Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Update requirements-linting.txt (#1847) * Remove typo casual and correcting it to causal (#1846) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Disable local causal chart for large data support (#1845) * Disable local causal chart for large data support Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * add multilabel text example and fix correct and incorrect groups in data analysis (#1848) * Add number of cohort samples inside generateMetrics() (#1849) * Add number of cohort samples inside generateMetrics() Signed-off-by: Gaurav Gupta <[email protected]> * Yarn lintfix Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * add multilabel RAI vision example for fridge multilabel dataset (#1844) * fix install command for speech to text example (#1856) * Send the correct column name to SDK backend for model overview distribution charts (#1835) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Derive fairness metrics from metric stats instead of cohort stats (#1854) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * add upper bounds to greenlet and gevent in rai-core-flask as 5.0 release fails until they are more stable (#1852) * fix loading older versions of RAIInsights due to _FEATURE_METADATA key error (#1857) * Update maintainers (#1860) * Update requirements.txt in `raiwidgets` and `responsibleai` to pin numpy upper bound (#1864) * Update requirements.txt * Update requirements.txt * Port `cohort.py` from `raiwidgets` to `raiutils` (#1859) * Port cohort.py from raiwidgets to raiutils Signed-off-by: Gaurav Gupta <[email protected]> * Add more constants Signed-off-by: Gaurav Gupta <[email protected]> * Add constants.py Signed-off-by: Gaurav Gupta <[email protected]> * Make constants public Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Add common APIs for model overview metrics (#1862) * Add metric SDK APIs for Model Overview metrics Signed-off-by: Gaurav Gupta <[email protected]> * remove console.log() Signed-off-by: Gaurav Gupta <[email protected]> * Port `cohort.py` from `raiwidgets` to `raiutils` (#1859) * Port cohort.py from raiwidgets to raiutils Signed-off-by: Gaurav Gupta <[email protected]> * Add more constants Signed-off-by: Gaurav Gupta <[email protected]> * Add constants.py Signed-off-by: Gaurav Gupta <[email protected]> * Make constants public Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> * lint fix Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Update requirements-linting.txt (#1861) * update raiwidgets to rai-core-flask v0.5.0 (#1851) * fix error in erroranalysis heatmap caused by max value over right side of max bin (#1866) * remove dead space in aggregate feature importance (#1869) * display tree branching decisions (#1870) * Remove warning for 'dropped_features are not in use currently.' (#1871) * display tree branching decisions * Remove warning for 'dropped_features are not in use currently.' * turn off fail-fast for python tests (#1878) * add multilabel model overview metrics (#1882) * Show branching decisions on hover over on unselected tree nodes (#1881) * show tree label on hover over * address comments * Update some sample notebooks to include dropped_features (#1836) * update some notebooks to include dropped_features * update some notebooks to include dropped_features * update some notebooks to include dropped_features * remove unused changes * remove unused changes * address comments * Revert "Update some sample notebooks to include dropped_features (#1836)" (#1837) This reverts commit d89b03a. * Update requirements-linting.txt (#1847) * Add number of cohort samples inside generateMetrics() (#1849) * Add number of cohort samples inside generateMetrics() Signed-off-by: Gaurav Gupta <[email protected]> * Yarn lintfix Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Update requirements-linting.txt (#1861) * add multilabel model overview metrics (#1882) * Update `raiutils` in `raiwidgets`, `responsibleai`, `erroranalysis` and `nlp_feature_extractors` (#1873) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> * Fix test Signed-off-by: Gaurav Gupta <[email protected]> * Undo changes Signed-off-by: Gaurav Gupta <[email protected]> * Fix lint Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]> Co-authored-by: tongy-msft <[email protected]> Co-authored-by: Ilya Matiach <[email protected]> Co-authored-by: Roman Lutz <[email protected]>

Update raiutils in raiwidgets, responsibleai, erroranalysis a…

848d665

…nd `nlp_feature_extractors` Signed-off-by: Gaurav Gupta <[email protected]>

gaugup requested review from imatiach-msft, xuke444, kicha0, RubyZ10, vinuthakaranth, tongyu-microsoft, hawestra and romanlutz as code owners January 3, 2023 19:58

romanlutz approved these changes Jan 3, 2023

View reviewed changes

vinuthakaranth approved these changes Jan 4, 2023

View reviewed changes

imatiach-msft approved these changes Jan 4, 2023

View reviewed changes

Merge branch 'main' into gaugup/UpdateRaiUtils

5044947

gaugup enabled auto-merge (squash) January 5, 2023 21:39

gaugup merged commit f2cdec6 into main Jan 6, 2023

gaugup deleted the gaugup/UpdateRaiUtils branch January 6, 2023 04:13

gaugup added a commit that referenced this pull request Jan 6, 2023

Update raiutils in raiwidgets, responsibleai, erroranalysis a…

4466434

…nd `nlp_feature_extractors` (#1873) Signed-off-by: Gaurav Gupta <[email protected]> Signed-off-by: Gaurav Gupta <[email protected]>

imatiach-msft mentioned this pull request Jan 6, 2023

release raiwidgets and responsibleai 0.24.0 #1891

Merged

3 tasks

imatiach-msft mentioned this pull request Jan 15, 2023

release erroranalysis v0.4.0 #1909

Merged

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update `raiutils` to 0.3.0 in `raiwidgets`, `responsibleai`, `erroranalysis` and `nlp_feature_extractors` #1873

Update `raiutils` to 0.3.0 in `raiwidgets`, `responsibleai`, `erroranalysis` and `nlp_feature_extractors` #1873

gaugup commented Jan 3, 2023

github-actions bot commented Jan 3, 2023

codecov-commenter commented Jan 5, 2023 •

edited

Loading

github-actions bot commented Jan 5, 2023

Update raiutils to 0.3.0 in raiwidgets, responsibleai, erroranalysis and nlp_feature_extractors #1873

Update raiutils to 0.3.0 in raiwidgets, responsibleai, erroranalysis and nlp_feature_extractors #1873

Conversation

gaugup commented Jan 3, 2023

Description

Checklist

github-actions bot commented Jan 3, 2023

codecov-commenter commented Jan 5, 2023 • edited Loading

Codecov Report

github-actions bot commented Jan 5, 2023

Update `raiutils` to 0.3.0 in `raiwidgets`, `responsibleai`, `erroranalysis` and `nlp_feature_extractors` #1873

Update `raiutils` to 0.3.0 in `raiwidgets`, `responsibleai`, `erroranalysis` and `nlp_feature_extractors` #1873

codecov-commenter commented Jan 5, 2023 •

edited

Loading