Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port over logic of load_adult_income_dataset from dice-ml to unblock gates #2106

Merged
merged 4 commits into from
Jun 8, 2023

Conversation

gaugup
Copy link
Contributor

@gaugup gaugup commented Jun 8, 2023

Description

Port over logic of load_adult_income_dataset from dice-ml to unblock gates

Checklist

  • I have added screenshots above for all UI changes.
  • I have added e2e tests for all UI changes.
  • Documentation was updated if it was needed.

@codecov-commenter
Copy link

codecov-commenter commented Jun 8, 2023

Codecov Report

Merging #2106 (90f4555) into main (f720299) will decrease coverage by 0.78%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #2106      +/-   ##
==========================================
- Coverage   93.20%   92.43%   -0.78%     
==========================================
  Files          38      101      +63     
  Lines        1840     5022    +3182     
==========================================
+ Hits         1715     4642    +2927     
- Misses        125      380     +255     
Flag Coverage Δ
unittests 92.43% <ø> (-0.78%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 63 files with indirect coverage changes

@gaugup gaugup enabled auto-merge (squash) June 8, 2023 21:09
@gaugup gaugup merged commit 3952cbd into main Jun 8, 2023
@gaugup gaugup deleted the gaugup/PortOverLogicFromDiceML branch June 8, 2023 22:32
vinuthakaranth pushed a commit that referenced this pull request Jul 5, 2023
…ock gates (#2106)

* Port over logic of `load_adult_income_dataset` from `dice-ml` to unblock gates

Signed-off-by: Gaurav Gupta <[email protected]>

* Fix linting and add TODO

Signed-off-by: Gaurav Gupta <[email protected]>

* Add fixture for dataset fetch

Signed-off-by: Gaurav Gupta <[email protected]>

---------

Signed-off-by: Gaurav Gupta <[email protected]>
imatiach-msft added a commit that referenced this pull request Jul 10, 2023
* add individual feature importance for QA

temporally use a dropdown to select token

* make QA UI compatible with text classification

temporally using hardcode isQA flag as the prop for identifying qa from an upper level is TBD

* fix left textbox data

fix left textbox importance data and add description for qa interpret

* add isAllDataCohort (#2094)

Signed-off-by: RubyZ10 <[email protected]>

* retain selections (#2096)

Signed-off-by: RubyZ10 <[email protected]>

* Adding Class Name To OD Dropdown (#2098)

* changing dropdown to include class name

* prettier

* Update erroranalysis-dashboard-regression-superconductor.ipynb (#2102)

* Port over logic of `load_adult_income_dataset` from `dice-ml` to unblock gates (#2106)

* Port over logic of `load_adult_income_dataset` from `dice-ml` to unblock gates

Signed-off-by: Gaurav Gupta <[email protected]>

* Fix linting and add TODO

Signed-off-by: Gaurav Gupta <[email protected]>

* Add fixture for dataset fetch

Signed-off-by: Gaurav Gupta <[email protected]>

---------

Signed-off-by: Gaurav Gupta <[email protected]>

* refactor cohortlist (#2103)

Signed-off-by: RubyZ10 <[email protected]>

* Fix dimension mismatch error when dropped_features contains cat_features (#2099)

* fix error when dropped_features contains cat_features

* fix lint

* add tests

* add tests

* fix UT error

* Add more dataset utilities in `rai_test_utils` (#2101)

Signed-off-by: Gaurav Gupta <[email protected]>

* release erroranalysis 0.4.4 (#2105)

* update responsibleai and raiwidgets to erroranalysis 0.4.4 (#2107)

* enable confusion matrix for binary and multiclass text and vision RAI dashboards (#2108)

* release raiwidgets and responsibleai 0.28.0 (#2109)

* Release `rai-test-utils` 0.3.0 (#2110)

* Update rai_test_utils in erroranalysis and responsibleai to 0.3.0 (#2111)

* Update rai_test_utils in erroranalysis and responsibleai to 0.3.0

* Update requirements-dev.txt

* update econml to latest 0.14.1 release (#2112)

* causal fix (#2113)

Signed-off-by: vinutha karanth <[email protected]>

* [Image Explorer] CanvasTools Image Loading support for Object Detection (#2097)

* bbox vott template ckpt

* canvastools image load ckpt

* loading image from scratch ckpt

* canvastools image loading support

* coordinate fixes

* regiondata call + path fix

* code cleanup

* image loading ckpt

* callback image loading support

* lint fixes

* disabling internal imports for vott

* file refactor lint fix

* auto lint fixes

* lint fixes

* image dims arg for frontend bbox

* lint fixes

* lint fixes

* image dimension support

* canvas module added

* comment fix

* async image loading support

* lint fixes

* lint fixes

* max-lines lint fixes

* lint fixes

* Add columns names to `create_multiclass_classification_dataset` (#2114)

Signed-off-by: Gaurav Gupta <[email protected]>

* [Object Detection] [Image Explorer] Bounding Box Support with CanvasTools on Flyout (#2116)

* bbox vott template ckpt

* canvastools image load ckpt

* loading image from scratch ckpt

* canvastools image loading support

* coordinate fixes

* regiondata call + path fix

* code cleanup

* image loading ckpt

* callback image loading support

* lint fixes

* bounding box working ckpt for fridge

* disabling internal imports for vott

* freeze rough ckpt

* file refactor lint fix

* auto lint fixes

* freeze cleanup

* lint fixes

* image dims arg for frontend bbox

* lint fixes

* lint fixes

* image dimension support

* imagedim support comments

* image dimension support

* image dimension support

* canvas module added

* image dimension working ckpt

* comment fix

* cleanup

* async image loading support

* lint fixes

* lint fixes

* reverted max line override

* code cleanups

* lint fixes

* auto lint fixes

* comment fixes

* add ResponsibleAI Text package as initial commit

* update responsibleai-text package to responsibleai v0.25.0

* add model-agnostic explanation support for wrapped models with simple text tokenizer (#1)

* add build and release github actions to responsibleai-text package (#2)

* Enable error analysis for QA (#5)

* add error analysis for QA model

* validate github actions, fix linting and builds (#4)

* added question type feature extractor (#6)

Added regex based question type feature extractor

---------

Co-authored-by: Jarvis Gao <[email protected]>
Co-authored-by: Jarvis Gao <[email protected]>

* remove train data parameter from RAITextInsights (#7)

* release responsibleai-text v0.1.0 (#8)

* cache error analysis predictions for RAITextInsights to optimize performance when retraining tree or creating new matrix (#9)

* update responsibleai-text package to responsibleai v0.27.0 (#11)

* release responsibleai-text v0.1.1 (#12)

* Add QA feature context overlap and improve question type regex (#14)

* Update .gitignore

* Improve regex matching

modify regex to cover more cases

* add feature context_overlap

* add unit tests for QA feature extractors

* fix CI

* fix test case

* fix task type for multilabel and multiclass classification when passed to UX (#15)

* release responsibleai-text 0.1.2 (#16)

* Python backend metrics for question answering scenario (#17)

* Fixed metrics and added bertscore

* Update setup.py to add extras for qa metrics

* Update CI-python.yml to install qa extras

* fix linting error

* linting fixup

* fix lint

* fix flake8 linting

* fix install command in CI

---------

Co-authored-by: akhil-2709 <[email protected]>
Co-authored-by: Neutrinowo <[email protected]>

* added-syntactic-complexity (#18)

* added-syntactic-complexity-feature

Added syntactic complexity features, i.e., average and maximum parse tree depth for both Context and Questions.

* fixed-lint

* add metadata support to RAITextInsights (#19)

* fix feature metadata serialization logic in RAITextInsights which was causing exceptions in error analysis (#22)

* add text_column parameter to RAITextInsights to allow user to specify the text columns to differentiate from metadata (#24)

* release responsibleai-text 0.1.3 (#21)

* fix responsibleai-text linting and move directory to
responsible-ai-toolbox

* Add loading spinner for causal policy tab (#2121)

* Add loading spinner for causal policy tab

Signed-off-by: Gaurav Gupta <[email protected]>

* Address code review comments

Signed-off-by: Gaurav Gupta <[email protected]>

---------

Signed-off-by: Gaurav Gupta <[email protected]>

* Refactor- Add datasetCohorts to ModelAssessementContext && create datasetCohort && add compositeFilter in DatasetCohort (#2119)

* refactor

Signed-off-by: RubyZ10 <[email protected]>

* address comments

Signed-off-by: RubyZ10 <[email protected]>

---------

Signed-off-by: RubyZ10 <[email protected]>

* remove console log (#2125)

Signed-off-by: RubyZ10 <[email protected]>

* Update msdata-rai-widgets-onelocbuild.yml for Azure Pipelines

* fix build failures due to lint errors for onelocbuild yml (#2137)

* Skipping python 3.7 tests on MACOS (#2129)

* [WIP] Debugging _bz2 failures

* Update CI-python.yml

* Update CI-python.yml

* Update CI-python.yml

* Update CI-python.yml

* Update CI-python.yml

* Update CI-python.yml

* `rai_test_utils`: Convert all namespaces in `__all__` list as strings (#2128)

Signed-off-by: Gaurav Gupta <[email protected]>

* User Flows / Architectures

* [Object Detection] DFD Documentation (#2138)

* dfd

* yarn lint

* [Object Detection] Explanation Documentation (#2136)

* docs for expl

* fixing name

* docs correcting image

* yarn lintfix

* Update docs/explanation-object-detection-README.md

Co-authored-by: Advitya Gemawat <[email protected]>

* removing dpv2

---------

Co-authored-by: Advitya Gemawat <[email protected]>

* CanvasTools documentation

* isQA as prop

Signed-off-by: vinutha karanth <[email protected]>

* update and refine

Signed-off-by: vinutha karanth <[email protected]>

* remove state isQA

Signed-off-by: vinutha karanth <[email protected]>

* clean

Signed-off-by: vinutha karanth <[email protected]>

---------

Signed-off-by: RubyZ10 <[email protected]>
Signed-off-by: Gaurav Gupta <[email protected]>
Signed-off-by: vinutha karanth <[email protected]>
Co-authored-by: Neutrinowo <[email protected]>
Co-authored-by: Ruby Zhu <[email protected]>
Co-authored-by: natalie-isak <[email protected]>
Co-authored-by: tongy-msft <[email protected]>
Co-authored-by: Gaurav Gupta <[email protected]>
Co-authored-by: Ilya Matiach <[email protected]>
Co-authored-by: Advitya Gemawat <[email protected]>
Co-authored-by: Sreeja Gaddamidi <[email protected]>
Co-authored-by: Jarvis Gao <[email protected]>
Co-authored-by: mehektulsyan <[email protected]>
Co-authored-by: akhil-2709 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants