merge RAI Text repository to RAI toolbox #2118
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… text tokenizer (#1)
* add error analysis for QA model
Added regex based question type feature extractor --------- Co-authored-by: Jarvis Gao <[email protected]> Co-authored-by: Jarvis Gao <[email protected]>
…ormance when retraining tree or creating new matrix (#9)
* Update .gitignore * Improve regex matching modify regex to cover more cases * add feature context_overlap * add unit tests for QA feature extractors * fix CI * fix test case
* Fixed metrics and added bertscore * Update setup.py to add extras for qa metrics * Update CI-python.yml to install qa extras * fix linting error * linting fixup * fix lint * fix flake8 linting * fix install command in CI --------- Co-authored-by: akhil-2709 <[email protected]> Co-authored-by: Neutrinowo <[email protected]>
* added-syntactic-complexity-feature Added syntactic complexity features, i.e., average and maximum parse tree depth for both Context and Questions. * fixed-lint
… causing exceptions in error analysis (#22)
… the text columns to differentiate from metadata (#24)
imatiach-msft
force-pushed
the
ilmat/mv-rai-text-toolbox
branch
from
7575506 to
11a1b9a
Compare
imatiach-msft
force-pushed
the
ilmat/mv-rai-text-toolbox
branch
2 times, most recently
from
f74b48e to
9448a95
Compare
responsible-ai-toolbox
imatiach-msft
force-pushed
the
ilmat/mv-rai-text-toolbox
branch
from
9448a95 to
5ab231f
Compare
1 similar comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR merges the responsibleai-text repository to the responsible-ai-toolbox.
Checklist