Highlights
- Option to return response-level scores for
CounterfactualMetrics,AutoEval - Additional unit tests for
CounterfactualMetrics,AutoEval - Data loader functions for cleaner code when using example data
- Enforced strings in
ResponseGenerator,CounterfactualGeneratoroutput to avoid error when computing metrics if any response is None
What's Changed
- v0.2.1 updates by @dylanbouchard in #65
- Ds/data loader by @dskarbrevik in #59
- Unit tests for classification metrics by @mohitcek in #69
- enforce strings in response outputs, return response-level cf scores by @dylanbouchard in #66
- Consistent return object of AutoEval class by @mohitcek in #70
- notebook updates by @dylanbouchard in #72
- AutoEval unit tests by @mohitcek in #73
- Final changes before releasing v0.3.0 by @mohitcek in #75
- Release PR: v0.3.0 by @dylanbouchard in #76
Full Changelog: v0.2.1...v0.3.0
Contributors
dskarbrevik, mohitcek, and dylanbouchard