Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Confidence interval feature #639

Merged
merged 5 commits into from
Jun 18, 2024
Merged

Confidence interval feature #639

merged 5 commits into from
Jun 18, 2024

Conversation

a-kore
Copy link
Collaborator

@a-kore a-kore commented Jun 18, 2024

Feature

Short Description

Adds confidence intervals to performance-over-time plot in overview section. Users can specify the mean_std_min_evals parameter in the export method to set how many data points are required to start calculating intervals. The default is 3.

image

Tests Added

  • No tests added.

@amrit110 amrit110 added the enhancement New feature or request label Jun 18, 2024
@amrit110 amrit110 self-requested a review June 18, 2024 20:46
Copy link

codecov bot commented Jun 18, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 75.27%. Comparing base (9418bcf) to head (f44d842).

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff             @@
##             main     #639       +/-   ##
===========================================
+ Coverage   39.50%   75.27%   +35.76%     
===========================================
  Files         128      128               
  Lines       11471    11473        +2     
===========================================
+ Hits         4532     8636     +4104     
+ Misses       6939     2837     -4102     
Files Coverage Δ
cyclops/report/model_card/sections.py 100.00% <100.00%> (ø)
cyclops/report/report.py 72.82% <100.00%> (+47.04%) ⬆️

... and 89 files with indirect coverage changes

Impacted file tree graph

@amrit110 amrit110 merged commit d8eea4c into main Jun 18, 2024
11 checks passed
@amrit110 amrit110 deleted the confidence_interval_feature branch June 18, 2024 22:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants