Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Mutation Testing #3806

Closed
wants to merge 6 commits into from
Closed

feat: Mutation Testing #3806

wants to merge 6 commits into from

Conversation

fpbgg
Copy link
Contributor

@fpbgg fpbgg commented Jul 25, 2023

Description

This is my first swing at introducing mutation tests to our GitHub Actions workflows.

Mutation testing is a methodology where you mutate your source code and measure how many mutants "survive" your test suites. This provides a useful measurement for the quality of your test suite.

To run these tests locally:

  1. cargo install cargo-mutagen
  2. cargo mutagen

(Currently there's a missing file error, but the test cases are run and evaluated in target/mutagen/mutations so I'm assuming it's a coverage file issue.)

Additional info (benefits, drawbacks, caveats)

Checklist

  • Test coverage for new or modified code paths
  • Changelog is updated
  • Required documentation changes (e.g., docs/rpc/openapi.yaml and rpc-endpoints.md for v2 endpoints, event-dispatcher.md for new events)
  • New clarity functions have corresponding PR in clarity-benchmarking repo
  • New integration test(s) added to bitcoin-tests.yml

@fpbgg fpbgg changed the base branch from master to develop July 25, 2023 18:08
@codecov
Copy link

codecov bot commented Jul 25, 2023

Codecov Report

Merging #3806 (f1749ce) into develop (cec7b4b) will decrease coverage by 26.31%.
Report is 18 commits behind head on develop.
The diff coverage is n/a.

❗ Current head f1749ce differs from pull request most recent head 3b7b25e. Consider uploading reports for the commit 3b7b25e to get more accurate results

@@             Coverage Diff              @@
##           develop    #3806       +/-   ##
============================================
- Coverage    84.62%   58.31%   -26.31%     
============================================
  Files          302        1      -301     
  Lines       286798      571   -286227     
============================================
- Hits        242699      333   -242366     
+ Misses       44099      238    -43861     

see 301 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@saralab saralab assigned ghost Oct 28, 2023
@saralab
Copy link
Contributor

saralab commented Oct 28, 2023

@KeewenawSTX Is this something you can own ? Mutation Testing is worth investing in.

@CLAassistant
Copy link

CLAassistant commented Nov 16, 2023

CLA assistant check
All committers have signed the CLA.

@jbencin jbencin assigned BowTiedDeployer and unassigned ghost Nov 21, 2023
@saralab
Copy link
Contributor

saralab commented Nov 28, 2023

Alin has a new PR , closing this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Status: ✅ Done
Development

Successfully merging this pull request may close these issues.

None yet

4 participants