Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include functional tests from cram in coverage reports #688

Closed
huddlej opened this issue Feb 25, 2021 · 0 comments · Fixed by #899 · May be fixed by dandye/augur#1
Closed

Include functional tests from cram in coverage reports #688

huddlej opened this issue Feb 25, 2021 · 0 comments · Fixed by #899 · May be fixed by dandye/augur#1
Labels
enhancement New feature or request

Comments

@huddlej
Copy link
Contributor

huddlej commented Feb 25, 2021

Context

Coverage reports from pytest help us identify large gaps in our tests. Functional tests written in Cram aren't currently reflected in coverage reports, but they likely cover code that isn't covered by unit tests.

Description

Ideally, Cram's coverage could be merged with the pytest coverage prior to uploading to the CodeCov service.

Possible solution

  1. Generate coverage from Cram tests by defining a COVERAGE variable prior to Cram execution
  2. Run Cram with coverage enabled before pytest in the CI
  3. Run pytest with the --cov-append flag so the unit test coverage is added to the functional test coverage
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
1 participant