Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce mutation testing #328

Merged
merged 29 commits into from
Jan 2, 2024
Merged

Introduce mutation testing #328

merged 29 commits into from
Jan 2, 2024

Commits on Dec 28, 2023

  1. configuration for cosmic-ray

    @tomato42
    tomato42 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    60d3fd5 View commit details
    Browse the repository at this point in the history

  2. add quick mutation testing to travis

    @tomato42
    tomato42 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    aa7e7b3 View commit details
    Browse the repository at this point in the history

  3. add --fast option to run hypothesis tests faster

    @tomato42
    tomato42 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    880d3cc View commit details
    Browse the repository at this point in the history

  4. add mark @slow to allow skipping slowest tests 

    as calling openssl is very slow, allow skipping tests that do that
    @tomato42
    tomato42 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    f433d49 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2023

  1. more test speed-ups

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    260cc29 View commit details
    Browse the repository at this point in the history

  2. extend the cosmic-ray testing

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    724535a View commit details
    Browse the repository at this point in the history

  3. how to run cosmic-ray comfortably

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    cbf086e View commit details
    Browse the repository at this point in the history

  4. increase the survival rate limit 

    currently we have 28.88% survival rate, so set that as the baseline
    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    6ee5257 View commit details
    Browse the repository at this point in the history

  5. waive test coverage for mutation speedups 

    the branches in test coverage that are there to speed up mutation testing
don't have to be covered by regular testing so waive them
    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    082a403 View commit details
    Browse the repository at this point in the history

  6. ensure that the equality tests are collected by instrumental

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    c2a1c16 View commit details
    Browse the repository at this point in the history

  7. test verification with plain Point 

    PointJacobi has a mul_add() method, but Point doesn't, verify
that verifies() works with both point encodings
    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    c17d7e7 View commit details
    Browse the repository at this point in the history

  8. deprecate digest_integer() and related methods

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    c983649 View commit details
    Browse the repository at this point in the history

  9. test coverage for Edwards key public_point() method

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    f369620 View commit details
    Browse the repository at this point in the history

  10. test coverage for CurveFp.__str__

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    c5b7c7a View commit details
    Browse the repository at this point in the history

  11. test coverage for CurveEdTw() __str__

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    8125ca2 View commit details
    Browse the repository at this point in the history

  12. ensure CurveEdTw hashability

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    6b56848 View commit details
    Browse the repository at this point in the history

  13. more complete test coverage for Jacobi points without hypothesis

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    27b1310 View commit details
    Browse the repository at this point in the history

  14. mark multithreaded tests as slow

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    55d7321 View commit details
    Browse the repository at this point in the history

  15. mark all openssl calling tests as slow

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    0cfc121 View commit details
    Browse the repository at this point in the history

  16. quicker encode-decode tests

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    0056307 View commit details
    Browse the repository at this point in the history

  17. update examples for the new cosmic-ray

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    159be34 View commit details
    Browse the repository at this point in the history

  18. don't run speed tests on mutation and codechecks tests

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    ad564c0 View commit details
    Browse the repository at this point in the history

  19. add mutation testing to PR

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    da9d8bb View commit details
    Browse the repository at this point in the history

  20. correct exclude configuration

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    6f09910 View commit details
    Browse the repository at this point in the history

  21. log number of tests to run

    @tomato42
    tomato42 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    09ffa0f View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2023

  1. Run mutation testing on multiple workers in parallel

    @tomato42
    tomato42 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    cae3082 View commit details
    Browse the repository at this point in the history

  2. create mutation score badge

    @tomato42
    tomato42 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    8df3bb8 View commit details
    Browse the repository at this point in the history

  3. error tolerance

    @tomato42
    tomato42 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    1364e89 View commit details
    Browse the repository at this point in the history

  4. long execution for mutation testing

    @tomato42
    tomato42 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    c4c6ff6 View commit details
    Browse the repository at this point in the history