Skip to content

fuzzgen: Add invalid input counter#5928

Merged
afonso360 merged 1 commit intobytecodealliance:mainfrom
afonso360:fuzzgen-fail-counter
Mar 4, 2023
Merged

fuzzgen: Add invalid input counter#5928
afonso360 merged 1 commit intobytecodealliance:mainfrom
afonso360:fuzzgen-fail-counter

Conversation

@afonso360
Copy link
Contributor

👋 Hey,

This is a followup to a suggestion that @jameysharp pointed out in #5820 (review). With the refactoring done there we can now count how many inputs we reject.

This is great since we can at least keep track of this and hopefully improve it in the future. Right now it isn't great at about 74% rejected inputs:

== FuzzGen Statistics  ====================
Valid Inputs: 130000
Invalid Inputs: 373838 (74.2% of Total Inputs)
Total Runs: 705910
Successful Runs: 690177 (97.8% of Total Runs)
Timed out Runs: 8247 (1.2% of Total Runs)
Traps:
        user code: int_divz: 6448 (0.9% of Total Runs)
        user code: int_ovf: 566 (0.1% of Total Runs)
        user code: bad_toint: 472 (0.1% of Total Runs)

@afonso360 afonso360 requested a review from jameysharp March 4, 2023 19:52
@github-actions github-actions bot added the fuzzing Issues related to our fuzzing infrastructure label Mar 4, 2023
@github-actions
Copy link

github-actions bot commented Mar 4, 2023

Subscribe to Label Action

cc @fitzgen

Details This issue or pull request has been labeled: "fuzzing"

Thus the following users have been cc'd because of the following labels:

  • fitzgen: fuzzing

To subscribe or unsubscribe from this label, edit the .github/subscribe-to-label.json configuration file.

Learn more.

@afonso360 afonso360 added this pull request to the merge queue Mar 4, 2023
Merged via the queue into bytecodealliance:main with commit c24d410 Mar 4, 2023
@afonso360 afonso360 deleted the fuzzgen-fail-counter branch March 4, 2023 22:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

fuzzing Issues related to our fuzzing infrastructure

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants