These are the results for shrinking test cases using the shrinking algorithms in the thesis. The CSV files are structured as follows:
First there is a comment block, these are the lines that start with #. The comment block contains general information on the shrinking process.
Shrunk traces: 10 ; The number of thest cases that were shrunk
Start total, inputs: 2276, 1732' ; The number of total steps (e.g. input + output) in the traces that were shrunk, and only the nr of inputs
Start: [56, 546, 86, 22, 130, 528, 39, 236, 482, 151]' ; the length of each individual test case before shrinking
Start inputs: [43, 411, 63, 17, 101, 411, 28, 180, 366, 112]' ; the length in inputs only
Start max, min, avg: 411, 17, 173.2' ; the min max and avg length of traces before shrinking (inputs only)
Next there is a header with the name of each column:
shrinker,time,times,nr_tests,nr_steps,steps,nr_inputs,inputs,end_max,end_min,end_avg,end,end_all_max,end_all_min,end_all_avg,end_all,time_step
shrinker: A list of the shrinkers that were used.
time: The total time of the shrinking process.
times: An array with the time it took to shrink each individual test cases.
nr_test: The number of test cases executes in the shrinkin process.
nr_steps, steps: Total nr of steps (inputs + outputs) and the steps for each test case shrunk.
nr_inputs, inputs: Total nr of interactions with the SUT (inputs) and inputs for each test case shrunk.
The columns afterwards contain the maximum, minimum and avarage size of the shrunk traces at the end measured in nr of inputs in the trace (e.g. interactions with the SUT).
The columns with the _all_ infix contain the same information, but counting both inputs and outputs.
The final line contains a calculation for the time that was needed per interaction with the sut.
There are two folders. The folder exp_vending contains the results of the 10 bugs that were tested in the vending machine experiment. The folder exp_ppr_aap contains the results of the 15 bugs for the experiment on ppr-aap.