Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable code coverage. #681

Merged
merged 1 commit into from
Oct 16, 2024
Merged

Enable code coverage. #681

merged 1 commit into from
Oct 16, 2024

Conversation

hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Oct 16, 2024

What does this PR do?

Code coverage started to malfunction due to some compatibility issue between current Rust and llvm-cov/nextest versions. This PR bumps llvm-cov and nextest to bring back code coverage.

@pr-commenter
Copy link

pr-commenter bot commented Oct 16, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-10-16 15:10:44

Comparing candidate commit 938cd0e in PR branch julio/enable-codecov with baseline commit f399485 in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

  • 🟩 execution_time [-68.562ns; -60.837ns] or [-2.492%; -2.212%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 622.747µs 624.548µs ± 0.430µs 624.573µs ± 0.296µs 624.859µs 625.186µs 625.363µs 625.519µs 0.15% -0.546 0.887 0.07% 0.030µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1598673.010op/s 1601158.706op/s ± 1102.663op/s 1601094.600op/s ± 758.332op/s 1601867.228op/s 1602925.247op/s 1604135.651op/s 1605787.441op/s 0.29% 0.552 0.902 0.07% 77.970op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 460.970µs 462.118µs ± 0.418µs 462.112µs ± 0.296µs 462.407µs 462.783µs 463.103µs 463.461µs 0.29% 0.226 0.034 0.09% 0.030µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2157680.816op/s 2163952.595op/s ± 1955.935op/s 2163976.948op/s ± 1388.353op/s 2165363.327op/s 2166988.981op/s 2167967.193op/s 2169338.321op/s 0.25% -0.221 0.030 0.09% 138.306op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 178.234µs 178.431µs ± 0.118µs 178.419µs ± 0.070µs 178.498µs 178.629µs 178.789µs 178.932µs 0.29% 0.815 1.524 0.07% 0.008µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5588724.408op/s 5604401.149op/s ± 3702.046op/s 5604772.368op/s ± 2183.229op/s 5606687.137op/s 5609817.427op/s 5610582.775op/s 5610615.613op/s 0.10% -0.810 1.505 0.07% 261.774op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.718µs 46.861µs ± 0.080µs 46.851µs ± 0.049µs 46.902µs 47.013µs 47.101µs 47.177µs 0.70% 0.966 1.710 0.17% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21196715.441op/s 21339651.304op/s ± 36323.346op/s 21344038.668op/s ± 22384.028op/s 21364783.104op/s 21391762.643op/s 21402632.806op/s 21404882.924op/s 0.29% -0.952 1.663 0.17% 2568.448op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.612µs 49.302µs ± 0.306µs 49.302µs ± 0.241µs 49.537µs 49.780µs 49.875µs 50.079µs 1.58% -0.003 -0.864 0.62% 0.022µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19968626.038op/s 20283771.420op/s ± 125763.404op/s 20283277.248op/s ± 99031.228op/s 20383622.168op/s 20481316.169op/s 20513978.577op/s 20570860.515op/s 1.42% 0.024 -0.872 0.62% 8892.816op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [624.488µs; 624.608µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1601005.888op/s; 1601311.525op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [462.060µs; 462.176µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2163681.521op/s; 2164223.669op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [178.415µs; 178.448µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5603888.081op/s; 5604914.217op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.850µs; 46.872µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21334617.238op/s; 21344685.371op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.260µs; 49.345µs] or [-0.086%; +0.086%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20266341.822op/s; 20301201.019op/s] or [-0.086%; +0.086%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 141.278µs 142.213µs ± 0.434µs 142.168µs ± 0.200µs 142.400µs 142.791µs 143.433µs 145.890µs 2.62% 3.165 24.729 0.30% 0.031µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [142.153µs; 142.273µs] or [-0.042%; +0.042%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.000µs 2.014µs 2.015µs 2.016µs 2.026µs 0.61% 7.660 82.405 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 493498313.748op/s 496521660.225op/s ± 266721.673op/s 496499036.921op/s ± 106107.219op/s 496683417.986op/s 496733146.837op/s 496759129.834op/s 496770491.633op/s 0.05% -7.618 81.762 0.05% 18860.070op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 118.015µs 118.819µs ± 0.356µs 118.755µs ± 0.227µs 119.042µs 119.449µs 119.715µs 119.734µs 0.82% 0.481 -0.254 0.30% 0.025µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8351863.006op/s 8416214.187op/s ± 25186.962op/s 8420726.022op/s ± 16095.683op/s 8433605.605op/s 8452803.230op/s 8462796.911op/s 8473475.480op/s 0.63% -0.467 -0.268 0.30% 1780.987op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 109.372µs 110.216µs ± 0.417µs 110.159µs ± 0.191µs 110.374µs 110.888µs 111.657µs 112.704µs 2.31% 2.078 8.318 0.38% 0.029µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 8872765.806op/s 9073225.503op/s ± 34032.952op/s 9077775.789op/s ± 15773.000op/s 9093076.986op/s 9113463.366op/s 9134453.038op/s 9143146.508op/s 0.72% -2.011 7.903 0.37% 2406.493op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.001µs 2.015µs 2.015µs 2.016µs 2.024µs 0.49% 4.208 32.985 0.05% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 494094795.943op/s 496496232.242op/s ± 266030.464op/s 496515143.786op/s ± 155661.304op/s 496677052.953op/s 496750297.572op/s 496773024.969op/s 496791020.180op/s 0.06% -4.180 32.647 0.05% 18811.194op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 105.044µs 106.060µs ± 0.320µs 106.073µs ± 0.176µs 106.223µs 106.651µs 106.782µs 107.203µs 1.06% 0.050 1.052 0.30% 0.023µs 1 200
credit_card/is_card_number/378282246310005 throughput 9328091.666op/s 9428722.144op/s ± 28466.063op/s 9427428.130op/s ± 15685.463op/s 9444478.287op/s 9474146.476op/s 9500608.505op/s 9519817.404op/s 0.98% -0.022 1.038 0.30% 2012.855op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 103.601µs 104.819µs ± 0.564µs 104.803µs ± 0.369µs 105.144µs 105.844µs 106.428µs 106.469µs 1.59% 0.498 0.084 0.54% 0.040µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9392374.058op/s 9540570.353op/s ± 51166.322op/s 9541682.193op/s ± 33629.826op/s 9578790.179op/s 9613071.714op/s 9632264.087op/s 9652449.480op/s 1.16% -0.468 0.040 0.53% 3618.005op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 23.238µs 23.965µs ± 0.378µs 23.963µs ± 0.257µs 24.231µs 24.541µs 24.840µs 24.931µs 4.04% 0.083 -0.662 1.57% 0.027µs 1 200
credit_card/is_card_number/x371413321323331 throughput 40110724.885op/s 41738004.720op/s ± 658175.454op/s 41731060.570op/s ± 447862.477op/s 42169497.142op/s 42787250.239op/s 43021990.272op/s 43033257.053op/s 3.12% -0.021 -0.687 1.57% 46540.033op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.001µs 2.014µs 2.015µs 2.016µs 2.017µs 0.16% 0.969 1.212 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 495704740.884op/s 496519540.461op/s ± 199611.019op/s 496511593.546op/s ± 150177.653op/s 496691164.012op/s 496767136.528op/s 496791526.712op/s 496827160.685op/s 0.06% -0.966 1.202 0.04% 14114.631op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 96.913µs 98.094µs ± 0.434µs 98.053µs ± 0.285µs 98.362µs 98.864µs 99.034µs 99.729µs 1.71% 0.391 0.357 0.44% 0.031µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10027214.056op/s 10194522.528op/s ± 45046.437op/s 10198559.480op/s ± 29593.294op/s 10224361.074op/s 10259146.755op/s 10291500.081op/s 10318566.520op/s 1.18% -0.362 0.314 0.44% 3185.264op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 87.914µs 88.775µs ± 0.423µs 88.734µs ± 0.260µs 89.028µs 89.537µs 89.848µs 90.129µs 1.57% 0.441 0.094 0.48% 0.030µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11095249.378op/s 11264646.710op/s ± 53585.757op/s 11269587.336op/s ± 33082.921op/s 11299478.257op/s 11347256.903op/s 11371339.304op/s 11374689.624op/s 0.93% -0.414 0.058 0.47% 3789.085op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.001µs 2.014µs 2.015µs 2.016µs 2.016µs 0.11% 0.815 -0.104 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 496001369.823op/s 496529282.678op/s ± 182685.873op/s 496550772.325op/s ± 131361.013op/s 496682332.084op/s 496734483.513op/s 496752567.385op/s 496763234.838op/s 0.04% -0.814 -0.107 0.04% 12917.842op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 83.850µs 84.774µs ± 0.444µs 84.731µs ± 0.278µs 85.017µs 85.667µs 85.891µs 86.062µs 1.57% 0.531 0.135 0.52% 0.031µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11619512.943op/s 11796425.720op/s ± 61685.344op/s 11802050.852op/s ± 38684.024op/s 11837925.165op/s 11887565.418op/s 11915802.239op/s 11926112.679op/s 1.05% -0.502 0.098 0.52% 4361.813op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 103.864µs 105.149µs ± 0.635µs 105.082µs ± 0.460µs 105.595µs 106.233µs 106.562µs 106.776µs 1.61% 0.243 -0.564 0.60% 0.045µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9365404.158op/s 9510673.203op/s ± 57322.603op/s 9516351.948op/s ± 41667.858op/s 9556605.222op/s 9599365.278op/s 9625907.519op/s 9628019.930op/s 1.17% -0.218 -0.577 0.60% 4053.320op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 23.243µs 24.152µs ± 0.471µs 24.142µs ± 0.348µs 24.487µs 24.950µs 25.187µs 25.416µs 5.28% 0.085 -0.603 1.94% 0.033µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 39346049.372op/s 41420494.418op/s ± 806367.871op/s 41421740.330op/s ± 595868.728op/s 42028687.409op/s 42693132.442op/s 43004139.198op/s 43023157.109op/s 3.87% -0.005 -0.645 1.94% 57018.819op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.014µs; 2.014µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ throughput [496484695.166op/s; 496558625.283op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [118.770µs; 118.869µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8412723.517op/s; 8419704.858op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [110.158µs; 110.274µs] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9068508.863op/s; 9077942.143op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/37828224631 execution_time [2.014µs; 2.014µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631 throughput [496459362.978op/s; 496533101.506op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/378282246310005 execution_time [106.015µs; 106.104µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number/378282246310005 throughput [9424777.022op/s; 9432667.267op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [104.740µs; 104.897µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9533479.193op/s; 9547661.513op/s] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/x371413321323331 execution_time [23.912µs; 24.017µs] or [-0.219%; +0.219%] None None None
credit_card/is_card_number/x371413321323331 throughput [41646787.932op/s; 41829221.508op/s] or [-0.219%; +0.219%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.014µs; 2.014µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/ throughput [496491876.294op/s; 496547204.629op/s] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [98.034µs; 98.154µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10188279.525op/s; 10200765.531op/s] or [-0.061%; +0.061%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [88.717µs; 88.834µs] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11257220.240op/s; 11272073.181op/s] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.014µs; 2.014µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [496503964.173op/s; 496554601.183op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [84.712µs; 84.835µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [11787876.724op/s; 11804974.715op/s] or [-0.072%; +0.072%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [105.061µs; 105.237µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9502728.842op/s; 9518617.565op/s] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [24.087µs; 24.217µs] or [-0.270%; +0.270%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [41308739.587op/s; 41532249.250op/s] or [-0.270%; +0.270%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.119µs 1.176µs ± 0.024µs 1.179µs ± 0.017µs 1.197µs 1.200µs 1.204µs 1.205µs 2.23% -0.948 0.066 2.03% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.173µs; 1.180µs] or [-0.282%; +0.282%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 80.726µs 80.893µs ± 0.188µs 80.873µs ± 0.040µs 80.916µs 80.967µs 81.353µs 83.233µs 2.92% 10.000 119.190 0.23% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [80.867µs; 80.919µs] or [-0.032%; +0.032%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.387µs 3.186µs ± 1.398µs 3.036µs ± 0.025µs 3.060µs 3.089µs 13.803µs 14.859µs 389.36% 7.601 57.866 43.78% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.992µs; 3.379µs] or [-6.083%; +6.083%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.219µs 23.024µs ± 10.054µs 18.630µs ± 0.172µs 19.165µs 37.607µs 38.663µs 99.597µs 434.61% 3.825 21.799 43.56% 0.711µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [21.630µs; 24.417µs] or [-6.052%; +6.052%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.872ms 8.908ms ± 0.014ms 8.907ms ± 0.009ms 8.916ms 8.931ms 8.951ms 8.957ms 0.56% 0.456 0.812 0.16% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.906ms; 8.910ms] or [-0.022%; +0.022%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.644µs 2.686µs ± 0.016µs 2.683µs ± 0.006µs 2.696µs 2.719µs 2.726µs 2.728µs 1.67% 0.129 1.149 0.59% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.684µs; 2.688µs] or [-0.082%; +0.082%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 190.393µs 192.961µs ± 0.735µs 193.020µs ± 0.441µs 193.411µs 194.159µs 194.354µs 194.373µs 0.70% -0.526 0.705 0.38% 0.052µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5144758.615op/s 5182472.523op/s ± 19784.650op/s 5180804.370op/s ± 11802.142op/s 5193549.584op/s 5218059.678op/s 5239172.911op/s 5252284.502op/s 1.38% 0.553 0.762 0.38% 1398.986op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.171µs 18.211µs ± 0.028µs 18.199µs ± 0.020µs 18.229µs 18.264µs 18.282µs 18.322µs 0.68% 0.837 0.508 0.15% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54578159.393op/s 54913193.035op/s ± 82972.999op/s 54946833.854op/s ± 60445.187op/s 54985789.901op/s 55006255.680op/s 55016465.685op/s 55032000.175op/s 0.15% -0.829 0.476 0.15% 5867.077op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 11.320µs 11.365µs ± 0.023µs 11.358µs ± 0.016µs 11.384µs 11.405µs 11.418µs 11.430µs 0.63% 0.561 -0.592 0.20% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 87490200.072op/s 87993634.467op/s ± 179984.664op/s 88040974.849op/s ± 123890.695op/s 88133860.193op/s 88225664.709op/s 88275147.019op/s 88342575.945op/s 0.34% -0.555 -0.602 0.20% 12726.838op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [192.859µs; 193.063µs] or [-0.053%; +0.053%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5179730.560op/s; 5185214.485op/s] or [-0.053%; +0.053%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.207µs; 18.214µs] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54901693.775op/s; 54924692.294op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/good execution_time [11.361µs; 11.368µs] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/good throughput [87968690.323op/s; 88018578.610op/s] or [-0.028%; +0.028%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.058µs 37.718µs ± 1.179µs 37.182µs ± 0.065µs 37.274µs 40.268µs 40.302µs 40.684µs 9.42% 1.700 0.918 3.12% 0.083µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.555µs; 37.882µs] or [-0.433%; +0.433%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 938cd0e 1729090817 julio/enable-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 255.629ns 268.477ns ± 14.226ns 262.970ns ± 4.312ns 274.351ns 306.918ns 312.105ns 313.942ns 19.38% 1.837 2.507 5.29% 1.006ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [266.506ns; 270.449ns] or [-0.734%; +0.734%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Oct 16, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.81%. Comparing base (67d4f7a) to head (938cd0e).
Report is 17 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #681      +/-   ##
==========================================
+ Coverage   71.79%   71.81%   +0.01%     
==========================================
  Files         271      271              
  Lines       40931    40935       +4     
==========================================
+ Hits        29388    29399      +11     
+ Misses      11543    11536       -7     
Components Coverage Δ
crashtracker 20.41% <ø> (ø)
crashtracker-ffi 9.07% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.92% <ø> (+0.32%) ⬆️
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 82.73% <0.00%> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.10% <85.71%> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 89.05% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.65% <94.44%> (-0.04%) ⬇️
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 36.08% <33.33%> (+<0.01%) ⬆️
sidecar-ffi 0.00% <0.00%> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.40% <58.82%> (-0.26%) ⬇️
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.48% <59.09%> (+0.19%) ⬆️

@hoolioh hoolioh force-pushed the julio/enable-codecov branch from 4f9a0e6 to 9c1ef72 Compare October 16, 2024 13:26
Update llvm-cov and nextest versions.
@hoolioh hoolioh force-pushed the julio/enable-codecov branch from 9c1ef72 to 938cd0e Compare October 16, 2024 15:00
@hoolioh hoolioh marked this pull request as ready for review October 16, 2024 15:11
@hoolioh hoolioh requested a review from a team as a code owner October 16, 2024 15:11
Copy link
Contributor

@r1viollet r1viollet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hoolioh hoolioh merged commit 9b01c90 into main Oct 16, 2024
30 checks passed
@hoolioh hoolioh deleted the julio/enable-codecov branch October 16, 2024 15:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants