[APMSP-1391] Add missing crates to code coverage.

[hoolioh]

What does this PR do?

Add missing crates to code coverage support.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.83%. Comparing base (bc58fa5) to head (55d8fa3).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #652      +/-   ##
==========================================
+ Coverage   73.81%   73.83%   +0.01%     
==========================================
  Files         257      257              
  Lines       37309    37318       +9     
==========================================
+ Hits        27541    27555      +14     
+ Misses       9768     9763       -5     

Components	Coverage Δ
crashtracker	20.48% <ø> (ø)
crashtracker-ffi	9.28% <ø> (ø)
datadog-alloc	98.73% <ø> (ø)
data-pipeline	93.33% <ø> (+0.27%)	⬆️
data-pipeline-ffi	0.00% <ø> (ø)
ddcommon	83.08% <ø> (ø)
ddcommon-ffi	69.52% <ø> (ø)
ddtelemetry	59.10% <ø> (ø)
ddtelemetry-ffi	22.13% <ø> (ø)
dogstatsd	90.42% <ø> (ø)
dogstatsd-client	79.77% <ø> (ø)
ipc	83.58% <ø> (ø)
profiling	84.26% <ø> (ø)
profiling-ffi	77.42% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	38.19% <ø> (ø)
sidecar-ffi	0.00% <ø> (ø)
spawn-worker	50.36% <ø> (ø)
tinybytes	94.77% <ø> (ø)
trace-mini-agent	72.47% <ø> (ø)
trace-normalization	98.25% <ø> (ø)
trace-obfuscation	95.73% <ø> (ø)
trace-protobuf	77.67% <ø> (ø)
trace-utils	93.46% <ø> (-0.41%)	⬇️

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2024-09-26 14:06:03

Comparing candidate commit 55d8fa3 in PR branch julio/code-coverage with baseline commit bc58fa5 in branch main.

Found 2 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

• 🟩 execution_time [-9.831µs; -9.727µs] or [-2.068%; -2.046%]
• 🟩 throughput [+43927.401op/s; +44400.727op/s] or [+2.089%; +2.111%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	142.027µs	142.800µs ± 0.508µs	142.740µs ± 0.199µs	142.940µs	143.350µs	144.794µs	146.984µs	2.97%	4.054	25.555	0.35%	0.036µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[142.730µs; 142.871µs] or [-0.049%; +0.049%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	37.884µs	38.499µs ± 1.175µs	37.958µs ± 0.037µs	38.023µs	41.016µs	41.054µs	42.235µs	11.27%	1.730	1.078	3.04%	0.083µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[38.336µs; 38.662µs] or [-0.423%; +0.423%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.389µs	3.218µs ± 1.582µs	3.066µs ± 0.036µs	3.097µs	3.162µs	14.015µs	18.315µs	497.41%	8.011	65.081	49.04%	0.112µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.999µs; 3.438µs] or [-6.813%; +6.813%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.746µs	22.718µs ± 10.820µs	17.944µs ± 0.070µs	18.063µs	43.298µs	46.930µs	97.853µs	445.32%	3.246	15.021	47.51%	0.765µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[21.218µs; 24.217µs] or [-6.601%; +6.601%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	501.391µs	501.957µs ± 0.288µs	501.930µs ± 0.166µs	502.098µs	502.512µs	502.863µs	502.989µs	0.21%	0.868	1.183	0.06%	0.020µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1988115.927op/s	1992202.765op/s ± 1143.450op/s	1992311.008op/s ± 659.125op/s	1992955.401op/s	1993831.197op/s	1994180.246op/s	1994452.320op/s	0.11%	-0.864	1.173	0.06%	80.854op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	464.953µs	465.690µs ± 0.278µs	465.707µs ± 0.183µs	465.867µs	466.131µs	466.354µs	466.597µs	0.19%	0.227	0.158	0.06%	0.020µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2143177.089op/s	2147349.948op/s ± 1282.452op/s	2147271.279op/s ± 843.415op/s	2148267.000op/s	2149334.092op/s	2149999.134op/s	2150753.805op/s	0.16%	-0.223	0.154	0.06%	90.683op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	180.117µs	181.849µs ± 0.301µs	181.876µs ± 0.169µs	182.030µs	182.244µs	182.308µs	182.404µs	0.29%	-1.561	5.998	0.17%	0.021µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5482321.252op/s	5499086.696op/s ± 9121.492op/s	5498262.986op/s ± 5122.755op/s	5503468.729op/s	5513100.331op/s	5528052.002op/s	5551959.571op/s	0.98%	1.589	6.170	0.17%	644.987op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	44.533µs	44.790µs ± 0.102µs	44.790µs ± 0.072µs	44.869µs	44.953µs	45.012µs	45.022µs	0.52%	-0.182	-0.302	0.23%	0.007µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	22211212.590op/s	22326279.945op/s ± 50768.061op/s	22326278.880op/s ± 36045.543op/s	22356435.919op/s	22417859.741op/s	22443746.163op/s	22455492.512op/s	0.58%	0.193	-0.295	0.23%	3589.844op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	50.334µs	50.885µs ± 0.308µs	50.766µs ± 0.170µs	51.153µs	51.374µs	51.534µs	52.538µs	3.49%	1.174	2.667	0.60%	0.022µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	19033769.714op/s	19652987.955op/s ± 118320.942op/s	19698236.960op/s ± 65784.181op/s	19739415.334op/s	19788680.646op/s	19822708.092op/s	19867221.515op/s	0.86%	-1.116	2.303	0.60%	8366.554op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[501.917µs; 501.997µs] or [-0.008%; +0.008%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1992044.294op/s; 1992361.236op/s] or [-0.008%; +0.008%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[465.652µs; 465.729µs] or [-0.008%; +0.008%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2147172.212op/s; 2147527.683op/s] or [-0.008%; +0.008%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[181.807µs; 181.891µs] or [-0.023%; +0.023%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5497822.545op/s; 5500350.847op/s] or [-0.023%; +0.023%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[44.776µs; 44.805µs] or [-0.032%; +0.032%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[22319243.980op/s; 22333315.910op/s] or [-0.032%; +0.032%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[50.842µs; 50.927µs] or [-0.084%; +0.084%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[19636589.810op/s; 19669386.099op/s] or [-0.083%; +0.083%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	306.045ns	316.848ns ± 13.916ns	309.696ns ± 2.871ns	322.837ns	350.341ns	357.083ns	359.196ns	15.98%	1.659	1.678	4.38%	0.984ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[314.919ns; 318.777ns] or [-0.609%; +0.609%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	76.470µs	76.794µs ± 0.253µs	76.773µs ± 0.055µs	76.830µs	76.934µs	77.851µs	79.611µs	3.70%	7.761	78.844	0.33%	0.018µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[76.759µs; 76.829µs] or [-0.046%; +0.046%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	318.199µs	318.613µs ± 0.270µs	318.542µs ± 0.153µs	318.772µs	319.085µs	319.433µs	319.536µs	0.31%	0.979	0.658	0.08%	0.019µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	3129532.933op/s	3138603.335op/s ± 2655.394op/s	3139299.471op/s ± 1512.800op/s	3140524.268op/s	3141847.363op/s	3142331.268op/s	3142687.058op/s	0.11%	-0.975	0.645	0.08%	187.765op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	29.329µs	29.406µs ± 0.037µs	29.406µs ± 0.024µs	29.429µs	29.471µs	29.510µs	29.540µs	0.45%	0.442	0.619	0.13%	0.003µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	33852392.395op/s	34006447.274op/s ± 42819.334op/s	34006384.618op/s ± 27496.394op/s	34034406.309op/s	34075694.955op/s	34091677.548op/s	34095404.237op/s	0.26%	-0.433	0.602	0.13%	3027.784op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	17.291µs	17.318µs ± 0.031µs	17.299µs ± 0.005µs	17.337µs	17.381µs	17.424µs	17.429µs	0.75%	1.432	1.859	0.18%	0.002µs	1	200
normalization/normalize_name/normalize_name/good	throughput	57375694.577op/s	57742694.418op/s ± 101447.432op/s	57806109.909op/s ± 17169.793op/s	57817929.117op/s	57824982.953op/s	57827366.530op/s	57832325.799op/s	0.05%	-1.423	1.817	0.18%	7173.417op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[318.576µs; 318.651µs] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[3138235.323op/s; 3138971.347op/s] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[29.401µs; 29.411µs] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[34000512.926op/s; 34012381.622op/s] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[17.314µs; 17.322µs] or [-0.024%; +0.024%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[57728634.779op/s; 57756754.056op/s] or [-0.024%; +0.024%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.137µs	1.200µs ± 0.022µs	1.207µs ± 0.010µs	1.216µs	1.219µs	1.220µs	1.220µs	1.09%	-1.533	1.498	1.81%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.197µs; 1.203µs] or [-0.252%; +0.252%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	9.046ms	9.076ms ± 0.013ms	9.075ms ± 0.008ms	9.084ms	9.098ms	9.110ms	9.115ms	0.44%	0.355	0.337	0.14%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[9.074ms; 9.078ms] or [-0.020%; +0.020%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	2.015µs	2.016µs ± 0.001µs	2.016µs ± 0.001µs	2.017µs	2.018µs	2.018µs	2.028µs	0.58%	5.965	58.788	0.06%	0.000µs	1	200
credit_card/is_card_number/	throughput	493114834.415op/s	495970689.781op/s ± 272934.761op/s	495995164.051op/s ± 123847.740op/s	496133112.519op/s	496229131.324op/s	496275471.101op/s	496307611.458op/s	0.06%	-5.923	58.198	0.05%	19299.402op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	110.984µs	112.542µs ± 0.698µs	112.361µs ± 0.405µs	112.782µs	113.984µs	114.666µs	115.331µs	2.64%	1.298	1.885	0.62%	0.049µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	8670692.271op/s	8885918.355op/s ± 54699.402op/s	8899870.065op/s ± 31926.791op/s	8926493.165op/s	8943130.168op/s	8950388.108op/s	9010332.422op/s	1.24%	-1.257	1.746	0.61%	3867.832op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	103.329µs	104.464µs ± 0.678µs	104.391µs ± 0.432µs	104.774µs	105.618µs	106.715µs	107.867µs	3.33%	1.357	3.522	0.65%	0.048µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	9270678.611op/s	9573085.845op/s ± 61577.254op/s	9579384.216op/s ± 39506.903op/s	9621278.181op/s	9652033.534op/s	9668172.230op/s	9677824.223op/s	1.03%	-1.288	3.180	0.64%	4354.169op/s	1	200
credit_card/is_card_number/37828224631	execution_time	2.015µs	2.016µs ± 0.001µs	2.016µs ± 0.001µs	2.017µs	2.018µs	2.019µs	2.026µs	0.48%	3.626	25.753	0.05%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	493645655.774op/s	495951537.360op/s ± 270004.811op/s	496003199.241op/s ± 134393.535op/s	496127033.329op/s	496204299.715op/s	496243578.694op/s	496344165.044op/s	0.07%	-3.602	25.475	0.05%	19092.223op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	99.934µs	100.960µs ± 0.514µs	100.853µs ± 0.314µs	101.201µs	101.972µs	102.229µs	103.317µs	2.44%	0.988	1.571	0.51%	0.036µs	1	200
credit_card/is_card_number/378282246310005	throughput	9678976.696op/s	9905188.220op/s ± 50135.390op/s	9915450.752op/s ± 30864.273op/s	9940855.924op/s	9968694.336op/s	9987324.513op/s	10006581.096op/s	0.92%	-0.949	1.419	0.50%	3545.107op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	100.506µs	101.019µs ± 0.529µs	100.881µs ± 0.249µs	101.218µs	101.930µs	103.118µs	104.569µs	3.66%	2.699	11.613	0.52%	0.037µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	9563083.022op/s	9899396.762op/s ± 51092.355op/s	9912687.250op/s ± 24499.694op/s	9932951.824op/s	9947458.629op/s	9948866.195op/s	9949646.747op/s	0.37%	-2.603	10.793	0.51%	3612.775op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	20.834µs	20.853µs ± 0.021µs	20.848µs ± 0.008µs	20.857µs	20.894µs	20.933µs	20.959µs	0.53%	2.337	6.431	0.10%	0.001µs	1	200
credit_card/is_card_number/x371413321323331	throughput	47712598.392op/s	47955060.272op/s ± 47594.690op/s	47967293.503op/s ± 19311.036op/s	47986376.668op/s	47993516.316op/s	47995970.931op/s	47997979.285op/s	0.06%	-2.328	6.375	0.10%	3365.453op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	2.015µs	2.016µs ± 0.001µs	2.016µs ± 0.001µs	2.017µs	2.018µs	2.018µs	2.020µs	0.17%	0.994	0.743	0.04%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	495171701.611op/s	495978181.758op/s ± 203066.909op/s	496018330.595op/s ± 129547.675op/s	496145707.423op/s	496208084.045op/s	496231910.356op/s	496256916.437op/s	0.05%	-0.992	0.735	0.04%	14358.999op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	88.016µs	89.834µs ± 0.804µs	89.664µs ± 0.509µs	90.391µs	91.250µs	91.956µs	92.272µs	2.91%	0.555	0.171	0.89%	0.057µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	10837491.334op/s	11132576.454op/s ± 99190.757op/s	11152705.286op/s ± 63366.701op/s	11197722.668op/s	11282497.312op/s	11316780.136op/s	11361522.217op/s	1.87%	-0.505	0.111	0.89%	7013.846op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	80.689µs	81.469µs ± 0.305µs	81.365µs ± 0.074µs	81.559µs	82.107µs	82.479µs	82.815µs	1.78%	1.523	3.514	0.37%	0.022µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	12075142.730op/s	12274852.483op/s ± 45624.652op/s	12290360.058op/s ± 11252.068op/s	12298056.600op/s	12330567.489op/s	12348134.383op/s	12393240.545op/s	0.84%	-1.488	3.400	0.37%	3226.150op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	2.015µs	2.016µs ± 0.001µs	2.016µs ± 0.001µs	2.017µs	2.018µs	2.019µs	2.031µs	0.75%	7.440	80.306	0.06%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	492343756.793op/s	495965180.795op/s ± 320704.360op/s	496027405.515op/s ± 123715.472op/s	496141871.769op/s	496196052.022op/s	496228370.264op/s	496277766.666op/s	0.05%	-7.387	79.494	0.06%	22677.223op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	77.146µs	77.768µs ± 0.168µs	77.749µs ± 0.056µs	77.833µs	78.056µs	78.221µs	78.737µs	1.27%	0.804	6.430	0.22%	0.012µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	12700588.067op/s	12858740.599op/s ± 27738.513op/s	12861853.672op/s ± 9244.455op/s	12868617.304op/s	12902344.422op/s	12925001.929op/s	12962462.217op/s	0.78%	-0.754	6.257	0.22%	1961.409op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	100.508µs	100.927µs ± 0.506µs	100.809µs ± 0.195µs	101.028µs	101.722µs	103.093µs	104.187µs	3.35%	3.197	13.427	0.50%	0.036µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	9598143.949op/s	9908363.836op/s ± 48943.899op/s	9919710.362op/s ± 19177.331op/s	9937857.832op/s	9947584.684op/s	9949234.974op/s	9949484.477op/s	0.30%	-3.121	12.803	0.49%	3460.856op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	20.833µs	20.876µs ± 0.078µs	20.852µs ± 0.012µs	20.882µs	20.965µs	21.355µs	21.491µs	3.06%	5.276	33.422	0.37%	0.005µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	46531482.003op/s	47902672.662op/s ± 174766.850op/s	47957237.396op/s ± 26780.431op/s	47978323.439op/s	47991646.001op/s	47998284.996op/s	48001351.268op/s	0.09%	-5.192	32.508	0.36%	12357.883op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[2.016µs; 2.016µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/	throughput	[495932863.648op/s; 496008515.914op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[112.445µs; 112.639µs] or [-0.086%; +0.086%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[8878337.544op/s; 8893499.166op/s] or [-0.085%; +0.085%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[104.370µs; 104.558µs] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[9564551.830op/s; 9581619.860op/s] or [-0.089%; +0.089%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[2.016µs; 2.016µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[495914117.290op/s; 495988957.430op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[100.889µs; 101.031µs] or [-0.070%; +0.070%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[9898239.937op/s; 9912136.503op/s] or [-0.070%; +0.070%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[100.946µs; 101.092µs] or [-0.073%; +0.073%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[9892315.853op/s; 9906477.671op/s] or [-0.072%; +0.072%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[20.850µs; 20.856µs] or [-0.014%; +0.014%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[47948464.106op/s; 47961656.438op/s] or [-0.014%; +0.014%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[2.016µs; 2.016µs] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[495950038.637op/s; 496006324.878op/s] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[89.722µs; 89.945µs] or [-0.124%; +0.124%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[11118829.569op/s; 11146323.339op/s] or [-0.123%; +0.123%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[81.426µs; 81.511µs] or [-0.052%; +0.052%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[12268529.345op/s; 12281175.621op/s] or [-0.052%; +0.052%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[2.016µs; 2.016µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[495920734.255op/s; 496009627.335op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[77.745µs; 77.792µs] or [-0.030%; +0.030%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[12854896.308op/s; 12862584.890op/s] or [-0.030%; +0.030%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[100.857µs; 100.998µs] or [-0.070%; +0.070%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[9901580.683op/s; 9915146.990op/s] or [-0.068%; +0.068%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[20.865µs; 20.887µs] or [-0.052%; +0.052%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[47878451.658op/s; 47926893.667op/s] or [-0.051%; +0.051%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	55d8fa3	1727358856	julio/code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.701µs	2.727µs ± 0.012µs	2.727µs ± 0.008µs	2.734µs	2.746µs	2.764µs	2.769µs	1.52%	0.569	0.940	0.44%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.726µs; 2.729µs] or [-0.061%; +0.061%]	None	None	None

Baseline

Omitted due to size.