[PROF-10603] Package libdatadog v13.1.0 for Ruby

[ivoanjo]

What does this PR do?

This PR includes the changes documented in the "Releasing a new version to rubygems.org" part of the README:
https://github.com/datadog/libdatadog/tree/main/ruby#releasing-a-new-version-to-rubygemsorg

Motivation:

Enable Ruby to use libdatadog v13.1.0.

Additional Notes:

We ended up not releasing 13.0 for Ruby. I don't see any reason to backfill so I've skipped ahead.

How to test the change?

I've tested this release locally using the changes in DataDog/dd-trace-rb#3997 .

As a reminder, new libdatadog releases don't get automatically picked up by dd-trace-rb, so the PR that bumps the Ruby profiler will also test this release against all supported Ruby versions.

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2024-10-14 10:05:52

Comparing candidate commit 80dee15 in PR branch ivoanjo/libdatadog13_1-ruby with baseline commit 1bae54b in branch main.

Found 1 performance improvements and 1 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

• 🟩 execution_time [-40.551ns; -31.732ns] or [-3.312%; -2.592%]

scenario:tags/replace_trace_tags

• 🟥 execution_time [+72.055ns; +78.808ns] or [+2.695%; +2.947%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.131µs	1.188µs ± 0.023µs	1.190µs ± 0.017µs	1.208µs	1.211µs	1.212µs	1.213µs	1.87%	-1.057	0.339	1.90%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.185µs; 1.191µs] or [-0.263%; +0.263%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	9.229ms	9.271ms ± 0.016ms	9.271ms ± 0.009ms	9.280ms	9.291ms	9.305ms	9.359ms	0.95%	0.933	5.244	0.17%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[9.269ms; 9.273ms] or [-0.024%; +0.024%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.715µs	2.749µs ± 0.016µs	2.746µs ± 0.008µs	2.755µs	2.786µs	2.792µs	2.795µs	1.78%	0.820	0.717	0.59%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.747µs; 2.752µs] or [-0.082%; +0.082%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	1.613µs	1.614µs ± 0.001µs	1.614µs ± 0.000µs	1.615µs	1.615µs	1.616µs	1.618µs	0.21%	1.059	1.801	0.04%	0.000µs	1	200
credit_card/is_card_number/	throughput	618226638.592op/s	619465373.058op/s ± 263697.204op/s	619507155.365op/s ± 174437.133op/s	619678622.363op/s	619762618.212op/s	619849528.811op/s	620022617.064op/s	0.08%	-1.056	1.786	0.04%	18646.208op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	110.383µs	111.872µs ± 0.723µs	111.901µs ± 0.525µs	112.322µs	113.080µs	113.645µs	114.557µs	2.37%	0.453	0.347	0.64%	0.051µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	8729259.401op/s	8939145.976op/s ± 57619.570op/s	8936457.765op/s ± 41964.222op/s	8984070.794op/s	9024830.378op/s	9035178.039op/s	9059352.347op/s	1.38%	-0.412	0.246	0.64%	4074.319op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	106.533µs	108.024µs ± 0.707µs	107.788µs ± 0.364µs	108.460µs	109.443µs	109.771µs	110.054µs	2.10%	0.787	0.006	0.65%	0.050µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	9086459.124op/s	9257631.279op/s ± 60324.492op/s	9277453.937op/s ± 31299.378op/s	9299880.511op/s	9332780.580op/s	9367732.944op/s	9386757.103op/s	1.18%	-0.760	-0.033	0.65%	4265.586op/s	1	200
credit_card/is_card_number/37828224631	execution_time	1.613µs	1.614µs ± 0.001µs	1.614µs ± 0.000µs	1.615µs	1.615µs	1.616µs	1.622µs	0.47%	5.629	56.176	0.05%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	616521338.804op/s	619457728.454op/s ± 283466.336op/s	619439233.031op/s ± 142086.310op/s	619661654.235op/s	619743249.225op/s	619776843.818op/s	619880854.797op/s	0.07%	-5.593	55.681	0.05%	20044.097op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	102.009µs	103.462µs ± 0.596µs	103.371µs ± 0.310µs	103.726µs	104.765µs	105.133µs	105.309µs	1.87%	0.803	0.937	0.57%	0.042µs	1	200
credit_card/is_card_number/378282246310005	throughput	9495883.143op/s	9665734.682op/s ± 55429.802op/s	9673893.065op/s ± 29125.564op/s	9698373.103op/s	9746056.943op/s	9774753.503op/s	9803010.029op/s	1.33%	-0.764	0.879	0.57%	3919.479op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	106.335µs	108.258µs ± 0.600µs	108.472µs ± 0.333µs	108.705µs	108.932µs	109.062µs	109.470µs	0.92%	-0.883	0.204	0.55%	0.042µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	9134882.433op/s	9237492.667op/s ± 51482.149op/s	9218927.827op/s ± 28176.888op/s	9272139.539op/s	9334000.182op/s	9382203.910op/s	9404268.891op/s	2.01%	0.906	0.266	0.56%	3640.338op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	23.717µs	25.023µs ± 0.466µs	25.023µs ± 0.239µs	25.289µs	25.735µs	25.893µs	26.292µs	5.07%	-0.489	0.679	1.86%	0.033µs	1	200
credit_card/is_card_number/x371413321323331	throughput	38034523.776op/s	39977587.317op/s ± 752670.941op/s	39962969.016op/s ± 386044.923op/s	40308286.015op/s	41510454.867op/s	42063954.820op/s	42163768.915op/s	5.51%	0.625	0.817	1.88%	53221.873op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	1.613µs	1.614µs ± 0.000µs	1.614µs ± 0.000µs	1.615µs	1.615µs	1.615µs	1.616µs	0.12%	0.192	0.333	0.03%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	618684450.158op/s	619476344.455op/s ± 180135.439op/s	619414768.538op/s ± 139658.293op/s	619655998.398op/s	619725291.836op/s	619797131.374op/s	619872667.448op/s	0.07%	-0.190	0.325	0.03%	12737.499op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	89.778µs	90.536µs ± 0.226µs	90.521µs ± 0.076µs	90.654µs	90.868µs	91.128µs	91.791µs	1.40%	0.406	5.425	0.25%	0.016µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	10894302.496op/s	11045372.240op/s ± 27584.075op/s	11047182.318op/s ± 9305.145op/s	11054649.131op/s	11098788.881op/s	11115165.622op/s	11138592.997op/s	0.83%	-0.352	5.238	0.25%	1950.489op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	83.711µs	84.869µs ± 0.722µs	84.623µs ± 0.290µs	84.990µs	86.430µs	87.150µs	87.546µs	3.45%	1.521	2.114	0.85%	0.051µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	11422585.220op/s	11783655.473op/s ± 98941.237op/s	11817155.570op/s ± 40531.561op/s	11842878.054op/s	11892103.551op/s	11915600.806op/s	11945883.125op/s	1.09%	-1.476	1.958	0.84%	6996.202op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	1.614µs	1.614µs ± 0.001µs	1.614µs ± 0.000µs	1.615µs	1.615µs	1.616µs	1.619µs	0.26%	2.731	15.376	0.04%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	617784967.153op/s	619431713.585op/s ± 240827.793op/s	619402877.630op/s ± 128355.478op/s	619621585.246op/s	619697438.705op/s	619746388.858op/s	619769971.800op/s	0.06%	-2.719	15.281	0.04%	17029.097op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	79.416µs	80.144µs ± 0.428µs	80.086µs ± 0.168µs	80.254µs	80.668µs	81.802µs	82.817µs	3.41%	2.680	11.158	0.53%	0.030µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	12074792.229op/s	12477830.207op/s ± 65752.627op/s	12486642.414op/s ± 26151.516op/s	12511791.767op/s	12555937.399op/s	12581185.348op/s	12591946.393op/s	0.84%	-2.586	10.522	0.53%	4649.413op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	106.760µs	108.337µs ± 0.583µs	108.547µs ± 0.358µs	108.794µs	109.040µs	109.116µs	109.362µs	0.75%	-0.747	-0.395	0.54%	0.041µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	9143917.894op/s	9230693.099op/s ± 49854.747op/s	9212587.293op/s ± 30310.438op/s	9274286.143op/s	9325698.837op/s	9357320.906op/s	9366788.009op/s	1.67%	0.764	-0.360	0.54%	3525.263op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	23.567µs	24.992µs ± 0.548µs	24.991µs ± 0.376µs	25.378µs	25.912µs	26.098µs	26.230µs	4.96%	-0.062	-0.548	2.19%	0.039µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	38123647.252op/s	40032184.585op/s ± 879815.715op/s	40014919.611op/s ± 602229.720op/s	40588734.639op/s	41498776.243op/s	41827851.482op/s	42432052.898op/s	6.04%	0.157	-0.519	2.19%	62212.366op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[1.614µs; 1.614µs] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number/	throughput	[619428827.162op/s; 619501918.955op/s] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[111.772µs; 111.972µs] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[8931160.458op/s; 8947131.495op/s] or [-0.089%; +0.089%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[107.926µs; 108.122µs] or [-0.091%; +0.091%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[9249270.884op/s; 9265991.673op/s] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[1.614µs; 1.614µs] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[619418442.746op/s; 619497014.162op/s] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[103.379µs; 103.544µs] or [-0.080%; +0.080%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[9658052.645op/s; 9673416.720op/s] or [-0.079%; +0.079%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[108.175µs; 108.341µs] or [-0.077%; +0.077%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[9230357.736op/s; 9244627.598op/s] or [-0.077%; +0.077%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[24.958µs; 25.087µs] or [-0.258%; +0.258%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[39873274.364op/s; 40081900.271op/s] or [-0.261%; +0.261%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[1.614µs; 1.614µs] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[619451379.415op/s; 619501309.494op/s] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[90.505µs; 90.568µs] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[11041549.352op/s; 11049195.128op/s] or [-0.035%; +0.035%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[84.769µs; 84.969µs] or [-0.118%; +0.118%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[11769943.169op/s; 11797367.777op/s] or [-0.116%; +0.116%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[1.614µs; 1.614µs] or [-0.005%; +0.005%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[619398337.169op/s; 619465090.001op/s] or [-0.005%; +0.005%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[80.085µs; 80.204µs] or [-0.074%; +0.074%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[12468717.525op/s; 12486942.888op/s] or [-0.073%; +0.073%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[108.257µs; 108.418µs] or [-0.075%; +0.075%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[9223783.710op/s; 9237602.487op/s] or [-0.075%; +0.075%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[24.916µs; 25.068µs] or [-0.304%; +0.304%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[39910250.589op/s; 40154118.581op/s] or [-0.305%; +0.305%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	187.267µs	191.255µs ± 1.029µs	191.310µs ± 0.653µs	191.900µs	192.798µs	193.323µs	194.823µs	1.84%	-0.410	1.357	0.54%	0.073µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	5132872.972op/s	5228768.450op/s ± 28193.776op/s	5227124.945op/s ± 17834.336op/s	5247271.621op/s	5272519.598op/s	5308908.436op/s	5339966.941op/s	2.16%	0.462	1.418	0.54%	1993.601op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	18.186µs	18.223µs ± 0.028µs	18.220µs ± 0.022µs	18.242µs	18.267µs	18.294µs	18.405µs	1.02%	1.616	7.047	0.16%	0.002µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	54332461.251op/s	54877163.478op/s ± 85565.446op/s	54884231.505op/s ± 66414.200op/s	54950281.056op/s	54967283.985op/s	54976394.019op/s	54987993.511op/s	0.19%	-1.586	6.806	0.16%	6050.391op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	11.267µs	11.314µs ± 0.023µs	11.310µs ± 0.016µs	11.330µs	11.354µs	11.369µs	11.373µs	0.56%	0.359	-0.523	0.20%	0.002µs	1	200
normalization/normalize_name/normalize_name/good	throughput	87925090.549op/s	88385965.196op/s ± 180018.496op/s	88419117.584op/s ± 127910.668op/s	88513153.992op/s	88662907.681op/s	88717154.011op/s	88755381.225op/s	0.38%	-0.351	-0.529	0.20%	12729.230op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[191.113µs; 191.398µs] or [-0.075%; +0.075%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[5224861.063op/s; 5232675.836op/s] or [-0.075%; +0.075%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[18.219µs; 18.227µs] or [-0.022%; +0.022%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[54865304.930op/s; 54889022.026op/s] or [-0.022%; +0.022%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[11.311µs; 11.317µs] or [-0.028%; +0.028%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[88361016.364op/s; 88410914.029op/s] or [-0.028%; +0.028%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	66.904µs	67.055µs ± 0.157µs	67.037µs ± 0.058µs	67.087µs	67.209µs	67.355µs	68.865µs	2.73%	8.022	87.471	0.23%	0.011µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[67.034µs; 67.077µs] or [-0.032%; +0.032%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	140.560µs	141.796µs ± 0.507µs	141.749µs ± 0.177µs	141.937µs	142.615µs	143.062µs	146.863µs	3.61%	5.279	48.972	0.36%	0.036µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[141.725µs; 141.866µs] or [-0.050%; +0.050%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	36.769µs	37.244µs ± 0.825µs	36.874µs ± 0.035µs	36.918µs	38.991µs	39.047µs	40.523µs	9.90%	1.800	1.584	2.21%	0.058µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[37.130µs; 37.358µs] or [-0.307%; +0.307%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	622.993µs	624.598µs ± 0.486µs	624.660µs ± 0.312µs	624.945µs	625.284µs	625.469µs	625.854µs	0.19%	-0.545	0.314	0.08%	0.034µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1597817.108op/s	1601030.173op/s ± 1245.215op/s	1600871.423op/s ± 798.766op/s	1601732.846op/s	1603424.705op/s	1604202.913op/s	1605155.760op/s	0.27%	0.550	0.320	0.08%	88.050op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	463.509µs	464.761µs ± 0.541µs	464.738µs ± 0.399µs	465.147µs	465.646µs	465.913µs	466.579µs	0.40%	0.290	-0.223	0.12%	0.038µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2143260.737op/s	2151648.078op/s ± 2506.083op/s	2151748.801op/s ± 1847.335op/s	2153556.819op/s	2155359.639op/s	2156610.009op/s	2157455.166op/s	0.27%	-0.284	-0.230	0.12%	177.207op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	178.285µs	181.598µs ± 1.673µs	181.819µs ± 0.954µs	182.759µs	183.912µs	184.546µs	185.333µs	1.93%	-0.504	-0.408	0.92%	0.118µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5395698.838op/s	5507150.119op/s ± 50993.005op/s	5499960.863op/s ± 28719.506op/s	5530416.557op/s	5604868.181op/s	5606904.830op/s	5608989.925op/s	1.98%	0.540	-0.390	0.92%	3605.750op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	46.786µs	46.966µs ± 0.103µs	46.957µs ± 0.058µs	47.020µs	47.158µs	47.252µs	47.299µs	0.73%	0.731	0.648	0.22%	0.007µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	21142289.407op/s	21291925.143op/s ± 46417.296op/s	21296090.650op/s ± 26251.980op/s	21321157.995op/s	21360173.588op/s	21370903.508op/s	21373788.913op/s	0.36%	-0.717	0.619	0.22%	3282.198op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	49.061µs	49.513µs ± 0.205µs	49.488µs ± 0.129µs	49.630µs	49.898µs	50.102µs	50.234µs	1.51%	0.734	0.903	0.41%	0.015µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	19906955.814op/s	20197132.765op/s ± 83567.674op/s	20207118.263op/s ± 52818.061op/s	20249651.124op/s	20319251.839op/s	20364989.385op/s	20382933.701op/s	0.87%	-0.705	0.848	0.41%	5909.127op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[624.531µs; 624.666µs] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1600857.598op/s; 1601202.747op/s] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[464.686µs; 464.836µs] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2151300.759op/s; 2151995.397op/s] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[181.366µs; 181.829µs] or [-0.128%; +0.128%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5500082.979op/s; 5514217.259op/s] or [-0.128%; +0.128%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[46.952µs; 46.981µs] or [-0.030%; +0.030%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[21285492.152op/s; 21298358.134op/s] or [-0.030%; +0.030%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[49.484µs; 49.541µs] or [-0.058%; +0.058%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[20185551.089op/s; 20208714.441op/s] or [-0.057%; +0.057%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.353µs	3.186µs ± 1.381µs	3.043µs ± 0.024µs	3.063µs	3.100µs	13.710µs	14.740µs	384.37%	7.581	57.691	43.23%	0.098µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.995µs; 3.378µs] or [-6.006%; +6.006%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.688µs	24.483µs ± 12.139µs	19.638µs ± 1.499µs	20.153µs	48.147µs	52.135µs	104.880µs	434.07%	3.066	13.670	49.46%	0.858µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[22.801µs; 26.166µs] or [-6.871%; +6.871%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80dee15	1728899714	ivoanjo/libdatadog13_1-ruby

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	265.022ns	274.072ns ± 14.299ns	267.771ns ± 1.822ns	272.133ns	302.178ns	319.759ns	323.237ns	20.71%	2.010	2.792	5.20%	1.011ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[272.091ns; 276.054ns] or [-0.723%; +0.723%]	None	None	None

Baseline

Omitted due to size.

[taegyunkim]

@taegyunkim approved this PR from Slack with Graphite