[Perf] Changes at 2/20/2022 5:50:14 AM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	79d478ae01d9a3e7548bf41a76d047158ed8a62b
Compare	4017327955f1d8ddc43980eb1848c52fbb131dfc
Diff	Diff

Improvements in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SingleWithPredicate_LastElementMatches - Duration of single invocation	864.49 ns	632.93 ns	0.73	0.43	False
WhereLast_LastElementMatches - Duration of single invocation	762.64 ns	642.33 ns	0.84	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Payloads

Baseline
Compare

Histogram

System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_LastElementMatches(input: IEnumerable)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 632.9266380436812 < 736.1961044679326.
IsChangePoint: Marked as a change because one of 2/7/2022 9:45:37 AM, 2/19/2022 11:51:48 PM, 2/22/2022 12:12:47 AM falls between 2/13/2022 12:11:49 PM and 2/22/2022 12:12:47 AM.
IsImprovementStdDev: Marked as improvement because 4.692236207999371 (T) = (0 -621.4112767823765) / Math.Sqrt((5033.941125972788 / (299)) + (665.7907778093692 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.07398263044407441 = (671.057905836449 - 621.4112767823765) / 671.057905836449 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: IEnumerable)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 642.3330105488707 < 729.7151083468436.
IsChangePoint: Marked as a change because one of 2/11/2022 5:21:58 PM, 2/19/2022 1:52:17 PM, 2/22/2022 12:12:47 AM falls between 2/13/2022 12:11:49 PM and 2/22/2022 12:12:47 AM.
IsImprovementStdDev: Marked as improvement because 11.00069105611494 (T) = (0 -645.7309000101794) / Math.Sqrt((2476.906317789686 / (299)) + (48.69540884407704 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.06066402779534729 = (687.433377532245 - 645.7309000101794) / 687.433377532245 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	79d478ae01d9a3e7548bf41a76d047158ed8a62b
Compare	4017327955f1d8ddc43980eb1848c52fbb131dfc
Diff	Diff

Improvements in System.Globalization.Tests.StringEquality

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Compare_DifferentFirstChar - Duration of single invocation	34.79 ns	32.22 ns	0.93	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringEquality*'

Payloads

Baseline
Compare

Histogram

System.Globalization.Tests.StringEquality.Compare_DifferentFirstChar(Count: 1024, Options: (, None))

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 32.22298925616662 < 33.0502794020717.
IsChangePoint: Marked as a change because one of 2/2/2022 1:56:18 PM, 2/7/2022 4:59:24 AM, 2/19/2022 11:51:48 PM, 2/22/2022 12:12:47 AM falls between 2/13/2022 12:11:49 PM and 2/22/2022 12:12:47 AM.
IsImprovementStdDev: Marked as improvement because 24.70511721080141 (T) = (0 -31.83231509579394) / Math.Sqrt((2.1211505244234306 / (299)) + (0.04757352414677435 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.08380385706364246 = (34.743995967690005 - 31.83231509579394) / 34.743995967690005 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	79d478ae01d9a3e7548bf41a76d047158ed8a62b
Compare	4017327955f1d8ddc43980eb1848c52fbb131dfc
Diff	Diff

Improvements in System.Collections.ContainsFalse<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Queue - Duration of single invocation	898.80 μs	825.99 μs	0.92	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsFalse<String>.Queue(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 825.9882844129553 < 853.4796190889548.
IsChangePoint: Marked as a change because one of 12/17/2021 7:05:08 PM, 12/26/2021 4:30:45 AM, 1/4/2022 5:49:50 PM, 1/7/2022 4:24:34 PM, 1/27/2022 6:56:17 PM, 2/12/2022 12:09:13 AM, 2/19/2022 11:51:48 PM, 2/22/2022 12:12:47 AM falls between 2/13/2022 12:11:49 PM and 2/22/2022 12:12:47 AM.
IsImprovementStdDev: Marked as improvement because 21.287523825101903 (T) = (0 -825998.6546896087) / Math.Sqrt((1244366591.063488 / (299)) + (303925.31476809946 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.05019632253920516 = (869651.9862902969 - 825998.6546896087) / 869651.9862902969 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	79d478ae01d9a3e7548bf41a76d047158ed8a62b
Compare	4017327955f1d8ddc43980eb1848c52fbb131dfc
Diff	Diff

Improvements in System.Tests.Perf_Random

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
NextBytes - Duration of single invocation	7.99 μs	7.51 μs	0.94	0.09	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Random*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Random.NextBytes

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.51407227032227 < 7.760395527254614.
IsChangePoint: Marked as a change because one of 1/23/2022 1:32:42 AM, 1/25/2022 9:10:05 PM, 1/28/2022 6:30:08 PM, 2/1/2022 8:13:55 AM, 2/19/2022 11:51:48 PM, 2/22/2022 12:12:47 AM falls between 2/13/2022 12:11:49 PM and 2/22/2022 12:12:47 AM.
IsImprovementStdDev: Marked as improvement because 30.38654747299923 (T) = (0 -7515.81677338351) / Math.Sqrt((72853.98789930838 / (299)) + (11.029879959739887 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.05954354236692796 = (7991.669058553986 - 7515.81677338351) / 7991.669058553986 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	79d478ae01d9a3e7548bf41a76d047158ed8a62b
Compare	4017327955f1d8ddc43980eb1848c52fbb131dfc
Diff	Diff

Improvements in System.Collections.Tests.Perf_Dictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ContainsValue - Duration of single invocation	3.79 ms	3.08 ms	0.81	0.16	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_Dictionary*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_Dictionary.ContainsValue(Items: 3000)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.08111825 < 3.597634322172619.
IsChangePoint: Marked as a change because one of 12/27/2021 12:37:17 AM, 2/1/2022 8:13:55 AM, 2/12/2022 4:06:00 AM, 2/19/2022 11:51:48 PM, 2/22/2022 12:12:47 AM falls between 2/13/2022 12:11:49 PM and 2/22/2022 12:12:47 AM.
IsImprovementStdDev: Marked as improvement because 18.230146975725305 (T) = (0 -3112511.327121747) / Math.Sqrt((97524654462.26817 / (299)) + (2694565196.332042 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.13508852410210637 = (3598647.2764632297 - 3112511.327121747) / 3598647.2764632297 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository