[Perf] Windows/x64: 13 Regressions on 1/7/2025 5:24:42 PM +00:00

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in LinqBenchmarks

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Where00LinqMethodX - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	238.02 ms	346.42 ms	1.46	0.08	False
Where00LinqQueryX - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	242.04 ms	347.13 ms	1.43	0.06	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'LinqBenchmarks*'

LinqBenchmarks.Where00LinqMethodX

ETL Files

Histogram

JIT Disasms

LinqBenchmarks.Where00LinqQueryX

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_BinaryIntegerTensorPrimitives<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
OnesComplement - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	9.54 ns	10.84 ns	1.14	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_BinaryIntegerTensorPrimitives<Byte>*'

System.Numerics.Tensors.Tests.Perf_BinaryIntegerTensorPrimitives<Byte>.OnesComplement(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IsMatch - Duration of single invocation ADX - Test Multi Config Graph	84.07 ns	98.03 ns	1.17	0.29	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple*'

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_BoostDocs_Simple.IsMatch(Id: 10, Options: NonBacktracking)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Count_Array - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	0.03 ns	1.03 ns	32.12	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark*'

Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.Count_Array

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToDictionary - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	817.52 ns	913.17 ns	1.12	0.01	True
FirstWithPredicate_LastElementMatches - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	51.90 ns	105.60 ns	2.03	0.11	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

System.Linq.Tests.Perf_Enumerable.ToDictionary(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Benchstone.MDBenchF.MDSqMtx

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	852.51 ms	909.15 ms	1.07	0.23	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchF.MDSqMtx*'

Benchstone.MDBenchF.MDSqMtx.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Benchstone.MDBenchI.MDNDhrystone

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	347.26 ms	384.99 ms	1.11	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchI.MDNDhrystone*'

Benchstone.MDBenchI.MDNDhrystone.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Benchstone.BenchI.XposMatrix

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	21.35 μs	23.26 μs	1.09	0.47	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.XposMatrix*'

Benchstone.BenchI.XposMatrix.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Count - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	94.73 μs	100.80 μs	1.06	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sher[a-z]+|Hol[a-z]+", Options: Compiled)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in Benchstone.BenchI.NDhrystone

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	332.57 ms	357.98 ms	1.08	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.NDhrystone*'

Benchstone.BenchI.NDhrystone.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.22621
Queue	TigerWindows
Baseline	717bc30a0ed2a32f05f90e288eaaf7c02712c916
Compare	cce6bdfc9a897faa5cd64900cfcb73d8d7a62d5f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateForEach<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SortedSet - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	4.36 μs	4.79 μs	1.10	0.12	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<String>*'

System.Collections.IterateForEach<String>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[LoopedBard3]

Likely due to #111047, @amanasifkhalid.

Related regressions:

• [Perf] Linux/x64: 12 Regressions on 1/7/2025 5:24:42 PM +00:00 perf-autofiling-issues#48021
• [Perf] Windows/x64: 5 Regressions on 1/7/2025 5:24:42 PM +00:00 perf-autofiling-issues#48052
• [Perf] Linux/x64: 2 Regressions on 1/7/2025 5:24:42 PM +00:00 perf-autofiling-issues#48064
• [Perf] Windows/x64: 1 Regression on 1/7/2025 9:07:10 AM +00:00 perf-autofiling-issues#48051
• [Perf] Windows/arm64: 1 Regression on 1/8/2025 10:31:51 PM +00:00 perf-autofiling-issues#49139

[amanasifkhalid]

The changes in #111047 churned code layout, so I'm excluding Tiger machines to filter out JCC errata:

Notes	Recent Score	Orig Score	SurfaceWindows/	ViperUbuntu/	ViperWindows/	Benchmark
	1.06	1.07			1.06 1.07	Benchstone.MDBenchI.MDNDhrystone.Test
	1.04	1.12		1.04 1.12		System.Collections.Sort(IntStruct).List(Size: 512)
	1.03	1.05			1.03 1.05	System.Reflection.Invoke.Property_Set_int
	1.02	1.22			1.02 1.22	System.Reflection.Invoke.Field_SetStatic_int
	1.02	1.05		1.02 1.05		System.IO.Tests.Perf_Path.GetDirectoryName
	1.02	1.10			1.02 1.10	System.Collections.IterateForEach(String).SortedSet(Size: 512)
	0.87	1.15			0.87 1.15	System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: LotsOfStrings)
	0.86	1.06	0.86 1.06			System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: False)
	0.40	1.06			0.40 1.06	System.Collections.TryGetValueTrue(BigStruct, BigStruct).ConcurrentDictionary(Size: 512)

Graph-based loop inversion has helped bring these down. Benchstone.MDBenchI.MDNDhrystone.Test and System.Collections.Sort<IntStruct>.List(Size: 512) both seemed to regress in April, so they should be tracked by newer regression reports. Everything else seems acceptably close to -- or better than -- their baselines.