[Perf] Linux/x64: 6 Regressions on 1/13/2024 4:18:20 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	5e2453988f460897ce08d5c10f34b4a8b882b7cb
Compare	d14587922635ecf583733051106cc147f6173e06
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.CtorDefaultSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Stack - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	14.33 ns	17.06 ns	1.19	0.45	False
Dictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	19.33 ns	24.73 ns	1.28	0.49	False
Queue - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	14.43 ns	17.13 ns	1.19	0.45	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorDefaultSize<String>*'

Payloads

Baseline
Compare

System.Collections.CtorDefaultSize<String>.Stack

ETL Files

Histogram

JIT Disasms

System.Collections.CtorDefaultSize<String>.Dictionary

ETL Files

Histogram

JIT Disasms

System.Collections.CtorDefaultSize<String>.Queue

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	5e2453988f460897ce08d5c10f34b4a8b882b7cb
Compare	d14587922635ecf583733051106cc147f6173e06
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Object>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SingleParallel - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	757.36 ns	954.57 ns	1.26	0.85	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Object>*'

Payloads

Baseline
Compare

System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	5e2453988f460897ce08d5c10f34b4a8b882b7cb
Compare	d14587922635ecf583733051106cc147f6173e06
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Char

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Char_ToLower - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	15.92 ns	17.62 ns	1.11	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Char*'

Payloads

Baseline
Compare

System.Tests.Perf_Char.Char_ToLower(c: '你', cultureName: zh-Hans)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	5e2453988f460897ce08d5c10f34b4a8b882b7cb
Compare	d14587922635ecf583733051106cc147f6173e06
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Concurrent.AddRemoveFromSameThreads<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ConcurrentStack - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	114.91 ms	125.28 ms	1.09	0.09	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.AddRemoveFromSameThreads<String>*'

Payloads

Baseline
Compare

System.Collections.Concurrent.AddRemoveFromSameThreads<String>.ConcurrentStack(Size: 2000000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[cincuranet]

Seems to mostly on Linux + Intel and the diff does not show much hope.

Ideas @EgorBo, @AndyAyersMS?