Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Perf] Linux/x64: 138 Regressions on 10/26/2023 4:53:28 PM #24014

Open
performanceautofiler bot opened this issue Nov 2, 2023 · 9 comments
Open

[Perf] Linux/x64: 138 Regressions on 10/26/2023 4:53:28 PM #24014

performanceautofiler bot opened this issue Nov 2, 2023 · 9 comments

Comments

@performanceautofiler
Copy link

performanceautofiler bot commented Nov 2, 2023

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
39.91 ns 194.38 ns 4.87 0.32 True
31.73 ns 165.77 ns 5.22 0.43 False
36.56 ns 193.50 ns 5.29 0.39 True

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector4*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector4.TransformByQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.TransformVector2ByQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.TransformVector3ByQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.BlockCopyPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
61.20 ns 83.43 ns 1.36 0.27 False
50.26 ns 69.90 ns 1.39 0.33 False
179.36 ns 206.39 ns 1.15 0.25 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.BlockCopyPerf*'

Payloads

Baseline
Compare

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 100)

ETL Files

Histogram

JIT Disasms

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 10)

ETL Files

Histogram

JIT Disasms

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 1000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Nov 2, 2023

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.77 ns 142.83 ns 11.18 0.66 True
13.20 ns 78.69 ns 5.96 0.62 True
58.24 ns 249.52 ns 4.28 0.37 True
13.61 ns 132.46 ns 9.73 0.60 True
22.97 ns 38.06 ns 1.66 0.50 True
19.85 ns 114.10 ns 5.75 0.49 True
21.29 ns 122.70 ns 5.76 0.46 True
22.34 ns 173.50 ns 7.76 0.46 True
73.30 ns 150.44 ns 2.05 0.30 True
78.98 ns 138.02 ns 1.75 0.43 True
20.83 ns 123.99 ns 5.95 0.50 True
23.63 ns 344.82 ns 14.59 0.45 True
30.34 ns 155.24 ns 5.12 0.49 True
27.40 ns 138.03 ns 5.04 0.43 True
32.12 ns 160.69 ns 5.00 0.40 True
28.16 ns 184.42 ns 6.55 0.44 True
30.94 ns 150.35 ns 4.86 0.40 True
23.43 ns 173.80 ns 7.42 0.49 True
14.32 ns 58.46 ns 4.08 0.38 True
20.67 ns 121.27 ns 5.87 0.51 True
24.30 ns 178.75 ns 7.36 0.41 True
89.30 ns 149.56 ns 1.67 0.25 True
20.90 ns 123.66 ns 5.92 0.39 True
91.63 ns 153.31 ns 1.67 0.26 True
14.44 ns 37.69 ns 2.61 0.45 True
59.94 ns 137.79 ns 2.30 0.37 True
22.16 ns 174.36 ns 7.87 0.49 True
15.40 ns 80.45 ns 5.23 0.59 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Quaternion.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.LengthSquaredBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.CreateFromVector3WithScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.IsIdentityBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.InverseBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.IdentityBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.LerpBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.CreateFromScalarXYZWBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.LengthBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Nov 2, 2023

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
130.43 ns 152.31 ns 1.17 0.09 True
95.27 ns 102.76 ns 1.08 0.16 False
30.13 ns 51.18 ns 1.70 0.40 True
34.42 ns 52.33 ns 1.52 0.39 True
25.60 ns 48.40 ns 1.89 0.56 True
32.09 ns 51.28 ns 1.60 0.39 True
33.08 ns 48.61 ns 1.47 0.42 True
90.25 ns 103.16 ns 1.14 0.18 False
30.55 ns 54.95 ns 1.80 0.51 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Byte>.SequenceEqual(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.EndsWith(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.EndsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.EndsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceEqual(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.StartsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.StartsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.StartsWith(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceEqual(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_String

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
485.73 ns 595.10 ns 1.23 0.29 False
594.77 ns 843.40 ns 1.42 0.20 False
91.46 ns 104.22 ns 1.14 0.32 False
147.45 ns 184.75 ns 1.25 0.32 False
319.04 ns 346.77 ns 1.09 0.23 False
108.14 ns 190.44 ns 1.76 0.40 False
99.07 ns 140.16 ns 1.41 0.31 False
473.88 ns 570.76 ns 1.20 0.30 False
1.98 μs 2.51 μs 1.26 0.21 False
103.54 ns 147.23 ns 1.42 0.36 False
224.86 ns 249.60 ns 1.11 0.19 False
159.09 ns 197.24 ns 1.24 0.39 False
116.79 ns 159.04 ns 1.36 0.43 False
217.63 ns 282.90 ns 1.30 0.40 False
129.50 ns 151.68 ns 1.17 0.42 False
552.79 ns 801.42 ns 1.45 0.22 False
100.36 ns 264.75 ns 2.64 0.37 False
238.49 ns 302.33 ns 1.27 0.34 False
115.39 ns 193.73 ns 1.68 0.35 False
410.93 ns 457.17 ns 1.11 0.24 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'

Payloads

Baseline
Compare

System.Tests.Perf_String.Replace_String(text: "This is a very nice sentence", oldValue: "nice", newValue: "bad")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Join_List

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Substring_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 10, i2: 1)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Replace_Char(text: "Hello", oldChar: 'l', newChar: '!')

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Concat_str_str_str(size: 100)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Insert(s1: "Test", i: 2, s2: " Test")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 0, i2: 8)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Replace_String(text: "This is a very nice sentence. This is another very nice sentence.", oldValue: "a", newValue: "")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Interpolation_MultipleArgs(c: '1', s: "Foo")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 7, i2: 4)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Concat_str_str(size: 100)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Replace_Char(text: "This is a very nice sentence", oldChar: 'i', newChar: 'I')

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.TrimEnd(s: "Test ")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Replace_Char(text: "yfesgj0sg1ijslnjsb3uofdz3tbzf6ysgblu3at20nfab2wei1kxfbvsbpzwhanjczcqa2psra3aacxb67qnwbnfp2tok6v0a58l", oldChar: 'b', newChar: '+')

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.TrimStart(s: " Test")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Join_Array

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 10, i2: 1)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Replace_String(text: "This is a very nice sentence. This is another very nice sentence.", oldValue: "a", newValue: "b")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Insert(s1: "dzsdzsDDZSDZSDZSddsz", i: 7, s2: "Test")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Concat_str_str_str_str(size: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Nov 2, 2023

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
24.44 ns 47.87 ns 1.96 0.49 True
30.94 ns 49.51 ns 1.60 0.44 True
42.61 ns 58.75 ns 1.38 0.34 True
33.61 ns 52.68 ns 1.57 0.42 True
142.60 ns 158.14 ns 1.11 0.05 False
34.74 ns 53.39 ns 1.54 0.43 True
41.13 ns 63.76 ns 1.55 0.32 True

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Char&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Char>.SequenceEqual(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.StartsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.EndsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.EndsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.StartsWith(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.StartsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceEqual(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
115.23 ns 156.86 ns 1.36 0.32 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 123)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
14.62 μs 17.53 μs 1.20 0.12 False
14.36 μs 29.33 μs 2.04 0.19 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Payloads

Baseline
Compare

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options: Compiled)

ETL Files

Histogram

JIT Disasms

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options: None)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsTrue<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.29 ms 7.32 ms 1.38 0.31 False
5.97 ms 7.29 ms 1.22 0.30 False
6.18 ms 7.34 ms 1.19 0.29 False
5.62 ms 7.31 ms 1.30 0.31 False
5.27 ms 7.34 ms 1.39 0.29 False
5.29 ms 7.32 ms 1.39 0.35 False
2.36 ms 16.04 ms 6.79 0.25 False
5.59 ms 7.49 ms 1.34 0.33 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsTrue<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ImmutableArray(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Span(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
44.19 ns 68.81 ns 1.56 0.21 True
55.26 ns 74.55 ns 1.35 0.28 True
45.98 ns 66.23 ns 1.44 0.32 False
31.91 ns 55.17 ns 1.73 0.41 True
27.40 ns 49.13 ns 1.79 0.53 True
31.38 ns 51.69 ns 1.65 0.38 True

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Int32>.StartsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.SequenceEqual(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.EndsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.EndsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.SequenceEqual(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.StartsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
58.88 μs 67.67 μs 1.15 0.19 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.CreateAddAndClear<Int32>.ConcurrentStack(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Nov 2, 2023

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorConvert

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.28 μs 53.27 μs 4.34 0.01 True
19.33 μs 66.91 μs 3.46 0.01 True
64.82 μs 96.08 μs 1.48 0.27 False
14.75 μs 56.30 μs 3.82 0.01 True

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorConvert.Convert_double_long

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorConvert.Convert_float_int

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorConvert.Convert_double_ulong

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorConvert.Convert_int_float

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_LengthBucketsFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
883.87 ns 2.43 μs 2.74 0.22 False
1.27 μs 2.67 μs 2.10 0.20 False
12.60 μs 26.53 μs 2.11 0.21 False
125.15 μs 264.47 μs 2.11 0.18 True
1.31 ms 2.72 ms 2.07 0.23 False
8.72 μs 11.65 μs 1.34 0.24 False
944.32 μs 1.26 ms 1.33 0.28 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_LengthBucketsFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Plane

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
38.08 ns 250.24 ns 6.57 0.33 True
17.90 ns 38.68 ns 2.16 0.44 True

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Plane*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Plane.TransformByQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Plane.CreateFromVector4Benchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.17 μs 9.89 μs 1.08 0.17 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;SimpleStructWithProperties&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Tests.Perf_StringBuilder

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.65 μs 4.26 μs 1.17 0.19 False
121.55 ns 141.04 ns 1.16 0.33 False
5.17 μs 5.80 μs 1.12 0.19 False
1.75 μs 2.20 μs 1.26 0.18 False
2.58 μs 3.23 μs 1.25 0.14 False
654.89 μs 1.07 ms 1.63 0.15 False
136.23 ns 240.23 ns 1.76 0.28 True

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

Payloads

Baseline
Compare

System.Text.Tests.Perf_StringBuilder.Append_Memory

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Insert_Strings

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_NonEmptySpan

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1000)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
36.22 ns 197.81 ns 5.46 0.42 True

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector3*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector3.TransformByQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
33.65 μs 35.38 μs 1.05 0.12 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>.XmlSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<StructRecord>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
11.39 μs 12.90 μs 1.13 0.15 False
3.22 μs 3.87 μs 1.20 0.19 False
4.51 μs 5.03 μs 1.11 0.16 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;StructRecord&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Nov 2, 2023

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Add_Remove_SteadyState<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
221.65 ns 448.93 ns 2.03 0.20 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Add_Remove_SteadyState&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.Tests.Add_Remove_SteadyState<Int32>.ConcurrentStack(Count: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsFalse<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
10.62 ms 14.52 ms 1.37 0.30 False
10.57 ms 31.91 ms 3.02 0.33 False
10.75 ms 14.61 ms 1.36 0.29 False
10.57 ms 14.41 ms 1.36 0.34 False
4.57 ms 12.47 ms 2.73 0.28 False
10.70 ms 14.55 ms 1.36 0.30 False
11.03 ms 14.97 ms 1.36 0.33 False
10.55 ms 14.47 ms 1.37 0.25 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsFalse<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.ImmutableArray(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.Span(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
19.96 ns 38.69 ns 1.94 0.53 True

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Double&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Double>.OneBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Enum

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
752.96 ns 907.64 ns 1.21 0.27 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Enum*'

Payloads

Baseline
Compare

System.Tests.Perf_Enum.ToString_Flags(value: Red, Orange, Yellow, Green, Blue)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Primitives.StringSegmentBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
110.43 ns 119.36 ns 1.08 0.32 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Primitives.StringSegmentBenchmark*'

Payloads

Baseline
Compare

Microsoft.Extensions.Primitives.StringSegmentBenchmark.SubString

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.Perf_Path

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
208.99 ns 267.36 ns 1.28 0.34 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_Path*'

Payloads

Baseline
Compare

System.IO.Tests.Perf_Path.ChangeExtension

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.84 μs 13.80 μs 1.07 0.14 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;LargeStructWithProperties&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.91 μs 30.60 μs 1.10 0.15 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;SimpleStructWithProperties&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>.XmlSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Matrix4x4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
47.37 ns 234.54 ns 4.95 0.30 True
204.14 ns 569.38 ns 2.79 0.25 True

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Matrix4x4.CreateFromQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.TransformBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
29.10 μs 34.42 μs 1.18 0.21 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyFalse<Int32, Int32>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
11.60 μs 12.53 μs 1.08 0.18 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ClassRecord&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Type

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
8.63 ns 22.15 ns 2.57 0.62 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Type*'

Payloads

Baseline
Compare

System.Tests.Perf_Type.op_Equality

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Nov 2, 2023

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.82 ns 136.54 ns 4.91 0.43 True

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector2.TransformByQuaternionBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in BilinearTest

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
446.27 μs 750.86 μs 1.68 0.41 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'BilinearTest*'

Payloads

Baseline
Compare

BilinearTest.Interpol_Vector

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_TimeSpan

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
60.42 ns 93.93 ns 1.55 0.28 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_TimeSpan*'

Payloads

Baseline
Compare

System.Tests.Perf_TimeSpan.FromSeconds

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline db558253fbd598ed682272c736ae6102673bd921
Compare dd89eb7b277cd80663846fb43a0b9c32a587fde9
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Tests.Perf_Interlocked

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
60.74 ns 71.79 ns 1.18 0.40 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_Interlocked*'

Payloads

Baseline
Compare

System.Threading.Tests.Perf_Interlocked.CompareExchange_object_Match

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@lewing
Copy link
Member

lewing commented Nov 7, 2023

@radekdoulik @radical this looks like something changed in the platform not the code?

@radical
Copy link
Member

radical commented Nov 7, 2023

this looks like something changed in the platform not the code?

Nothing jumps out based on the build at least. Any thoughts on where I should look?

dotnet/performance#3446 was the only difference in dotnet/performance.

@radekdoulik
Copy link
Member

this is similar and same range as #23886

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants