- 
                Notifications
    You must be signed in to change notification settings 
- Fork 4
Description
Run Information
| Architecture | x64 | 
|---|---|
| OS | ubuntu 18.04 | 
| Baseline | 7e3bf878c105ea6114e56d3e6e3014c5480cb060 | 
| Compare | 1c8d37af80667daffb3cb80ce0fe915621e8f039 | 
| Diff | Diff | 
Improvements in StoreBlock.LocalAddress
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL | 
|---|---|---|---|---|---|---|---|---|---|---|
| CopyBlock128 - Duration of single invocation | 2.93 ns | 0.89 ns | 0.30 | 0.11 | False | 
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'StoreBlock.LocalAddress*'Payloads
Histogram
StoreBlock.LocalAddress.CopyBlock128
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.8937072345214009 < 2.787703714728815.
IsChangePoint: Marked as a change because one of 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 14.36534127676576 (T) = (0 -1.0341441202707766) / Math.Sqrt((0.5741670640358779 / (299)) + (0.06046276997193792 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.6736146106936701 = (3.1684755327701817 - 1.0341441202707766) / 3.1684755327701817 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Architecture | x64 | 
|---|---|
| OS | ubuntu 18.04 | 
| Baseline | 7e3bf878c105ea6114e56d3e6e3014c5480cb060 | 
| Compare | 1c8d37af80667daffb3cb80ce0fe915621e8f039 | 
| Diff | Diff | 
Improvements in System.Tests.Perf_Single
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL | 
|---|---|---|---|---|---|---|---|---|---|---|
| Parse - Duration of single invocation | 76.40 ns | 70.47 ns | 0.92 | 0.00 | False | |||||
| Parse - Duration of single invocation | 74.00 ns | 67.10 ns | 0.91 | 0.00 | False | |||||
| TryParse - Duration of single invocation | 73.68 ns | 67.20 ns | 0.91 | 0.01 | False | |||||
| TryParse - Duration of single invocation | 77.10 ns | 70.26 ns | 0.91 | 0.01 | False | 
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'Payloads
Histogram
System.Tests.Perf_Single.Parse(value: "-3.4028235E+38")
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 70.47353505542966 < 72.71041168365944.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 2/9/2023 4:27:10 AM, 2/16/2023 9:36:08 AM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 102.87193810261549 (T) = (0 -70.51566343647566) / Math.Sqrt((0.8619445267504178 / (299)) + (0.0024800887940989863 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.08160138564399672 = (76.78110826193095 - 70.51566343647566) / 76.78110826193095 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.Parse(value: "3.4028235E+38")
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 67.10457316504308 < 70.09778166689645.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 2/16/2023 9:36:08 AM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 38.10421162311779 (T) = (0 -67.43704757235902) / Math.Sqrt((0.6732019600907404 / (299)) + (0.08297446997195009 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.08902027680731019 = (74.02694687431016 - 67.43704757235902) / 74.02694687431016 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.TryParse(value: "3.4028235E+38")
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 67.20390919167274 < 70.10623971467382.
IsChangePoint: Marked as a change because one of 1/12/2023 10:41:19 PM, 2/16/2023 9:36:08 AM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 35.18865962211809 (T) = (0 -67.3526575128065) / Math.Sqrt((0.5605699400601034 / (299)) + (0.11852537041937349 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.0960714824628763 = (74.51104396652734 - 67.3526575128065) / 74.51104396652734 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Single.TryParse(value: "-3.4028235E+38")
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 70.25921989867605 < 72.75555845858706.
IsChangePoint: Marked as a change because one of 1/9/2023 8:29:54 AM, 2/9/2023 4:27:10 AM, 2/16/2023 3:28:45 AM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 19.64416244336192 (T) = (0 -70.61931473636685) / Math.Sqrt((0.7636551590769367 / (299)) + (0.33429051060886766 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.08585171874942887 = (77.25148773430757 - 70.61931473636685) / 77.25148773430757 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Architecture | x64 | 
|---|---|
| OS | ubuntu 18.04 | 
| Baseline | 7e3bf878c105ea6114e56d3e6e3014c5480cb060 | 
| Compare | 1c8d37af80667daffb3cb80ce0fe915621e8f039 | 
| Diff | Diff | 
Improvements in HardwareIntrinsics.RayTracer.SoA
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL | 
|---|---|---|---|---|---|---|---|---|---|---|
| Render - Duration of single invocation | 6.20 ms | 5.44 ms | 0.88 | 0.13 | False | 
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'HardwareIntrinsics.RayTracer.SoA*'Payloads
Histogram
HardwareIntrinsics.RayTracer.SoA.Render
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.435296091304347 < 5.894336778577235.
IsChangePoint: Marked as a change because one of 1/23/2023 1:44:35 PM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 16.235291114346595 (T) = (0 -5334777.6334376) / Math.Sqrt((27354398000.038193 / (299)) + (7580549769.276049 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.13474175787849063 = (6165532.292830133 - 5334777.6334376) / 6165532.292830133 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Architecture | x64 | 
|---|---|
| OS | ubuntu 18.04 | 
| Baseline | 7e3bf878c105ea6114e56d3e6e3014c5480cb060 | 
| Compare | 1c8d37af80667daffb3cb80ce0fe915621e8f039 | 
| Diff | Diff | 
Improvements in System.Buffers.Text.Tests.Utf8ParserTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL | 
|---|---|---|---|---|---|---|---|---|---|---|
| TryParseSingle - Duration of single invocation | 55.75 ns | 49.19 ns | 0.88 | 0.01 | False | |||||
| TryParseSingle - Duration of single invocation | 53.50 ns | 49.18 ns | 0.92 | 0.01 | False | |||||
| TryParseDouble - Duration of single invocation | 69.98 ns | 62.76 ns | 0.90 | 0.04 | False | 
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8ParserTests*'Payloads
Histogram
System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: -3.4028235E+38)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 49.187974283431586 < 53.05949770543402.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 1/19/2023 8:10:32 PM, 3/3/2023 4:59:02 PM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 27.553936252885418 (T) = (0 -49.383337101758855) / Math.Sqrt((1.0831251693539772 / (299)) + (0.11380419101071465 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.10212717092112951 = (55.00036920865655 - 49.383337101758855) / 55.00036920865655 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: 3.4028235E+38)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 49.17762832244576 < 50.99895302525933.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 1/19/2023 8:10:32 PM, 2/24/2023 9:01:57 AM, 3/3/2023 4:59:02 PM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 73.10971867434218 (T) = (0 -49.11754324773049) / Math.Sqrt((1.233998518485274 / (299)) + (0.005435206524787329 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.10290299088161824 = (54.751651993579316 - 49.11754324773049) / 54.751651993579316 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: -1.7976931348623157e+308)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 62.76045559002689 < 66.60578470750382.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 1/19/2023 8:10:32 PM, 2/14/2023 9:29:25 PM, 3/3/2023 4:59:02 PM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 88.8307445887907 (T) = (0 -62.87189363043033) / Math.Sqrt((1.6305266153782543 / (299)) + (0.009314574807706574 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.1155969308625999 = (71.08963754699793 - 62.87189363043033) / 71.08963754699793 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Architecture | x64 | 
|---|---|
| OS | ubuntu 18.04 | 
| Baseline | 7e3bf878c105ea6114e56d3e6e3014c5480cb060 | 
| Compare | 1c8d37af80667daffb3cb80ce0fe915621e8f039 | 
| Diff | Diff | 
Improvements in System.Tests.Perf_Double
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL | 
|---|---|---|---|---|---|---|---|---|---|---|
| TryParse - Duration of single invocation | 110.99 ns | 99.71 ns | 0.90 | 0.03 | False | 
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Double*'Payloads
Histogram
System.Tests.Perf_Double.TryParse(value: "-1.7976931348623157e+308")
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 99.71497158314129 < 104.73150576569768.
IsChangePoint: Marked as a change because one of 1/5/2023 12:24:13 PM, 1/18/2023 3:20:52 PM, 2/9/2023 4:27:10 AM, 2/16/2023 1:21:52 PM, 3/3/2023 4:59:02 PM, 3/13/2023 2:14:21 PM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsImprovementStdDev: Marked as improvement because 5.746939724617549 (T) = (0 -101.82656234508391) / Math.Sqrt((4.728499022813492 / (299)) + (3.349998625925731 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.05665786137063878 = (107.94234474994818 - 101.82656234508391) / 107.94234474994818 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository









