[Perf] Linux/arm64: 13 Regressions on 3/28/2023 10:24:48 AM

### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 20.04
Queue | AmpereUbuntu
Baseline | [ed3721b092e395ac3576c2d93f4134650a44dc08](https://github.com/dotnet/runtime/commit/ed3721b092e395ac3576c2d93f4134650a44dc08)
Compare | [49ae58ace038dbbd3d53147e08c9ac95b24a789f](https://github.com/dotnet/runtime/commit/49ae58ace038dbbd3d53147e08c9ac95b24a789f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/ed3721b092e395ac3576c2d93f4134650a44dc08...49ae58ace038dbbd3d53147e08c9ac95b24a789f)
Configs | CompilationMode:tiered, RunKind:micro


### Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5c%5cp%7bLl%7d%22%2c%20Options%3a%20Compiled).html>) | 16.34 ms | 20.55 ms | 1.26 | 0.06 | True | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5c%5cs%5ba-zA-Z%5d%7b0%2c12%7ding%5c%5cs%22%2c%20Options%3a%20Compiled).html>) | 5.17 ms | 6.15 ms | 1.19 | 0.00 | True | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5c%5cw%2b%5c%5cs%2bHolmes%22%2c%20Options%3a%20Compiled).html>) | 4.26 ms | 4.87 ms | 1.14 | 0.39 | False | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5c%5cw%2b%5c%5cs%2bHolmes%5c%5cs%2b%5c%5cw%2b%22%2c%20Options%3a%20Compiled).html>) | 4.33 ms | 4.82 ms | 1.11 | 0.35 | False | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5c%5cb%5c%5cw%2bn%5c%5cb%22%2c%20Options%3a%20Compiled).html>) | 12.80 ms | 16.83 ms | 1.31 | 0.04 | True | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22%5c%5cp%7bL%7d%22%2c%20Options%3a%20Compiled).html>) | 16.84 ms | 21.23 ms | 1.26 | 0.01 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_3.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_4.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_5.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_6.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-2f00b5bd-865d-4eaa-a5ba-9c5c52d5727edad877464a0401e89/d9c0561f-73ae-42cd-9777-d5f150cd1e15.zip?sv=2021-08-06&se=2023-04-26T22%3A18%3A44Z&sr=c&sp=rl&sig=DT47v64yI7kYd7ZGJJ19cx4lAFR4L4SLXMY6sI6ZPek%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b57ff1f6-1afe-4cf1-9cf3-bbaa35ef774f336b1a1d9294edf83/bdff0ace-898b-4b97-b82a-93dbe9377bdc.zip?sv=2021-08-06&se=2023-04-27T18%3A44%3A04Z&sr=c&sp=rl&sig=OD22j1R79VoHuH57JEO6HMIF91TcfPJMu%2Fr%2BrobqMoE%3D>)

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
```

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-2f00b5bd-865d-4eaa-a5ba-9c5c52d5727edad877464a0401e89/d9c0561f-73ae-42cd-9777-d5f150cd1e15.zip?sv=2021-08-06&se=2023-04-26T22%3A18%3A44Z&sr=c&sp=rl&sig=DT47v64yI7kYd7ZGJJ19cx4lAFR4L4SLXMY6sI6ZPek%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b57ff1f6-1afe-4cf1-9cf3-bbaa35ef774f336b1a1d9294edf83/bdff0ace-898b-4b97-b82a-93dbe9377bdc.zip?sv=2021-08-06&se=2023-04-27T18%3A44%3A04Z&sr=c&sp=rl&sig=OD22j1R79VoHuH57JEO6HMIF91TcfPJMu%2Fr%2BrobqMoE%3D>)
### Histogram

#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\\p{Ll}", Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.54947575 > 17.217470477884618.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -57.557024839303075 (T) = (0 -20332103.287499998) / Math.Sqrt((58049568224.474754 / (33)) + (18794273467.97515 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.2468614926205208 = (16306625.401325168 - 20332103.287499998) / 16306625.401325168 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\\s[a-zA-Z]{0,12}ing\\s", Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.151779736666667 > 5.4106838359375.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -101.1979770815705 (T) = (0 -6114647.954487803) / Math.Sqrt((110167271.14663804 / (33)) + (430914634.8630668 / (5))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (5) - 2, .025) and -0.18566276570011475 = (5157156.091409518 - 6114647.954487803) / 5157156.091409518 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\\w+\\s+Holmes", Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.872532517857143 > 4.482539235905904.
IsChangePoint: Marked as a change because one of 12/25/2022 11:45:49 PM, 12/27/2022 1:08:06 PM, 3/25/2023 2:21:39 PM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -3.2418812551457306 (T) = (0 -4618381.482173909) / Math.Sqrt((23252746055.079617 / (23)) + (101193558559.1289 / (15))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (15) - 2, .025) and -0.06589863743060032 = (4332852.412033042 - 4618381.482173909) / 4332852.412033042 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\\w+\\s+Holmes\\s+\\w+", Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.819193994791667 > 4.552229026293103.
IsChangePoint: Marked as a change because one of 3/27/2023 3:21:55 PM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -12.756492135980336 (T) = (0 -4795824.034725765) / Math.Sqrt((27922608730.92018 / (31)) + (154549921.9120878 / (7))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (7) - 2, .025) and -0.0879052347587299 = (4408310.468134992 - 4795824.034725765) / 4408310.468134992 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\\b\\w+n\\b", Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.82856401333333 > 13.444227299596152.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -24.027129135169304 (T) = (0 -16720176.586133787) / Math.Sqrt((761750069493.8451 / (33)) + (4225525173.170076 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.28474253276079076 = (13014418.188680733 - 16720176.586133787) / 13014418.188680733 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\\p{L}", Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.2263869125 > 17.688542270000003.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -78.14928473949419 (T) = (0 -21087444.902083334) / Math.Sqrt((19916808307.44899 / (33)) + (13728388400.888712 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.24888085607666177 = (16885073.383484464 - 21087444.902083334) / 16885073.383484464 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```


### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 20.04
Queue | AmpereUbuntu
Baseline | [ed3721b092e395ac3576c2d93f4134650a44dc08](https://github.com/dotnet/runtime/commit/ed3721b092e395ac3576c2d93f4134650a44dc08)
Compare | [49ae58ace038dbbd3d53147e08c9ac95b24a789f](https://github.com/dotnet/runtime/commit/49ae58ace038dbbd3d53147e08c9ac95b24a789f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/ed3721b092e395ac3576c2d93f4134650a44dc08...49ae58ace038dbbd3d53147e08c9ac95b24a789f)
Configs | CompilationMode:tiered, RunKind:micro


### Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[OneNodeBacktracking - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options%3a%20IgnoreCase%2c%20Compiled).html>) | 91.31 ns | 126.20 ns | 1.38 | 0.28 | False | | |
[MatchesSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options%3a%20Compiled).html>) | 65.69 μs | 77.38 μs | 1.18 | 0.03 | True | | |
[MatchesBoundary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options%3a%20IgnoreCase%2c%20Compiled).html>) | 61.41 μs | 85.95 μs | 1.40 | 0.02 | True | | |
[Date_IsNotMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options%3a%20IgnoreCase%2c%20Compiled).html>) | 143.36 ns | 179.36 ns | 1.25 | 0.02 | True | | |
[MatchesSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options%3a%20IgnoreCase%2c%20Compiled).html>) | 65.93 μs | 77.51 μs | 1.18 | 0.08 | False | | |
[Date_IsNotMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options%3a%20Compiled).html>) | 139.84 ns | 178.91 ns | 1.28 | 0.02 | True | | |
[MatchesBoundary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options%3a%20Compiled).html>) | 61.22 μs | 85.85 μs | 1.40 | 0.05 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common_3.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common_4.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common_5.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common_6.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common_7.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_30_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Common.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-2f00b5bd-865d-4eaa-a5ba-9c5c52d5727edad877464a0401e89/d9c0561f-73ae-42cd-9777-d5f150cd1e15.zip?sv=2021-08-06&se=2023-04-26T22%3A18%3A44Z&sr=c&sp=rl&sig=DT47v64yI7kYd7ZGJJ19cx4lAFR4L4SLXMY6sI6ZPek%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b57ff1f6-1afe-4cf1-9cf3-bbaa35ef774f336b1a1d9294edf83/bdff0ace-898b-4b97-b82a-93dbe9377bdc.zip?sv=2021-08-06&se=2023-04-27T18%3A44%3A04Z&sr=c&sp=rl&sig=OD22j1R79VoHuH57JEO6HMIF91TcfPJMu%2Fr%2BrobqMoE%3D>)

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'
```

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-2f00b5bd-865d-4eaa-a5ba-9c5c52d5727edad877464a0401e89/d9c0561f-73ae-42cd-9777-d5f150cd1e15.zip?sv=2021-08-06&se=2023-04-26T22%3A18%3A44Z&sr=c&sp=rl&sig=DT47v64yI7kYd7ZGJJ19cx4lAFR4L4SLXMY6sI6ZPek%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b57ff1f6-1afe-4cf1-9cf3-bbaa35ef774f336b1a1d9294edf83/bdff0ace-898b-4b97-b82a-93dbe9377bdc.zip?sv=2021-08-06&se=2023-04-27T18%3A44%3A04Z&sr=c&sp=rl&sig=OD22j1R79VoHuH57JEO6HMIF91TcfPJMu%2Fr%2BrobqMoE%3D>)
### Histogram

#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: IgnoreCase, Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 126.19567320874324 > 100.74592776046136.
IsChangePoint: Marked as a change because one of 1/5/2023 10:03:03 PM, 1/15/2023 4:47:52 PM, 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -34.52804837981968 (T) = (0 -127.71426184138913) / Math.Sqrt((6.082417785131605 / (33)) + (4.41594097943025 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.3501789748061439 = (94.59061666970936 - 127.71426184138913) / 94.59061666970936 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 77.38079769230771 > 69.6607456010894.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -56.68358683752159 (T) = (0 -76665.51084222078) / Math.Sqrt((252040.94123439136 / (32)) + (155802.63837915318 / (6))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (6) - 2, .025) and -0.15743060075355678 = (66237.67402754596 - 76665.51084222078) / 66237.67402754596 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.95272614644969 > 64.44590341085687.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -133.32827741160585 (T) = (0 -85127.8385115181) / Math.Sqrt((44515.818974660084 / (33)) + (182088.97935423913 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.3866616741779852 = (61390.48918474075 - 85127.8385115181) / 61390.48918474075 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 179.35817492139208 > 150.3545781010817.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -38.034303602809935 (T) = (0 -180.62935285729) / Math.Sqrt((4.8085696229625645 / (33)) + (5.379455708739078 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.2738395681827048 = (141.79913810887575 - 180.62935285729) / 141.79913810887575 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: IgnoreCase, Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 77.514115313214 > 69.49939937752309.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -18.958138603491705 (T) = (0 -76947.1684807885) / Math.Sqrt((8496634.947970118 / (33)) + (130888.88992695129 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.14969698318495897 = (66928.21639631069 - 76947.1684807885) / 66928.21639631069 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 178.91159432850742 > 148.7727507789894.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -33.773539593410895 (T) = (0 -180.94239430066202) / Math.Sqrt((5.464994894812919 / (33)) + (7.048810836416668 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.2756728672463426 = (141.840748475934 - 180.94239430066202) / 141.840748475934 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: Compiled)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.85032978479852 > 64.44862728514404.
IsChangePoint: Marked as a change because one of 3/28/2023 2:42:21 AM, 3/30/2023 4:24:24 AM falls between 3/21/2023 2:53:21 PM and 3/30/2023 4:24:24 AM.
IsRegressionStdDev: Marked as regression because -164.05687266755143 (T) = (0 -85150.41426074681) / Math.Sqrt((18500.112642650867 / (33)) + (122396.74430169149 / (6))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (6) - 2, .025) and -0.38683873987671913 = (61398.92967535369 - 85150.41426074681) / 61398.92967535369 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```


### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	ed3721b092e395ac3576c2d93f4134650a44dc08
Compare	49ae58ace038dbbd3d53147e08c9ac95b24a789f
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Count - Duration of single invocation	16.34 ms	20.55 ms	1.26	0.06	True
Count - Duration of single invocation	5.17 ms	6.15 ms	1.19	0.00	True
Count - Duration of single invocation	4.26 ms	4.87 ms	1.14	0.39	False
Count - Duration of single invocation	4.33 ms	4.82 ms	1.11	0.35	False
Count - Duration of single invocation	12.80 ms	16.83 ms	1.31	0.04	True
Count - Duration of single invocation	16.84 ms	21.23 ms	1.26	0.01	True

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
OneNodeBacktracking - Duration of single invocation	91.31 ns	126.20 ns	1.38	0.28	False
MatchesSet - Duration of single invocation	65.69 μs	77.38 μs	1.18	0.03	True
MatchesBoundary - Duration of single invocation	61.41 μs	85.95 μs	1.40	0.02	True
Date_IsNotMatch - Duration of single invocation	143.36 ns	179.36 ns	1.25	0.02	True
MatchesSet - Duration of single invocation	65.93 μs	77.51 μs	1.18	0.08	False
Date_IsNotMatch - Duration of single invocation	139.84 ns	178.91 ns	1.28	0.02	True
MatchesBoundary - Duration of single invocation	61.22 μs	85.85 μs	1.40	0.05	True

[Perf] Linux/arm64: 13 Regressions on 3/28/2023 10:24:48 AM #14661

Description

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Repro

Payloads

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{Ll}", Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\s[a-zA-Z]{0,12}ing\s", Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes", Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes\s+\w+", Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\b\w+n\b", Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\p{L}", Options: Compiled)

Description of detection logic

Docs

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Repro

Payloads

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: IgnoreCase, Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled)

Description of detection logic

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: Compiled)

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions