Regressions in Benchstone.BenchF.Whetsto

### Run Information

Architecture | x64
-- | --
OS | Windows 10.0.19042
Baseline | [5c559f14ff23a34eb5585bc8112a73a579648b87](https://github.com/dotnet/runtime/commit/5c559f14ff23a34eb5585bc8112a73a579648b87)
Compare | [025b7638ce84c404eb4cdc1a12ea114029e511fc](https://github.com/dotnet/runtime/commit/025b7638ce84c404eb4cdc1a12ea114029e511fc)
Diff | [Diff](https://github.com/dotnet/runtime/compare/5c559f14ff23a34eb5585bc8112a73a579648b87...025b7638ce84c404eb4cdc1a12ea114029e511fc)


### Regressions in System.Tests.Perf_DateTime

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[ToString - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Tests.Perf_DateTime.ToString(format%3a%20%22s%22).html>) | 212.46 ns | 231.39 ns | 1.09 | 0.18 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/System.Tests.Perf_DateTime_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/System.Tests.Perf_DateTime.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTime*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-5b6d43b9-6459-4882-8c8a-544cce83fb8cc220efb4ea14f1f80/da5b4d29-b796-4dad-9de0-db481853a81f.zip?sv=2019-07-07&se=2022-07-13T12%3A29%3A47Z&sr=c&sp=rl&sig=51cbpU3RtaDn1xC%2BY4F2uyF9CVnw0ZWkfoPZMwNmTaY%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-79562f51-86da-42fd-9390-5019f66917ed3c2059111ae4e7da2/8f8e3a91-ee5b-4b24-b30b-965282f38d22.zip?sv=2019-07-07&se=2022-07-13T22%3A54%3A42Z&sr=c&sp=rl&sig=sRZcyDj5%2B8t52lAkwmXvJqDHCXS6RaQ8swMDe9a83Cw%3D>)
### Histogram

#### System.Tests.Perf_DateTime.ToString(format: "s")

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 231.3868659289664 > 224.93963687210936.
IsChangePoint: Marked as a change because one of 5/15/2022 3:27:46 PM, 6/2/2022 3:41:19 AM, 6/13/2022 2:27:15 PM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -21.128020932399817 (T) = (0 -232.21028437704024) / Math.Sqrt((9.195208195731894 / (24)) + (13.458414347571733 / (45))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (45) - 2, .025) and -0.08125789279877214 = (214.75938897054212 - 232.21028437704024) / 214.75938897054212 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>
### Run Information

Architecture | x64
-- | --
OS | Windows 10.0.19042
Baseline | [5c559f14ff23a34eb5585bc8112a73a579648b87](https://github.com/dotnet/runtime/commit/5c559f14ff23a34eb5585bc8112a73a579648b87)
Compare | [025b7638ce84c404eb4cdc1a12ea114029e511fc](https://github.com/dotnet/runtime/commit/025b7638ce84c404eb4cdc1a12ea114029e511fc)
Diff | [Diff](https://github.com/dotnet/runtime/compare/5c559f14ff23a34eb5585bc8112a73a579648b87...025b7638ce84c404eb4cdc1a12ea114029e511fc)


### Regressions in System.Text.Json.Tests.Perf_Get

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[GetGuid - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Text.Json.Tests.Perf_Get.GetGuid.html>) | 4.89 μs | 5.14 μs | 1.05 | 0.06 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/System.Text.Json.Tests.Perf_Get_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/System.Text.Json.Tests.Perf_Get.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Get*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-5b6d43b9-6459-4882-8c8a-544cce83fb8cc220efb4ea14f1f80/da5b4d29-b796-4dad-9de0-db481853a81f.zip?sv=2019-07-07&se=2022-07-13T12%3A29%3A47Z&sr=c&sp=rl&sig=51cbpU3RtaDn1xC%2BY4F2uyF9CVnw0ZWkfoPZMwNmTaY%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-79562f51-86da-42fd-9390-5019f66917ed3c2059111ae4e7da2/8f8e3a91-ee5b-4b24-b30b-965282f38d22.zip?sv=2019-07-07&se=2022-07-13T22%3A54%3A42Z&sr=c&sp=rl&sig=sRZcyDj5%2B8t52lAkwmXvJqDHCXS6RaQ8swMDe9a83Cw%3D>)
### Histogram

#### System.Text.Json.Tests.Perf_Get.GetGuid

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.143946569271176 > 5.141723655311287.
IsChangePoint: Marked as a change because one of 5/24/2022 1:50:23 PM, 6/2/2022 10:01:42 AM, 6/13/2022 2:27:15 PM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -9.903419351975518 (T) = (0 -5265.996127595913) / Math.Sqrt((13022.380295379391 / (24)) + (9122.545714361095 / (45))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (45) - 2, .025) and -0.05412118109195785 = (4995.6268995002065 - 5265.996127595913) / 4995.6268995002065 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


### Run Information

Architecture | x64
-- | --
OS | Windows 10.0.19042
Baseline | [5c559f14ff23a34eb5585bc8112a73a579648b87](https://github.com/dotnet/runtime/commit/5c559f14ff23a34eb5585bc8112a73a579648b87)
Compare | [025b7638ce84c404eb4cdc1a12ea114029e511fc](https://github.com/dotnet/runtime/commit/025b7638ce84c404eb4cdc1a12ea114029e511fc)
Diff | [Diff](https://github.com/dotnet/runtime/compare/5c559f14ff23a34eb5585bc8112a73a579648b87...025b7638ce84c404eb4cdc1a12ea114029e511fc)


### Regressions in Benchstone.BenchF.Whetsto

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Test - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/Benchstone.BenchF.Whetsto.Test.html>) | 536.73 ms | 567.08 ms | 1.06 | 0.00 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/Benchstone.BenchF.Whetsto_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/Benchstone.BenchF.Whetsto.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchF.Whetsto*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-5b6d43b9-6459-4882-8c8a-544cce83fb8cc220efb4ea14f1f80/da5b4d29-b796-4dad-9de0-db481853a81f.zip?sv=2019-07-07&se=2022-07-13T12%3A29%3A47Z&sr=c&sp=rl&sig=51cbpU3RtaDn1xC%2BY4F2uyF9CVnw0ZWkfoPZMwNmTaY%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-79562f51-86da-42fd-9390-5019f66917ed3c2059111ae4e7da2/8f8e3a91-ee5b-4b24-b30b-965282f38d22.zip?sv=2019-07-07&se=2022-07-13T22%3A54%3A42Z&sr=c&sp=rl&sig=sRZcyDj5%2B8t52lAkwmXvJqDHCXS6RaQ8swMDe9a83Cw%3D>)
### Histogram

#### Benchstone.BenchF.Whetsto.Test

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 567.0779933333333 > 564.0397967307692.
IsChangePoint: Marked as a change because one of 5/11/2022 7:02:26 PM, 6/13/2022 2:27:15 PM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -41.6199604941197 (T) = (0 -565470763.8030119) / Math.Sqrt((283123955457.2862 / (24)) + (20345517610454.36 / (45))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (45) - 2, .025) and -0.05277757371441425 = (537122729.3605007 - 565470763.8030119) / 537122729.3605007 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>




category:performance
theme:benchmarks
skill-level:beginner
cost:small
impact:small

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Regressions in Benchstone.BenchF.Whetsto #71067

Run Information

Regressions in System.Tests.Perf_DateTime

Repro

Payloads

Histogram

System.Tests.Perf_DateTime.ToString(format: "s")

Description of detection logic

Docs