Skip to content

[Perf] Windows/x64: 30 Regressions on 11/30/2022 11:21:33 PM #10382

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
performanceautofiler bot opened this issue Dec 6, 2022 · 1 comment
Open

[Perf] Windows/x64: 30 Regressions on 11/30/2022 11:21:33 PM #10382

performanceautofiler bot opened this issue Dec 6, 2022 · 1 comment
Assignees
@EgorBo
Labels
arch-x64 branch-refs/heads/main kind-micro os-windows perf-regression runtime-coreclr

Comments

@performanceautofiler
Copy link

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS Windows 10.0.19042
Baseline 8158cb8be51bd6269c75e4010e2e25ada78578f0
Compare 067e43a1363f6d1748acc679f1804cd48299ba89
Diff Diff

Regressions in Exceptions.Handling

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
MultipleNestedTryCatch_LastCatches - Duration of single invocation 9.19 μs 10.97 μs 1.19 0.01 False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation 23.03 μs 29.02 μs 1.26 0.01 False
ThrowAndCatchWhenFinally - Duration of single invocation 9.19 μs 10.81 μs 1.18 0.00 False
MultipleNestedTryFinally - Duration of single invocation 9.40 μs 10.88 μs 1.16 0.00 False
ThrowAndCatchFinally - Duration of single invocation 6.74 μs 9.13 μs 1.35 0.00 False
ThrowAndCatch - Duration of single invocation 6.74 μs 9.08 μs 1.35 0.00 False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation 9.21 μs 10.98 μs 1.19 0.00 False
TryAndFinallyDeep - Duration of single invocation 20.18 μs 23.23 μs 1.15 0.02 False
ThrowAndCatch - Duration of single invocation 20.04 μs 26.54 μs 1.32 0.01 False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation 20.38 μs 26.73 μs 1.31 0.01 False
ThrowAndCatch - Duration of single invocation 9.05 μs 10.81 μs 1.19 0.00 False
TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation 22.57 μs 24.88 μs 1.10 0.01 False
TryAndFinallyDeep - Duration of single invocation 22.75 μs 25.05 μs 1.10 0.01 False
CatchAndThrowOtherDeep - Duration of single invocation 98.48 μs 139.67 μs 1.42 0.00 False
ThrowAndCatchFinally - Duration of single invocation 9.20 μs 10.76 μs 1.17 0.00 False
MultipleNestedTryFinally - Duration of single invocation 7.01 μs 9.39 μs 1.34 0.00 False
ThrowAndCatch - Duration of single invocation 22.67 μs 28.64 μs 1.26 0.01 False
CatchAndRethrowDeep - Duration of single invocation 98.38 μs 140.50 μs 1.43 0.01 False
CatchAndRethrowDeep - Duration of single invocation 91.16 μs 132.97 μs 1.46 0.01 False
CatchAndThrowOtherDeep - Duration of single invocation 95.32 μs 137.02 μs 1.44 0.01 False
TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation 20.17 μs 22.62 μs 1.12 0.01 False
ThrowAndCatchDeep - Duration of single invocation 21.20 μs 23.51 μs 1.11 0.02 False
ThrowAndCatchWhen - Duration of single invocation 9.11 μs 10.79 μs 1.18 0.00 False
MultipleNestedTryCatch_LastCatches - Duration of single invocation 7.00 μs 9.34 μs 1.33 0.00 False
MultipleNestedTryCatch_FirstCatches - Duration of single invocation 9.05 μs 10.69 μs 1.18 0.00 False
ThrowAndCatchWhenFinally - Duration of single invocation 6.92 μs 9.26 μs 1.34 0.00 False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation 7.01 μs 9.43 μs 1.35 0.00 False
MultipleNestedTryCatch_FirstCatches - Duration of single invocation 6.83 μs 9.19 μs 1.34 0.01 False
ThrowAndCatchWhen - Duration of single invocation 6.98 μs 9.21 μs 1.32 0.00 False
ThrowAndCatchDeep - Duration of single invocation 18.88 μs 21.76 μs 1.15 0.02 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Exceptions.Handling*'

Payloads

Baseline
Compare

Histogram

Exceptions.Handling.MultipleNestedTryCatch_LastCatches(kind: Hardware)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.96745167103539 > 9.684347818839887.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -71.82324215498986 (T) = (0 -10831.467709074213) / Math.Sqrt((3819.75370993724 / (27)) + (9171.72559576854 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.17578572892579478 = (9212.110202230393 - 10831.467709074213) / 9212.110202230393 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionHardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.020908425754776 > 24.177205206717545.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -85.28094696653346 (T) = (0 -28794.17812278562) / Math.Sqrt((29216.648692639912 / (27)) + (88566.37509060481 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.2522147043557455 = (22994.601502942736 - 28794.17812278562) / 22994.601502942736 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhenFinally(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.805612156259308 > 9.63382039458409.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -57.99798724618391 (T) = (0 -10748.597274591846) / Math.Sqrt((12309.648075550105 / (27)) + (7035.857904621837 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.17167373021207694 = (9173.711928017976 - 10748.597274591846) / 9173.711928017976 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryFinally(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.882577943402346 > 9.73546864900514.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -61.85211043013736 (T) = (0 -10815.145306539804) / Math.Sqrt((6044.720004992264 / (27)) + (10648.409859949677 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.1706673784152848 = (9238.44424637518 - 10815.145306539804) / 9238.44424637518 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchFinally(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.12944497787426 > 7.1236244123747055.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -168.24772135169783 (T) = (0 -9103.133307950013) / Math.Sqrt((963.9414517594395 / (27)) + (3816.815212478358 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.33988967771180584 = (6793.942411360219 - 9103.133307950013) / 6793.942411360219 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.080453944715737 > 7.075476403518685.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -109.09039086897687 (T) = (0 -9113.627723499407) / Math.Sqrt((5789.900437743041 / (27)) + (5888.1205350138125 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.34032618113457525 = (6799.559578687626 - 9113.627723499407) / 6799.559578687626 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.977976611436654 > 9.758740915902393.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -57.528880712958326 (T) = (0 -10882.741039585439) / Math.Sqrt((8636.191887937008 / (27)) + (10435.420853128055 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.16759219994534624 = (9320.669528363454 - 10882.741039585439) / 9320.669528363454 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndFinallyDeep(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.232562966417913 > 21.10163401442308.
IsChangePoint: Marked as a change because one of 10/27/2022 8:00:27 PM, 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -28.62846303365714 (T) = (0 -22914.216886427308) / Math.Sqrt((84045.69421927791 / (27)) + (133001.58395377183 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.12960010688173848 = (20285.246740708986 - 22914.216886427308) / 20285.246740708986 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: ReflectionSoftware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.54042624395977 > 21.023322499576125.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -71.90741866947346 (T) = (0 -26656.97808452915) / Math.Sqrt((48790.17475958498 / (27)) + (161183.22285791385 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.32464064281792104 = (20123.931897349532 - 26656.97808452915) / 20123.931897349532 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionSoftware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.732376725838265 > 21.4426926195307.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -126.60198424537408 (T) = (0 -26793.436813096687) / Math.Sqrt((20893.909949555156 / (27)) + (42812.358216812885 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.3082316645429955 = (20480.651507893625 - 26793.436813096687) / 20480.651507893625 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.809091909998399 > 9.497933848471394.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -61.92846636948064 (T) = (0 -10617.076981752161) / Math.Sqrt((6977.01225875744 / (27)) + (9765.240651475086 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.17453357951971946 = (9039.39841898229 - 10617.076981752161) / 9039.39841898229 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.88442124250948 > 23.67232258724255.
IsChangePoint: Marked as a change because one of 10/28/2022 2:46:43 AM, 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -18.08890072098606 (T) = (0 -24626.978059744717) / Math.Sqrt((69900.55197767627 / (27)) + (200815.7646189118 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.0818995947113271 = (22762.720478064046 - 24626.978059744717) / 22762.720478064046 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndFinallyDeep(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.05083534621578 > 23.85846107580144.
IsChangePoint: Marked as a change because one of 10/28/2022 2:46:43 AM, 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -23.30000601695777 (T) = (0 -24748.230231606016) / Math.Sqrt((47262.22206753267 / (27)) + (119244.16940186104 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.08227760959208016 = (22866.804239749392 - 24748.230231606016) / 22866.804239749392 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndThrowOtherDeep(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 139.66945153061224 > 103.72238335929119.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -141.98375533786316 (T) = (0 -140115.14436604266) / Math.Sqrt((336185.3809424351 / (27)) + (1818204.1662166084 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.4199452372790443 = (98676.44236374699 - 140115.14436604266) / 98676.44236374699 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchFinally(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.757499322192645 > 9.512392101987103.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -52.16713967769279 (T) = (0 -10617.55854857694) / Math.Sqrt((6028.81434754355 / (27)) + (17022.39751886102 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.17335225665212725 = (9048.909641910554 - 10617.55854857694) / 9048.909641910554 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryFinally(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.38910984848485 > 7.365925435152354.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -111.10172526358492 (T) = (0 -9388.563301216534) / Math.Sqrt((2836.0149532415694 / (27)) + (8623.425349775558 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.3351567001540644 = (7031.806304183759 - 9388.563301216534) / 7031.806304183759 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: ReflectionHardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.639621196111584 > 23.825919220906446.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -90.19227594811258 (T) = (0 -28523.541219511782) / Math.Sqrt((40935.87749642927 / (27)) + (64765.1143105473 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.25413114542339676 = (22743.66705874463 - 28523.541219511782) / 22743.66705874463 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndRethrowDeep(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 140.49811843093093 > 103.04783605726709.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -153.95598008557047 (T) = (0 -138709.32331979135) / Math.Sqrt((621579.087205315 / (27)) + (1155900.932993491 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.41261911961163483 = (98193.00998695678 - 138709.32331979135) / 98193.00998695678 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndRethrowDeep(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 132.97366449757868 > 95.32952483742775.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -144.2353156132364 (T) = (0 -132139.32975389916) / Math.Sqrt((441397.56623690814 / (27)) + (1670845.9105831005 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.4594575317821967 = (90540.030714384 - 132139.32975389916) / 90540.030714384 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndThrowOtherDeep(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 137.01920817669173 > 99.74942131801124.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -148.66804460069122 (T) = (0 -137082.7185049537) / Math.Sqrt((841248.3457994448 / (27)) + (1175428.545182421 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.43518703138256165 = (95515.57776612398 - 137082.7185049537) / 95515.57776612398 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.61991936377743 > 20.99706409533604.
IsChangePoint: Marked as a change because one of 10/31/2022 10:23:25 PM, 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -33.70340004616296 (T) = (0 -22626.855837413605) / Math.Sqrt((37765.18711159286 / (27)) + (111201.11700628688 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.12853519899930446 = (20049.7564076666 - 22626.855837413605) / 20049.7564076666 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.51414027149321 > 22.29659937139931.
IsChangePoint: Marked as a change because one of 10/27/2022 8:00:27 PM, 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -24.784347301138443 (T) = (0 -23276.588418090436) / Math.Sqrt((24315.64417624387 / (27)) + (128457.95595280781 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.0902082952478806 = (21350.588249558346 - 23276.588418090436) / 21350.588249558346 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhen(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.785809085952218 > 9.6040601941292.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -59.78955506355496 (T) = (0 -10722.819999662663) / Math.Sqrt((10190.287974180628 / (27)) + (7194.553365094729 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.16796659377718176 = (9180.759155949201 - 10722.819999662663) / 9180.759155949201 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryCatch_LastCatches(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.33631495936698 > 7.327670278825977.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -107.70699266192089 (T) = (0 -9327.728174529058) / Math.Sqrt((4308.761949244332 / (27)) + (7766.830364595707 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.33404618238917105 = (6992.057919482095 - 9327.728174529058) / 6992.057919482095 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryCatch_FirstCatches(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.686544303071985 > 9.44507780690272.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -63.66834233949684 (T) = (0 -10594.591193958802) / Math.Sqrt((3908.29309387723 / (27)) + (11499.493583293777 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.1734082308217826 = (9028.904788352307 - 10594.591193958802) / 9028.904788352307 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhenFinally(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.260306411129072 > 7.345414939093258.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -92.65300371234197 (T) = (0 -9299.733665054226) / Math.Sqrt((4661.2545596694345 / (27)) + (11408.297513817271 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.33309221349798634 = (6976.061798944918 - 9299.733665054226) / 6976.061798944918 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.434867104204384 > 7.361756137315386.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -111.34484510494539 (T) = (0 -9412.111467844912) / Math.Sqrt((1412.2734318165699 / (27)) + (10106.623555699402 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.33828839642398895 = (7032.947078518209 - 9412.111467844912) / 7032.947078518209 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryCatch_FirstCatches(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.185427830913943 > 7.117656396882589.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -133.43161997320308 (T) = (0 -9132.49323163787) / Math.Sqrt((3133.0087802652056 / (27)) + (4509.194484426675 / (24))) is less than -2.0095752371279447 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (24) - 2, .025) and -0.34176314916210887 = (6806.337793179699 - 9132.49323163787) / 6806.337793179699 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhen(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.214213192634322 > 7.298112004491613.
IsChangePoint: Marked as a change because one of 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -111.05030464725667 (T) = (0 -9273.353027227728) / Math.Sqrt((2858.220217223592 / (27)) + (8354.753775883124 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.335484958345837 = (6943.809414906417 - 9273.353027227728) / 6943.809414906417 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: Software)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.75993567267235 > 19.79739942423408.
IsChangePoint: Marked as a change because one of 10/28/2022 8:11:48 AM, 11/30/2022 7:06:59 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsRegressionStdDev: Marked as regression because -31.19621323152304 (T) = (0 -21401.296015702403) / Math.Sqrt((80670.06928796228 / (27)) + (82271.67548510616 / (25))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (25) - 2, .025) and -0.13058662421140077 = (18929.37308596773 - 21401.296015702403) / 18929.37308596773 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@EgorBo EgorBo

Labels
arch-x64 branch-refs/heads/main kind-micro os-windows perf-regression runtime-coreclr
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@EgorBo @LoopedBard3