Skip to content

Conversation

mdjastrzebski
Copy link
Member

Summary

This PR intentionally introduces performance regression to showcase how Reassure detects and present such case.

Test plan

@mdjastrzebski mdjastrzebski force-pushed the feat/regression-example branch 3 times, most recently from 4d87a25 to fc93e6a Compare January 31, 2025 13:11
@callstack callstack deleted a comment from github-actions bot Jan 31, 2025
Copy link

github-actions bot commented Jan 31, 2025

Performance Comparison Report

  • Current: 344e2be - 2025-07-17 07:44:14Z
  • Baseline: main (5d5cae2) - 2025-07-17 07:43:51Z

Significant Changes To Duration

Show entries
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render 53.9 ms → 62.1 ms (+8.2 ms, +15.3%) 🔴 4 → 5 (+1, +25.0%) 🔴
Web Vite - TestList (100 items) render 13.9 ms → 18.6 ms (+4.8 ms, +34.4%) 🔴🔴 1 → 2 (+1, +100.0%) 🔴
Show details
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render Baseline
Mean: 53.9 ms
Stdev: 8.9 ms (16.5%)
Runs: 57.4 58.3 59.3 38.8 53.3 62.1 61.6 61.6 45.8 40.7
Warmup runs: 64.9
Removed outliers: (none)

Current
Mean: 62.1 ms
Stdev: 12.7 ms (20.5%)
Runs: 67.1 69.8 57.9 40.7 74.5 73.0 73.9 59.0 40.4 65.1
Warmup runs: 80.8
Removed outliers: (none)
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1
Web Vite - TestList (100 items) render Baseline
Mean: 13.9 ms
Stdev: 0.2 ms (1.5%)
Runs: 13.9 14.0 13.6 13.6 13.7 13.8 13.7 13.9 14.0 14.3
Warmup runs: 19.9
Removed outliers: (none)

Current
Mean: 18.6 ms
Stdev: 0.4 ms (2.4%)
Runs: 18.5 18.2 18.1 18.4 18.4 18.3 18.6 19.1 19.4 19.1
Warmup runs: 25.5
Removed outliers: (none)
Baseline
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1
Render issues:

Current
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2
Render issues:
- Initial updates: 1

Meaningless Changes To Duration

Show entries
Name Type Duration Count
Web Vite - AsyncComponent (50 runs) render 62.3 ms → 63.7 ms (+1.4 ms, +2.3%) 4 → 5 (+1, +25.0%) 🔴
Show details
Name Type Duration Count
Web Vite - AsyncComponent (50 runs) render Baseline
Mean: 62.3 ms
Stdev: 1.1 ms (1.7%)
Runs: 61.9 62.1 59.2 62.4 62.7 62.9 62.6 62.4 62.3 62.0 62.2 62.0 62.1 65.4 62.4 62.4 62.0 62.6 62.7 62.7 60.0 64.2 62.6 62.4 62.4 62.3 62.6 62.4 62.4 62.3 62.2 59.8 62.7 62.2 63.1
Warmup runs: 62.0
Removed outliers: 34.7 39.0 46.6 53.7 34.8 39.4 53.5 46.9 40.5 34.6 39.5 53.3 46.7 40.6 34.6

Current
Mean: 63.7 ms
Stdev: 13.6 ms (21.3%)
Runs: 76.7 66.6 40.2 65.6 74.9 75.0 67.8 39.8 59.8 74.9 75.4 71.7 40.1 53.0 74.6 74.4 75.8 44.8 46.7 74.7 74.5 74.6 53.8 46.3 74.4 74.7 74.4 53.8 39.8 74.2 74.9 74.1 60.0 40.3 74.4 74.6 76.0 60.8 40.1 65.5 75.4 74.8 67.5 40.2 60.6 74.3 74.9 72.2 40.3 53.0
Warmup runs: 74.6
Removed outliers: (none)
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1

Render Count Changes

Show entries
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render 53.9 ms → 62.1 ms (+8.2 ms, +15.3%) 🔴 4 → 5 (+1, +25.0%) 🔴
Web Vite - AsyncComponent (50 runs) render 62.3 ms → 63.7 ms (+1.4 ms, +2.3%) 4 → 5 (+1, +25.0%) 🔴
Web Vite - TestList (100 items) render 13.9 ms → 18.6 ms (+4.8 ms, +34.4%) 🔴🔴 1 → 2 (+1, +100.0%) 🔴
Show details
Name Type Duration Count
Web Vite - AsyncComponent (10 runs) render Baseline
Mean: 53.9 ms
Stdev: 8.9 ms (16.5%)
Runs: 57.4 58.3 59.3 38.8 53.3 62.1 61.6 61.6 45.8 40.7
Warmup runs: 64.9
Removed outliers: (none)

Current
Mean: 62.1 ms
Stdev: 12.7 ms (20.5%)
Runs: 67.1 69.8 57.9 40.7 74.5 73.0 73.9 59.0 40.4 65.1
Warmup runs: 80.8
Removed outliers: (none)
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1
Web Vite - AsyncComponent (50 runs) render Baseline
Mean: 62.3 ms
Stdev: 1.1 ms (1.7%)
Runs: 61.9 62.1 59.2 62.4 62.7 62.9 62.6 62.4 62.3 62.0 62.2 62.0 62.1 65.4 62.4 62.4 62.0 62.6 62.7 62.7 60.0 64.2 62.6 62.4 62.4 62.3 62.6 62.4 62.4 62.3 62.2 59.8 62.7 62.2 63.1
Warmup runs: 62.0
Removed outliers: 34.7 39.0 46.6 53.7 34.8 39.4 53.5 46.9 40.5 34.6 39.5 53.3 46.7 40.6 34.6

Current
Mean: 63.7 ms
Stdev: 13.6 ms (21.3%)
Runs: 76.7 66.6 40.2 65.6 74.9 75.0 67.8 39.8 59.8 74.9 75.4 71.7 40.1 53.0 74.6 74.4 75.8 44.8 46.7 74.7 74.5 74.6 53.8 46.3 74.4 74.7 74.4 53.8 39.8 74.2 74.9 74.1 60.0 40.3 74.4 74.6 76.0 60.8 40.1 65.5 75.4 74.8 67.5 40.2 60.6 74.3 74.9 72.2 40.3 53.0
Warmup runs: 74.6
Removed outliers: (none)
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
Render issues:

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5
Render issues:
- Initial updates: 1
Web Vite - TestList (100 items) render Baseline
Mean: 13.9 ms
Stdev: 0.2 ms (1.5%)
Runs: 13.9 14.0 13.6 13.6 13.7 13.8 13.7 13.9 14.0 14.3
Warmup runs: 19.9
Removed outliers: (none)

Current
Mean: 18.6 ms
Stdev: 0.4 ms (2.4%)
Runs: 18.5 18.2 18.1 18.4 18.4 18.3 18.6 19.1 19.4 19.1
Warmup runs: 25.5
Removed outliers: (none)
Baseline
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1
Render issues:

Current
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2
Render issues:
- Initial updates: 1

Render Issues

Name Initial Updates Redundant Updates
Web Vite - AsyncComponent (10 runs) 1 🔴 -
Web Vite - AsyncComponent (50 runs) 1 🔴 -
Web Vite - TestList (100 items) 1 🔴 -

Added Entries

There are no entries

Removed Entries

There are no entries

Generated by 🚫 dangerJS against 8d8e5e9

@Victorvikson1996
Copy link

How can Use this

@mdjastrzebski
Copy link
Member Author

@Victorvikson1996 you can learn more about Reassure here: docs, GitHub.

@Victorvikson1996
Copy link

Thank you so much @mdjastrzebski

@fabioh8010 fabioh8010 force-pushed the feat/regression-example branch from fc93e6a to 416970d Compare June 5, 2025 15:46
@mdjastrzebski mdjastrzebski force-pushed the feat/regression-example branch from 416970d to 8d8e5e9 Compare July 17, 2025 07:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants