Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: pass test runner options #511

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

mdjastrzebski
Copy link
Member

Summary

Test plan

Copy link

changeset-bot bot commented Jul 3, 2024

⚠️ No Changeset found

Latest commit: 782afb1

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Copy link
Contributor

github-actions bot commented Jul 3, 2024

Performance Comparison Report

  • Current: HEAD (c1bdf32) - 2024-07-03 16:21:03Z
  • Baseline: main (5f9127a) - 2024-07-03 16:20:09Z

Significant Changes To Duration

There are no entries

Meaningless Changes To Duration

Show entries
Name Type Duration Count
Async Component render 101.2 ms → 102.9 ms (+1.7 ms, +1.7%) 7 → 7
fib 30 function 38.7 ms → 37.7 ms (-1.0 ms, -2.5%) 1 → 1
fib 31 function 62.0 ms → 60.0 ms (-1.9 ms, -3.1%) 1 → 1
fib 32 function 98.5 ms → 99.4 ms (+0.8 ms, +0.8%) 1 → 1
InitialRenders 1 render 0.9 ms → 0.7 ms (-0.2 ms, -22.2%) 🟢 2 → 2
InitialRenders 3 render 1.3 ms → 1.2 ms (-0.1 ms, -7.7%) 4 → 4
ManyRenderIssues render 1.5 ms → 1.0 ms (-0.5 ms, -33.3%) 🟢 5 → 5
Other Component 10 render 66.5 ms → 67.7 ms (+1.2 ms, +1.8%) 4 → 4
Other Component 10 legacy scenario render 65.2 ms → 61.7 ms (-3.5 ms, -5.4%) 4 → 4
Other Component 20 render 65.1 ms → 64.9 ms (-0.2 ms, ±0.0%) 4 → 4
RedundantUpdates render 1.0 ms → 1.1 ms (+0.1 ms, +10.0%) 2 → 2
Show details
Name Type Duration Count
Async Component render Baseline
Mean: 101.2 ms
Stdev: 7.5 ms (7.5%)
Runs: 108 92 106 96 110 98 97 113 100 92

Current
Mean: 102.9 ms
Stdev: 5.4 ms (5.2%)
Runs: 95 107 106 106 110 97 99 102 109 98
Baseline
Mean: 7
Stdev: 0 (0.0%)
Runs: 7 7 7 7 7 7 7 7 7 7

Current
Mean: 7
Stdev: 0 (0.0%)
Runs: 7 7 7 7 7 7 7 7 7 7
fib 30 function Baseline
Mean: 38.7 ms
Stdev: 0.8 ms (2.0%)
Runs: 38.5 38.1 36.9 38.4 38.9 39.4 39.4 39.2 39.1 39.0

Current
Mean: 37.7 ms
Stdev: 0.8 ms (2.1%)
Runs: 36.9 38.0 37.0 38.8 38.9 38.5 37.8 36.9 36.8 37.7
Baseline
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1
fib 31 function Baseline
Mean: 62.0 ms
Stdev: 1.5 ms (2.4%)
Runs: 63.0 63.0 63.0 63.0 63.4 62.0 62.7 60.1 59.5 59.9

Current
Mean: 60.0 ms
Stdev: 1.3 ms (2.1%)
Runs: 62.2 62.2 61.0 59.0 59.4 59.6 59.4 59.3 59.0 59.2
Baseline
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1
fib 32 function Baseline
Mean: 98.5 ms
Stdev: 2.3 ms (2.4%)
Runs: 98.0 102.2 100.9 96.3 97.1 100.1 97.0 101.3 95.8 96.8

Current
Mean: 99.4 ms
Stdev: 2.5 ms (2.5%)
Runs: 100.5 98.7 99.5 97.7 104.7 101.0 95.7 97.1 100.2 98.7
Baseline
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1
Stdev: 0 (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1
InitialRenders 1 render Baseline
Mean: 0.9 ms
Stdev: 0.3 ms (35.1%)
Runs: 1 1 1 1 1 1 1 1 0 1

Current
Mean: 0.7 ms
Stdev: 0.5 ms (69.0%)
Runs: 1 1 1 0 1 0 1 1 0 1
Baseline
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2

Current
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2
InitialRenders 3 render Baseline
Mean: 1.3 ms
Stdev: 0.7 ms (51.9%)
Runs: 1 1 2 2 1 1 0 2 2 1

Current
Mean: 1.2 ms
Stdev: 0.8 ms (65.7%)
Runs: 2 0 2 0 2 1 1 1 2 1
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4

Current
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4
ManyRenderIssues render Baseline
Mean: 1.5 ms
Stdev: 0.8 ms (56.7%)
Runs: 3 2 2 0 1 1 2 1 2 1

Current
Mean: 1.0 ms
Stdev: 0.8 ms (81.6%)
Runs: 2 0 0 1 0 1 1 2 2 1
Baseline
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5

Current
Mean: 5
Stdev: 0 (0.0%)
Runs: 5 5 5 5 5 5 5 5 5 5
Other Component 10 render Baseline
Mean: 66.5 ms
Stdev: 4.3 ms (6.5%)
Runs: 68 66 65 67 65 68 61 70 60 75

Current
Mean: 67.7 ms
Stdev: 3.7 ms (5.4%)
Runs: 65 71 67 70 62 72 66 64 67 73
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4

Current
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4
Other Component 10 legacy scenario render Baseline
Mean: 65.2 ms
Stdev: 4.6 ms (7.1%)
Runs: 63 57 66 63 67 71 67 60 66 72

Current
Mean: 61.7 ms
Stdev: 3.2 ms (5.2%)
Runs: 57 58 63 65 64 57 65 61 63 64
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4

Current
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4
Other Component 20 render Baseline
Mean: 65.1 ms
Stdev: 4.5 ms (6.8%)
Runs: 61 62 63 67 66 65 70 56 67 69 64 66 67 68 76 66 66 65 61 57

Current
Mean: 64.9 ms
Stdev: 4.7 ms (7.3%)
Runs: 66 64 64 69 60 61 61 69 71 66 66 61 65 77 63 60 59 59 66 71
Baseline
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4

Current
Mean: 4
Stdev: 0 (0.0%)
Runs: 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
RedundantUpdates render Baseline
Mean: 1.0 ms
Stdev: 0.9 ms (94.3%)
Runs: 2 1 0 2 0 0 2 2 0 1

Current
Mean: 1.1 ms
Stdev: 1.0 ms (90.4%)
Runs: 2 0 1 2 0 2 2 0 2 0
Baseline
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2

Current
Mean: 2
Stdev: 0 (0.0%)
Runs: 2 2 2 2 2 2 2 2 2 2

Render Count Changes

There are no entries

Render Issues

Name Initial Updates Redundant Updates
Other Component 10 1 🔴 -
Other Component 10 legacy scenario 1 🔴 -
Other Component 20 1 🔴 -
InitialRenders 1 1 🔴 -
InitialRenders 3 3 🔴 -
RedundantUpdates - 1 (1) 🔴
ManyRenderIssues 2 🔴 2 (3, 4) 🔴
Async Component 1 🔴 -

Added Scenarios

There are no entries

Removed Scenarios

There are no entries

Generated by 🚫 dangerJS against 782afb1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant