-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Integrate storywright for story tests - As part of exploring screener alternative #25399
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
This pull request is automatically built and testable in CodeSandbox. To see build info of the built libraries, click here or the icon next to each commit SHA. Latest deployment of this branch, based on commit 6d0a36b:
|
Asset size changesSize Auditor did not detect a change in bundle size for any component! Baseline commit: 870f51fc39736198871559d6e12ece5663b0525f (build) |
Perf Analysis (
|
| Scenario | Render type | Master Ticks | PR Ticks | Iterations | Status |
|---|---|---|---|---|---|
| Avatar | mount | 1299 | 1312 | 5000 | |
| Button | mount | 950 | 948 | 5000 | |
| FluentProvider | mount | 1584 | 1591 | 5000 | |
| FluentProviderWithTheme | mount | 616 | 636 | 10 | |
| FluentProviderWithTheme | virtual-rerender | 593 | 594 | 10 | |
| FluentProviderWithTheme | virtual-rerender-with-unmount | 626 | 633 | 10 | |
| MakeStyles | mount | 1903 | 1906 | 50000 | |
| SpinButton | mount | 2554 | 2544 | 5000 |
📊 Bundle size reportUnchanged fixtures
|
Perf Analysis (
|
| Scenario | Current PR Ticks | Baseline Ticks | Ratio |
|---|---|---|---|
| PortalMinimalPerf.default | 186 | 171 | 1.09:1 |
| TreeWith60ListItems.default | 188 | 174 | 1.08:1 |
| AvatarMinimalPerf.default | 217 | 204 | 1.06:1 |
| ChatDuplicateMessagesPerf.default | 304 | 286 | 1.06:1 |
| GridMinimalPerf.default | 383 | 361 | 1.06:1 |
| HeaderMinimalPerf.default | 412 | 389 | 1.06:1 |
| ReactionMinimalPerf.default | 437 | 412 | 1.06:1 |
| RefMinimalPerf.default | 225 | 213 | 1.06:1 |
| AccordionMinimalPerf.default | 168 | 160 | 1.05:1 |
| DropdownManyItemsPerf.default | 772 | 736 | 1.05:1 |
| FormMinimalPerf.default | 437 | 415 | 1.05:1 |
| ListMinimalPerf.default | 580 | 555 | 1.05:1 |
| StatusMinimalPerf.default | 773 | 734 | 1.05:1 |
| RadioGroupMinimalPerf.default | 497 | 479 | 1.04:1 |
| SkeletonMinimalPerf.default | 398 | 383 | 1.04:1 |
| TextAreaMinimalPerf.default | 566 | 542 | 1.04:1 |
| CardMinimalPerf.default | 615 | 597 | 1.03:1 |
| LayoutMinimalPerf.default | 405 | 392 | 1.03:1 |
| ListWith60ListItems.default | 684 | 664 | 1.03:1 |
| IconMinimalPerf.default | 773 | 748 | 1.03:1 |
| AnimationMinimalPerf.default | 577 | 563 | 1.02:1 |
| AttachmentMinimalPerf.default | 172 | 168 | 1.02:1 |
| AttachmentSlotsPerf.default | 1218 | 1191 | 1.02:1 |
| ButtonSlotsPerf.default | 618 | 607 | 1.02:1 |
| DividerMinimalPerf.default | 395 | 387 | 1.02:1 |
| DropdownMinimalPerf.default | 2872 | 2808 | 1.02:1 |
| ItemLayoutMinimalPerf.default | 1327 | 1301 | 1.02:1 |
| MenuButtonMinimalPerf.default | 1887 | 1855 | 1.02:1 |
| RosterPerf.default | 2418 | 2363 | 1.02:1 |
| ProviderMinimalPerf.default | 425 | 417 | 1.02:1 |
| TextMinimalPerf.default | 378 | 372 | 1.02:1 |
| VideoMinimalPerf.default | 820 | 806 | 1.02:1 |
| BoxMinimalPerf.default | 375 | 372 | 1.01:1 |
| ChatMinimalPerf.default | 810 | 802 | 1.01:1 |
| CheckboxMinimalPerf.default | 2306 | 2291 | 1.01:1 |
| DatepickerMinimalPerf.default | 6246 | 6177 | 1.01:1 |
| DialogMinimalPerf.default | 838 | 826 | 1.01:1 |
| FlexMinimalPerf.default | 314 | 311 | 1.01:1 |
| ImageMinimalPerf.default | 448 | 445 | 1.01:1 |
| InputMinimalPerf.default | 1238 | 1227 | 1.01:1 |
| LoaderMinimalPerf.default | 722 | 717 | 1.01:1 |
| SegmentMinimalPerf.default | 388 | 384 | 1.01:1 |
| SliderMinimalPerf.default | 1733 | 1709 | 1.01:1 |
| TableManyItemsPerf.default | 2156 | 2137 | 1.01:1 |
| CustomToolbarPrototype.default | 2811 | 2787 | 1.01:1 |
| TooltipMinimalPerf.default | 2613 | 2590 | 1.01:1 |
| CarouselMinimalPerf.default | 501 | 500 | 1:1 |
| HeaderSlotsPerf.default | 866 | 864 | 1:1 |
| ListCommonPerf.default | 702 | 700 | 1:1 |
| MenuMinimalPerf.default | 925 | 922 | 1:1 |
| PopupMinimalPerf.default | 669 | 667 | 1:1 |
| ProviderMergeThemesPerf.default | 1307 | 1307 | 1:1 |
| SplitButtonMinimalPerf.default | 4813 | 4797 | 1:1 |
| TreeMinimalPerf.default | 893 | 892 | 1:1 |
| ButtonMinimalPerf.default | 181 | 183 | 0.99:1 |
| ButtonOverridesMissPerf.default | 1420 | 1440 | 0.99:1 |
| EmbedMinimalPerf.default | 3982 | 4007 | 0.99:1 |
| ChatWithPopoverPerf.default | 402 | 412 | 0.98:1 |
| TableMinimalPerf.default | 435 | 445 | 0.98:1 |
| AlertMinimalPerf.default | 288 | 297 | 0.97:1 |
| ListNestedPerf.default | 615 | 636 | 0.97:1 |
| ToolbarMinimalPerf.default | 998 | 1039 | 0.96:1 |
| LabelMinimalPerf.default | 407 | 429 | 0.95:1 |
Perf Analysis (
|
| Scenario | Render type | Master Ticks | PR Ticks | Iterations | Status |
|---|---|---|---|---|---|
| BaseButton | mount | 1232 | 1205 | 5000 | |
| Breadcrumb | mount | 3025 | 3052 | 1000 | |
| Checkbox | mount | 2733 | 2763 | 5000 | |
| CheckboxBase | mount | 2452 | 2438 | 5000 | |
| ChoiceGroup | mount | 4431 | 4491 | 5000 | |
| ComboBox | mount | 1283 | 1278 | 1000 | |
| CommandBar | mount | 9949 | 9975 | 1000 | |
| ContextualMenu | mount | 11700 | 11823 | 1000 | |
| DefaultButton | mount | 1413 | 1408 | 5000 | |
| DetailsRow | mount | 3651 | 3730 | 5000 | |
| DetailsRowFast | mount | 3719 | 3639 | 5000 | |
| DetailsRowNoStyles | mount | 3574 | 3499 | 5000 | |
| Dialog | mount | 3183 | 3192 | 1000 | |
| DocumentCardTitle | mount | 593 | 594 | 1000 | |
| Dropdown | mount | 3292 | 3302 | 5000 | |
| FocusTrapZone | mount | 2046 | 2024 | 5000 | |
| FocusZone | mount | 1978 | 2008 | 5000 | |
| GroupedList | mount | 57686 | 64860 | 2 | |
| GroupedList | virtual-rerender | 28232 | 26504 | 2 | |
| GroupedList | virtual-rerender-with-unmount | 95392 | 97072 | 2 | |
| GroupedListV2 | mount | 572 | 577 | 2 | |
| GroupedListV2 | virtual-rerender | 560 | 552 | 2 | |
| GroupedListV2 | virtual-rerender-with-unmount | 573 | 566 | 2 | |
| IconButton | mount | 1964 | 1915 | 5000 | |
| Label | mount | 743 | 752 | 5000 | |
| Layer | mount | 4304 | 4338 | 5000 | |
| Link | mount | 847 | 857 | 5000 | |
| MenuButton | mount | 1712 | 1735 | 5000 | |
| MessageBar | mount | 2389 | 2333 | 5000 | |
| Nav | mount | 3353 | 3352 | 1000 | |
| OverflowSet | mount | 1400 | 1387 | 5000 | |
| Panel | mount | 2636 | 2613 | 1000 | |
| Persona | mount | 1309 | 1323 | 1000 | |
| Pivot | mount | 1674 | 1692 | 1000 | |
| PrimaryButton | mount | 1562 | 1533 | 5000 | |
| Rating | mount | 7170 | 7159 | 5000 | |
| SearchBox | mount | 1528 | 1562 | 5000 | |
| Shimmer | mount | 2901 | 2980 | 5000 | |
| Slider | mount | 2156 | 2137 | 5000 | |
| SpinButton | mount | 4725 | 4797 | 5000 | |
| Spinner | mount | 825 | 826 | 5000 | |
| SplitButton | mount | 3184 | 3151 | 5000 | |
| Stack | mount | 833 | 842 | 5000 | |
| StackWithIntrinsicChildren | mount | 2306 | 2268 | 5000 | |
| StackWithTextChildren | mount | 4797 | 4780 | 5000 | |
| SwatchColorPicker | mount | 10711 | 10808 | 5000 | |
| TagPicker | mount | 2878 | 2671 | 5000 | |
| TeachingBubble | mount | 97366 | 98094 | 5000 | |
| Text | mount | 801 | 819 | 5000 | |
| TextField | mount | 1612 | 1621 | 5000 | |
| ThemeProvider | mount | 1584 | 1570 | 5000 | |
| ThemeProvider | virtual-rerender | 1092 | 1097 | 5000 | |
| ThemeProvider | virtual-rerender-with-unmount | 2164 | 2179 | 5000 | |
| Toggle | mount | 1123 | 1121 | 5000 | |
| buttonNative | mount | 564 | 554 | 5000 |
* master: (22 commits) fix(react-menu): removes exposing of internal type FluentTriggerComponent (microsoft#25410) fix(react-popover): removes exposing of internal type FluentTriggerComponent (microsoft#25411) applying package updates fix(react-tooltip): removes exposing of internal type FluentTriggerComponent (microsoft#25409) chore: Reducing bundle size of Stack by moving selector used in multiple places to local const (microsoft#25429) docs(rfcs): Simple component implementation (microsoft#25139) Fix migration publishing (microsoft#25422) Integrate storywright for story tests - As part of exploring screener alternative (microsoft#25399) fix(react-utilities): exposes internal methods used in API surface (microsoft#25406) fix(react-dialog): removes exposing of internal type FluentTriggerComponent (microsoft#25408) fix(react-context-selector): exposes internal type ContextSelector (microsoft#25404) fix(react-aria): exposes internal leaking types (microsoft#25403) fix(react-shared-contexts): exposes internal leaks used in the API surface (microsoft#25405) fix(react-positioning): exposes new typings to avoid exposing internal methods (microsoft#25407) applying package updates fix: Allowing DatePicker to be focusable within FocusZones by default (microsoft#25428) fix: Pad in slider so the thumb does not render outside the bounds of the root element (microsoft#25378) feat: Add enableScopedSelectors prop to Stack that, when true, makes the Stack styles selectors be more scoped to not be as expensive in style recalculation (microsoft#25397) fix(react-avatar): Remove gaps between AvatarGroupItem/OveflowButton and its outline (microsoft#25382) fix: Combobox text attribute ignored when empty string is passed (microsoft#24665) ...
Current Behavior
Currently all the VR testing is done using screener
New Behavior
Integrate storywright for story tests - This can generate screenshots locally. Later to be integrated with 1JS VR tool for analyzing screenshot diffs
This PR doesnt change anything in existing code or existing pipeline. It add a convert verb which replace screener tags with storywright tag. The 2 pipelines added will run in optional mode
Related Issue(s)
Fixes #