-
Couldn't load subscription status.
- Fork 351
[ci-visibility] Change test.type in browser tests
#3358
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Overall package sizeSelf size: 4.79 MB Dependency sizes
🤖 This report was automatically generated by heaviest-objects-in-the-universe |
Codecov Report
@@ Coverage Diff @@
## master #3358 +/- ##
==========================================
- Coverage 84.18% 84.15% -0.04%
==========================================
Files 205 205
Lines 8061 8064 +3
Branches 33 33
==========================================
Hits 6786 6786
- Misses 1275 1278 +3
... and 1 file with indirect coverage changes 📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
good job! Most of the comments are just for moving certain things around, but the logic is good
Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
BenchmarksBenchmark execution time: 2023-07-07 14:48:31 Comparing candidate commit d3f4b18 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 464 metrics, 28 unstable metrics. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we're almost there :-)
additionally, cypress tests are failing because we need to update this https://github.com/DataDog/dd-trace-js/blob/master/packages/datadog-plugin-cypress/test/index.spec.js#L81 and this https://github.com/DataDog/dd-trace-js/blob/master/packages/datadog-plugin-cypress/test/index.spec.js#L106
we could also optionally expand this test integration-tests/playwright/playwright.spec.js to include TEST_TYPE assertion, but that's up to you 😄
Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
test.type in browser tests
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I just noticed that we're missing a TEST_TYPE update in https://github.com/DataDog/dd-trace-js/blob/master/packages/dd-trace/src/plugins/util/test.js#L277.
The tests are correctly set but session, modules and suites are still being reported with test.type='test'
that's why the integration test is failing: https://github.com/DataDog/dd-trace-js/actions/runs/5487302751/jobs/9998579728?pr=3358. Good thing we added that! 😄 |
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
What does this PR do?
Adds a new test type:
browserwhich is only enabled when testing using Cypress or Playwright.Motivation
It adds more flexibility to test types
Plugin Checklist