Skip to content

Conversation

MichaelFu512
Copy link
Contributor

@MichaelFu512 MichaelFu512 commented May 16, 2024

Pull Request Description

Closes #4420 and Closes #4394

After creating the pull request: in order to pass the release_notes_updated check you will need to update the "Future Release" section of docs/source/release_notes.rst to include this pull request by adding :pr:123.

@codecov
Copy link

codecov bot commented May 16, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 99.7%. Comparing base (80ccb4d) to head (2b11a69).
Report is 17 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##            main   #4423     +/-   ##
=======================================
+ Coverage   99.7%   99.7%   +0.1%     
=======================================
  Files        352     352             
  Lines      39805   39804      -1     
=======================================
+ Hits       39682   39683      +1     
+ Misses       123     121      -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

"--single-process",
"--headless",
"--disable-gpu",
)
Copy link
Contributor Author

@MichaelFu512 MichaelFu512 May 21, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Originally these were only meant for mac m1 tests to pass, but windows tests also needs these settings for testing, else some tests hang forever, causing workers to fail.

@MichaelFu512 MichaelFu512 changed the title Fix install test Fix install test and uncap kaleido May 21, 2024
- name: Install evalml from sdist (using cache)
if: steps.cache.outputs.cache-hit == 'true'
run: |
python -m pip install "unpacked_sdist/." --no-deps
Copy link
Contributor Author

@MichaelFu512 MichaelFu512 May 21, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Whenever the install_tests would use cache, the test would fail.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, do you think it's noticably slower since we're not using the cache? If so, by how much?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interestingly the time it takes varies.

The latest commit (2b11a69) has the time that ubuntu takes for this step to be 8 seconds. For MacOS it takes 40 seconds for python3.9 and 3 minutes for python3.11.

Conversely, the second latest commit (cd3f4f8) has the time that ubuntu takes hover around 1 minute. MacOS hovers at around 40 seconds.

I can't say for sure how much slower it is without cache because it didn't work with cache enabled. I can go test to see if I can get cache working (hopefully it doesn't erase the approvals).

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FWIW, I was having trouble with caches in other OS repos recently and ended up removing them because they were failing too often.

@MichaelFu512 MichaelFu512 changed the title Fix install test and uncap kaleido Fix install test and uncap kaleido + various others May 21, 2024
@MichaelFu512 MichaelFu512 marked this pull request as ready for review May 21, 2024 22:32
Copy link
Contributor

@christopherbunn christopherbunn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Single (non-blocking) question, LGTM

- name: Install evalml from sdist (using cache)
if: steps.cache.outputs.cache-hit == 'true'
run: |
python -m pip install "unpacked_sdist/." --no-deps
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, do you think it's noticably slower since we're not using the cache? If so, by how much?

@MichaelFu512 MichaelFu512 merged commit d7e6e72 into main May 22, 2024
@MichaelFu512 MichaelFu512 deleted the install_test_fix branch May 22, 2024 20:43
@MichaelFu512 MichaelFu512 changed the title Fix install test and uncap kaleido + various others Fix install test and uncap kaleido May 22, 2024
This was referenced Jun 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix install tests Bump up minimum kaleido version to 0.2.1

4 participants