Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stop using cache for the benchmark job #7706

Merged
merged 1 commit into from
Oct 1, 2023

Conversation

sarutak
Copy link
Member

@sarutak sarutak commented Sep 30, 2023

Which issue does this PR close?

Closes #7705

Rationale for this change

To recover CI.

What changes are included in this PR?

#7678 introduces actions/cache for two GA jobs but a cache for the benchmark job seems large, and this can take up the space.
So, this PR proposes to stop using the cache for the benchmark job.

Are these changes tested?

Done by GA.

Are there any user-facing changes?

No.

@sarutak
Copy link
Member Author

sarutak commented Oct 1, 2023

#7705 seems not to happen with #7708.
But there is room to consider removing the cache for the benchmark job because the job is no longer the critical path.

Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @sarutak 🙏

This change does indeed make the benchmark verify test take longer (as expected):

Screenshot 2023-10-01 at 6 31 33 AM

I wonder if we are gaining anything from the caching 🤔 When I have played around with caching before, I could never really make a difference

@alamb
Copy link
Contributor

alamb commented Oct 1, 2023

Merging to get CI green

@alamb alamb merged commit 5d522fb into apache:main Oct 1, 2023
23 checks passed
Ted-Jiang pushed a commit to Ted-Jiang/arrow-datafusion that referenced this pull request Oct 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CI fails due to no space left
2 participants