Skip to content

Conversation

@zeroshade
Copy link
Member

@zeroshade zeroshade commented Dec 12, 2022

With the added benchmarking running, the Go workflows occasionally take longer than the 30 minutes, so we need to increase the workflow timeout time.

@zeroshade zeroshade requested a review from assignUser December 12, 2022 17:10
@pitrou
Copy link
Member

pitrou commented Dec 12, 2022

Uh, we run benchmarks on CI builds?

@zeroshade
Copy link
Member Author

@pitrou via conbench, @jonkeane and @alistaire47 can explain more as it was their request to set it up this way.

@pitrou
Copy link
Member

pitrou commented Dec 12, 2022

But are trusting GH runners to provide stable runtimes?

@alistaire47
Copy link
Contributor

Jon's on PTO at the moment, but AFAIK this setup is a fairly temporary state of affairs. I'm in the middle of a larger project to rearrange how we run benchmarks, and hopefully before too long it won't be too hard to run this through arrow-benchmarks-ci like the rest of the benchmarks (though we'll have to figure out what machines make sense given capacity on that side). Not sure exactly when that will be ready, but likely Jan-Feb.

And this is all based on my assumptions; if Jon says otherwise, I defer to them.

Copy link
Member

@assignUser assignUser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be ok with the current CI capacity 👍

@zeroshade zeroshade merged commit 624efd0 into apache:master Dec 13, 2022
@zeroshade zeroshade deleted the go-workflow-timeout branch December 13, 2022 21:35
@kou
Copy link
Member

kou commented Dec 14, 2022

It seems that this doesn't solve the problem: https://github.com/apache/arrow/actions/runs/3689554605

For example: https://github.com/apache/arrow/actions/runs/3689554605/jobs/6245623568#step:7:1134

*** Test killed with quit: ran too long (11m0s).

@ursabot
Copy link

ursabot commented Dec 14, 2022

Benchmark runs are scheduled for baseline = 56cf063 and contender = 624efd0. 624efd0 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Finished ⬇️0.34% ⬆️0.03%] test-mac-arm
[Finished ⬇️0.27% ⬆️0.27%] ursa-i9-9960x
[Finished ⬇️0.7% ⬆️0.31%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 624efd0e ec2-t3-xlarge-us-east-2
[Finished] 624efd0e test-mac-arm
[Finished] 624efd0e ursa-i9-9960x
[Finished] 624efd0e ursa-thinkcentre-m75q
[Finished] 56cf063b ec2-t3-xlarge-us-east-2
[Finished] 56cf063b test-mac-arm
[Finished] 56cf063b ursa-i9-9960x
[Finished] 56cf063b ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants