Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Build timeouts after ccache added #11564

Closed
lebeg opened this issue Jul 5, 2018 · 3 comments
Closed

Build timeouts after ccache added #11564

lebeg opened this issue Jul 5, 2018 · 3 comments
Labels

Comments

@lebeg
Copy link
Contributor

lebeg commented Jul 5, 2018

Some rare build failures occur after the addition of ccache. Sample:

http://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/incubator-mxnet/branches/PR-11486/runs/1/nodes/57/log/?start=0

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/PR-11486/1/pipeline/

The builds are hitting the Jenkin's timeout as the task fails at exactly the 2h mark.

The machine will probably have a running container until it's down-scaled due to the zombie container bug.

Adding build retries and lowering the Jenkins build timeout should improve the situation.

@andrewfayres
Copy link
Contributor

@sandeep-krishnamurthy requesting this be CI

@szha szha added the CI label Jul 5, 2018
@szha
Copy link
Member

szha commented Jul 5, 2018

@marcoabreu you're probably interested.

@lebeg
Copy link
Contributor Author

lebeg commented Sep 3, 2018

Zombie container issue has been resolved with #12381. Retries had been added with #11877. Issue should be resolved.

@lebeg lebeg closed this as completed Sep 3, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

3 participants