Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI / PR having issues provisioning resources #34647

Closed
jaredpar opened this issue Apr 7, 2020 · 2 comments
Closed

CI / PR having issues provisioning resources #34647

jaredpar opened this issue Apr 7, 2020 · 2 comments
Labels
area-Infrastructure-coreclr blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
Milestone

Comments

@jaredpar
Copy link
Member

jaredpar commented Apr 7, 2020

Builds are failing with the following error message:

##[Error 1]
An error occurred while provisioning resources (Error Type: Disconnect). 

##[Warning 1]
Received request to deprovision: The request was cancelled by the remote provider. 
Build Kind Timeline Record
591699 PR #32107 Libraries Test Run release mono OSX x64 Debug
591368 Rolling Installer Build and Test iOS_x64 Release
591316 Rolling CoreCLR Product Build OSX x64 release
591101 Rolling Installer Build and Test iOS_arm64 Release
590735 Rolling CoreCLR Product Build OSX x64 release
590527 PR #34601 Installer Build and Test iOS_arm64 Debug
590287 Rolling Mono Product Build iOS arm64 release
590193 PR #33608 CoreCLR Product Build OSX x64 checked
590153 PR #34297 CoreCLR Product Build OSX x64 release
590118 PR #34475 Installer Build and Test OSX_x64 Debug
590031 PR #34563 Mono Product Build iOS arm64 debug
589968 PR #32592 CoreCLR Product Build OSX x64 checked

Evaluated 100 builds
Impacted 12 builds
Impacted 12 jobs

@jaredpar jaredpar added the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Apr 7, 2020
@Dotnet-GitSync-Bot Dotnet-GitSync-Bot added area-Infrastructure-coreclr untriaged New issue has not been triaged by the area owner labels Apr 7, 2020
@MattGal
Copy link
Member

MattGal commented Apr 7, 2020

Just got off the IcM bridge with the hosted mac pool folks, and the problem seems to be different than the last time. As noted in https://github.com/dotnet/core-eng/issues/9448, there was a new feature turned on that had a bug and was subsequently turned off; this was not the case here, rather it seems the builds are filling up the disks.

Some more points:

  • The MMS team does not have information on the available disk space of a given MacOS build agent, and even if they did this would change up and down randomly as the workloads installed on the machines are modified and rolled out. They suggest adding some disk usage commands to the beginning of builds so this can be monitored.
  • They suggest "deleting any files you like" as an initial step in build if the size of the build cannot be reduced (not kidding)

@jaredpar
Copy link
Member Author

jaredpar commented Oct 6, 2020

This is a dupe of #34472

@jaredpar jaredpar closed this as completed Oct 6, 2020
@ghost ghost locked as resolved and limited conversation to collaborators Dec 9, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-Infrastructure-coreclr blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
Projects
None yet
Development

No branches or pull requests

4 participants