Disable CUDA 11.1 builds (#5477)#5478

atalman merged 1 commit intopytorch:release/0.12pytorch/vision:release/0.12from

atalman:vision_cherry_pickatalman/vision:vision_cherry_pickCopy head branch name to clipboard