Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix apt repo issue for docker #3823

Merged
merged 7 commits into from
Oct 6, 2020
Merged

Fix apt repo issue for docker #3823

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
9813eb3
fix docker repo issue
Oct 3, 2020
b411f06
docker
Borda Oct 4, 2020
80be0e0
docker
Borda Oct 4, 2020
3e70d24
docker
Borda Oct 4, 2020
c14f360
no cudnn
Oct 5, 2020
192c13c
no cudnn
Oct 5, 2020
63c7617
try 16.04
Oct 5, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions dockers/base-cuda/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@
ARG CUDNN_VERSION=7
ARG CUDA_VERSION=10.1

FROM nvidia/cuda:${CUDA_VERSION}-cudnn${CUDNN_VERSION}-devel
FROM nvidia/cuda:${CUDA_VERSION}-cudnn${CUDNN_VERSION}-devel-ubuntu18.04
# FROM nvidia/cuda:${CUDA_VERSION}-devel

ARG PYTHON_VERSION=3.7
Expand All @@ -34,7 +34,7 @@ SHELL ["/bin/bash", "-c"]

ENV PATH="$PATH:/root/.local/bin"

RUN apt-get update && apt-get install -y --no-install-recommends \
RUN apt-get clean && apt-get update && apt-get install -y --no-install-recommends \
Copy link
Member

@Borda Borda Oct 3, 2020 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems strange, you need update before install not clean..

Suggested change
RUN apt-get clean && apt-get update && apt-get install -y --no-install-recommends \
RUN apt-get update && apt-get install -y --no-install-recommends \

Copy link
Contributor Author

@ydcjeff ydcjeff Oct 4, 2020 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Turns out it's CDN issue, some suggest clean and update
but let's wait and see if CDN update can solve this

NVIDIA/nvidia-docker#1392
NVIDIA/nvidia-docker#877
NVIDIA/nvidia-docker#1328

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, the problem is in

Reading package lists...
E: Failed to fetch https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64/Packages.gz  File has unexpected size (47871 != 49498). Mirror sync in progress? [IP: 152.195.19.142 443]
   Hashes of expected file:
    - Filesize:49498 [weak]
    - SHA256:332f3ee4e353b8a5e5a2bdd8fdbd47cf140c73822b82b328815f122e09e195a0
    - SHA1:4dc8ef9a3ee3c97b3c26d46e07fdd83997e6880b [weak]
    - MD5Sum:bbff3b9c3462257479d72521ee78ec29 [weak]
   Release file created at: Wed, 23 Sep 2020 22:09:13 +0000
E: Some index files failed to download. They have been ignored, or old ones used instead.

not the update step...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That comes from this, I think

Get:10 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Packages [49.5 kB]
Err:10 https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64  Packages
  File has unexpected size (47871 != 49498). Mirror sync in progress? [IP: 152.195.19.142 443]
  Hashes of expected file:
   - Filesize:49498 [weak]
   - SHA256:332f3ee4e353b8a5e5a2bdd8fdbd47cf140c73822b82b328815f122e09e195a0
   - SHA1:4dc8ef9a3ee3c97b3c26d46e07fdd83997e6880b [weak]
   - MD5Sum:bbff3b9c3462257479d72521ee78ec29 [weak]
  Release file created at: Wed, 23 Sep 2020 22:09:13 +0000

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so skip of the update is just hiding the NVIDIA package issue not solving it.. :[

build-essential \
cmake \
git \
Expand Down
2 changes: 1 addition & 1 deletion dockers/base-xla/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ ENV CONDA_ENV=lightning
# show system inforation
RUN lsb_release -a && cat /etc/*-release

RUN apt-get update && \
RUN apt-get clean && apt-get update && \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
RUN apt-get clean && apt-get update && \
RUN apt-get update && \

apt-get install -y --no-install-recommends \
build-essential \
cmake \
Expand Down