Skip to content

Update Dockerfile to reflect how to compile bnb from source #1437

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
younesbelkada merged 15 commits into from
Feb 7, 2024
Merged

Update Dockerfile to reflect how to compile bnb from source #1437

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
2a81abc
Update Dockerfile
younesbelkada Feb 5, 2024
1ac22f9
Update Dockerfile
younesbelkada Feb 5, 2024
c682b08
Update build_docker_images.yml
younesbelkada Feb 5, 2024
e08683b
Update build_docker_images.yml
younesbelkada Feb 5, 2024
b844b78
Update Dockerfile
younesbelkada Feb 5, 2024
7215232
Update Dockerfile
younesbelkada Feb 5, 2024
88d7be4
add cmake to dockerfile
younesbelkada Feb 5, 2024
1baaacd
use pip install instead
younesbelkada Feb 5, 2024
46a81da
Update Dockerfile
younesbelkada Feb 6, 2024
ea7b941
Update Dockerfile
younesbelkada Feb 6, 2024
c8ce05b
Update Dockerfile
younesbelkada Feb 6, 2024
7b81850
Update Dockerfile
younesbelkada Feb 6, 2024
de5e6e2
final fix
younesbelkada Feb 6, 2024
7758308
Merge branch 'younesbelkada-patch-2' of https://github.com/huggingfac…
younesbelkada Feb 6, 2024
aac412e
Update .github/workflows/build_docker_images.yml
younesbelkada Feb 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions docker/peft-gpu-bnb-latest/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ RUN chsh -s /bin/bash
SHELL ["/bin/bash", "-c"]

# Stage 2
FROM nvidia/cuda:12.2.2-devel-ubuntu22.04 AS build-image
FROM nvidia/cuda:12.1.0-devel-ubuntu22.04 AS build-image
COPY --from=compile-image /opt/conda /opt/conda
ENV PATH /opt/conda/bin:$PATH

Expand All @@ -40,7 +40,7 @@ SHELL ["/bin/bash", "-c"]

# Install apt libs
RUN apt-get update && \
apt-get install -y curl git wget && \
apt-get install -y curl git wget cmake && \
apt-get clean && \
rm -rf /var/lib/apt/lists*

Expand All @@ -57,8 +57,9 @@ RUN source activate peft && \
optimum \
auto-gptq && \
git clone https://github.com/TimDettmers/bitsandbytes && cd bitsandbytes && \
CUDA_VERSION=121 make cuda12x && \
python setup.py develop && \
cmake -B . -DCOMPUTE_BACKEND=cuda -S . && \
cmake --build . && \
pip install -e . && \
pip freeze | grep bitsandbytes

RUN echo "source activate peft" >> ~/.profile
Expand Down
9 changes: 5 additions & 4 deletions docker/peft-gpu-bnb-source/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ RUN chsh -s /bin/bash
SHELL ["/bin/bash", "-c"]

# Stage 2
FROM nvidia/cuda:12.2.2-devel-ubuntu22.04 AS build-image
FROM nvidia/cuda:12.1.0-devel-ubuntu22.04 AS build-image
COPY --from=compile-image /opt/conda /opt/conda
ENV PATH /opt/conda/bin:$PATH

Expand All @@ -40,7 +40,7 @@ SHELL ["/bin/bash", "-c"]

# Install apt libs
RUN apt-get update && \
apt-get install -y curl git wget && \
apt-get install -y curl git wget cmake && \
apt-get clean && \
rm -rf /var/lib/apt/lists*

Expand All @@ -57,8 +57,9 @@ RUN source activate peft && \
optimum \
auto-gptq && \
git clone https://github.com/TimDettmers/bitsandbytes && cd bitsandbytes && \
CUDA_VERSION=121 make cuda12x && \
python setup.py develop && \
cmake -B . -DCOMPUTE_BACKEND=cuda -S . && \
cmake --build . && \
pip install -e . && \
pip freeze | grep bitsandbytes

RUN echo "source activate peft" >> ~/.profile
Expand Down