[FEAT] Add docker options for CPU only, Intel GPU, AMD GPU#5380
Conversation
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch
Merge dev branch (oobabooga#5257)
Merge dev branch
Merge dev branch
Merge dev branch
|
This is a great addition to the repository and it can be merged, yes.
I'll wait for that then. I don't use docker and have no way of testing the changes, but once you tell me the PR is ready I can merge it. |
|
@oobabooga done ! I've tested on a laptop with a small nvidia GPU. I was able to offload mistral on it so it should be good to go ! I've found some mistake from my parts in the READme I've fixed (good to have a spare laptop to test things following README to find typos) If there is any issues with my PR reported by the community I'll be happy to test and fix them |
|
Looks good, thank you. If you can think of any further improvements, feel free to submit new PRs. |
I've tried to create Dockerfile and docker-compose for each environment that was missing using the install script from the project.
I've tested the AMD and CPU only image for now. Will try to test the intel one using the iGPUof my laptop.
If this seems fine to be merged I'll maybe change the NVIDIA Dockerfile to unify them.
Checklist: