Skip to content

[FEAT] Add docker options for CPU only, Intel GPU, AMD GPU#5380

Merged
oobabooga merged 34 commits into
oobabooga:devfrom
smCloudInTheSky:main
Jan 28, 2024
Merged

[FEAT] Add docker options for CPU only, Intel GPU, AMD GPU#5380
oobabooga merged 34 commits into
oobabooga:devfrom
smCloudInTheSky:main

Conversation

@smCloudInTheSky
Copy link
Copy Markdown
Contributor

I've tried to create Dockerfile and docker-compose for each environment that was missing using the install script from the project.

I've tested the AMD and CPU only image for now. Will try to test the intel one using the iGPUof my laptop.

If this seems fine to be merged I'll maybe change the NVIDIA Dockerfile to unify them.

Checklist:

oobabooga and others added 30 commits December 14, 2023 22:39
@oobabooga
Copy link
Copy Markdown
Owner

This is a great addition to the repository and it can be merged, yes.

If this seems fine to be merged I'll maybe change the NVIDIA Dockerfile to unify them.

I'll wait for that then. I don't use docker and have no way of testing the changes, but once you tell me the PR is ready I can merge it.

@smCloudInTheSky
Copy link
Copy Markdown
Contributor Author

smCloudInTheSky commented Jan 28, 2024

@oobabooga done !

I've tested on a laptop with a small nvidia GPU. I was able to offload mistral on it so it should be good to go !

I've found some mistake from my parts in the READme I've fixed (good to have a spare laptop to test things following README to find typos)

If there is any issues with my PR reported by the community I'll be happy to test and fix them

@oobabooga
Copy link
Copy Markdown
Owner

Looks good, thank you. If you can think of any further improvements, feel free to submit new PRs.

@oobabooga oobabooga merged commit b1463df into oobabooga:dev Jan 28, 2024
PoetOnTheRun pushed a commit to PoetOnTheRun/text-generation-webui that referenced this pull request Feb 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants