Add initial support for TEI#40
Closed
ltowarek wants to merge 1 commit into
Closed
Conversation
ltowarek
force-pushed
the
ltowarek/tei
branch
from
43c9873 to
8ee8451
Compare
skaulintel
reviewed
Feb 20, 2024
ltowarek
force-pushed
the
ltowarek/tei
branch
from
8ee8451 to
246d6c6
Compare
bhargaveede
force-pushed
the
habana-main
branch
from
8d30377 to
4cf8089
Compare
ltowarek
requested review from
bhargaveede,
libinta,
mandy-li,
ssarkar2 and
vivekgoe
as code owners
ltowarek
force-pushed
the
ltowarek/tei
branch
from
246d6c6 to
112052e
Compare
Inspired by https://github.com/HabanaAI/optimum-habana-fork/tree/5dc75772f458842863d1b70d80b5c6265022dd1b/text-generation-inference Main changes compared to the upstream: * Enabled python backend with support for HPU * Added Habana PT as a base image * Updated python requirements to match Habana PT image * Removed torch * Added transformers text-embeddings-inference@0.6.0 can't be used as there are missing commits in candle.
ltowarek
force-pushed
the
ltowarek/tei
branch
from
112052e to
9808c77
Compare
Author
|
Moved to huggingface/tei-gaudi#1 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Inspired by https://github.com/HabanaAI/optimum-habana-fork/tree/5dc75772f458842863d1b70d80b5c6265022dd1b/text-generation-inference
Main changes compared to the upstream:
text-embeddings-inference@0.6.0 can't be used as there are missing commits in candle.