Skip to content

[OpenAI Extension] Embeddings Endpoint#4895

Merged
oobabooga merged 4 commits into
oobabooga:devfrom
Heimlock:main
Dec 15, 2023
Merged

[OpenAI Extension] Embeddings Endpoint#4895
oobabooga merged 4 commits into
oobabooga:devfrom
Heimlock:main

Conversation

@Heimlock
Copy link
Copy Markdown
Contributor

Checklist:

Description:

  • This pull requests makes fixes on the OpenAI Extension, on the Embeddings Endpoint;
  • Adds the missing package requirement "sentence-transformers" used in this data flow;
  • Fix the "EmbeddingsRequest" Model to accetp all the supported input types described on the OpenAI API;

Heimlock and others added 4 commits December 11, 2023 23:50
…rs" related to Embeddings Endpoint

The given package is used on the Embeddings data processing flow but was not properly refenrenced at the file "extensions/openai/requirements.txt";
…ingRequest" Model

- Following the OpenAI API especification the Embeddings endpoint supports Strings, Array of Strings, Array of Integers and Array of Arrays containing Integers;
- Without this declaration on the "EmbeddingsRequest" Model, external integrations, as Langchain, became incompatible as the Flask Server refuses requests with invalid formats;
- Reference: https://platform.openai.com/docs/api-reference/embeddings/create
@oobabooga
Copy link
Copy Markdown
Owner

sentence-transformers is intentionally left out because it breaks the one-click installer for Intel Arc GPUs.

@oobabooga oobabooga changed the base branch from main to dev December 15, 2023 03:26
@oobabooga oobabooga merged commit 11f082e into oobabooga:dev Dec 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants