Skip to content

Conversation

@jonathan-buttner
Copy link
Contributor

@jonathan-buttner jonathan-buttner commented Jan 10, 2025

This PR adds a new task type chat_completion which is specifically used for OpenAI and the ElasticInferenceService for the new unified API.

I also fixed a test that was muted by reworking the InferenceCRUDIT tests.

Fixes: #119959

@jonathan-buttner jonathan-buttner added :ml Machine learning Team:ML Meta label for the ML team auto-backport Automatically create backport pull requests when merged Feature:GenAI Features around GenAI v9.0.0 v8.18.0 labels Jan 10, 2025
@jonathan-buttner jonathan-buttner marked this pull request as ready for review January 13, 2025 15:29
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@jonathan-buttner jonathan-buttner merged commit f9a3721 into elastic:main Jan 15, 2025
16 checks passed
@jonathan-buttner jonathan-buttner deleted the ml-chat-completion-task-type branch January 15, 2025 17:59
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.x Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 119982

@jonathan-buttner
Copy link
Contributor Author

💚 All backports created successfully

Status Branch Result
8.x

Questions ?

Please refer to the Backport tool documentation

jonathan-buttner added a commit to jonathan-buttner/elasticsearch that referenced this pull request Jan 15, 2025
…9982)

* Creating new chat completion task type

* Adding some comments

* Refactoring names and removing todo

* Exposing chat completion for openai and eis for now

* Fixing tests

(cherry picked from commit f9a3721)

# Conflicts:
#	muted-tests.yml
#	x-pack/plugin/inference/qa/inference-service-tests/src/javaRestTest/java/org/elasticsearch/xpack/inference/InferenceCrudIT.java
#	x-pack/plugin/inference/src/test/java/org/elasticsearch/xpack/inference/Utils.java
jonathan-buttner added a commit that referenced this pull request Jan 16, 2025
) (#120224)

* [ML] Adding new chat_completion task type for unified API (#119982)

* Creating new chat completion task type

* Adding some comments

* Refactoring names and removing todo

* Exposing chat completion for openai and eis for now

* Fixing tests

(cherry picked from commit f9a3721)

# Conflicts:
#	muted-tests.yml
#	x-pack/plugin/inference/qa/inference-service-tests/src/javaRestTest/java/org/elasticsearch/xpack/inference/InferenceCrudIT.java
#	x-pack/plugin/inference/src/test/java/org/elasticsearch/xpack/inference/Utils.java

* Fixing addFirst

* Fixing test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged backport pending Feature:GenAI Features around GenAI :ml Machine learning >refactoring Team:ML Meta label for the ML team v8.18.0 v9.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CI] InferenceCrudIT testGetServicesWithCompletionTaskType failing

3 participants