Skip to content

[8.x] Add base FTR test coverage for inference APIs (#198000)#202916

Merged
pgayvallet merged 5 commits intoelastic:8.xfrom
pgayvallet:backport/8.x/pr-198000
Dec 5, 2024
Merged

[8.x] Add base FTR test coverage for inference APIs (#198000)#202916
pgayvallet merged 5 commits intoelastic:8.xfrom
pgayvallet:backport/8.x/pr-198000

Conversation

@pgayvallet
Copy link
Copy Markdown
Contributor

Backport

This will backport the following commits from main to 8.x:

Questions ?

Please refer to the Backport tool documentation

## Summary

Part of elastic/kibana-team#1271

This PR introduces the first set of end to end integration test for the
inference APIs, and the tooling required to do so (see issue for more
context)

- Add a dedicated pipeline for ai-infra GenAI tests. pipeline is
triggered when:
  - genAI stack connectors, or ai-infra owned code is changed
  - when the `ci:all-gen-ai-suites` label is present on a PR
  - on merge
- adapt the `ftr_configs.sh` script to load GenAI connector
configuration from vault when a specific var env is set
- create the `@kbn/gen-ai-functional-testing` package, which for now
only contains utilities to load the GenAI connector configuration in FTR
tests
- Add FTR integration tests for the `chatComplete` API of the
`inference` plugin

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit 14ad13b)

# Conflicts:
#	.buildkite/pipelines/on_merge.yml
#	.github/CODEOWNERS
@pgayvallet pgayvallet added the backport This PR is a backport of another PR label Dec 4, 2024
@pgayvallet pgayvallet enabled auto-merge (squash) December 4, 2024 13:18
@pgayvallet pgayvallet merged commit 4ffcaed into elastic:8.x Dec 5, 2024
@elasticmachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/gen-ai-functional-testing - 8 +8
@kbn/sse-utils-server 2 3 +1
total +9
Unknown metric groups

API count

id before after diff
@kbn/gen-ai-functional-testing - 10 +10
@kbn/sse-utils-server 2 4 +2
total +12

ESLint disabled line counts

id before after diff
@kbn/gen-ai-functional-testing - 2 +2
@kbn/test-suites-xpack 727 729 +2
total +4

Total ESLint disabled count

id before after diff
@kbn/gen-ai-functional-testing - 2 +2
@kbn/test-suites-xpack 752 754 +2
total +4

History

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport This PR is a backport of another PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants