[Obs AI Assistant] Add knowledge base migration test to the serverless test suite

[viduni94]

Closes #205537

Summary

The knowledge base migration test suite is missing in serverless. This PR adds it to the serverless test suite.

• This has a dependancy to Observability AI Assistant Tests Deployment Agnostic #205194 since we are removing all serverless tests and adding them to DA tests.
• If the DA tests PR gets merged first, I'll refactor this PR to add it there.

Checklist

• Flaky Test Runner was used on any tests changed
• The PR description includes the appropriate Release Notes section, and the correct release_note:* label is applied per the guidelines

[elasticmachine]

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

[viduni94]

I added this tag because this test fails in MKI due to a security exception:

This security exception is caused by await esArchiver.load(archive);

debg Requesting url (redacted): [https://keepvuw-serverless-mki-testing-bf2788.kb.eu-west-1.aws.qa.elastic.cloud/api/status]
         │ info [x-pack/test/functional/es_archives/observability/ai_assistant/knowledge_base_8_15] Loading "mappings.json"
         │ info [x-pack/test/functional/es_archives/observability/ai_assistant/knowledge_base_8_15] Loading "data.json.gz"
         └- ✖ fail: Observability AI Assistant API tests knowledge_base/knowledge_base_migration.spec.ts When there are knowledge base entries (from 8.15 or earlier) that does not contain semantic_text embeddings "before all" hook in "When there are knowledge base entries (from 8.15 or earlier) that does not contain semantic_text embeddings"
         │      ResponseError: security_exception
         │ 	Root causes:
         │ 		security_exception: action [indices:admin/settings/update] is unauthorized for user [testing-internal] with effective roles [superuser] on restricted indices [.kibana_security_solution_1,.kibana_task_manager_1,.kibana_alerting_cases_1,.kibana_usage_counters_1,.kibana_1,.kibana_ingest_1,.kibana_analytics_1], this action is granted by the index privileges [manage,all]

[kibanamachine]

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7648

[❌] x-pack/test_serverless/api_integration/test_suites/observability/ai_assistant/config.ts: 131/200 tests passed.

see run history

[sorenlouv]

This has a dependancy to #205194 since we are removing all serverless tests and adding them to DA tests.

Does this mean you won't merge this until the deployment agnostic testing environment is available? And then move this over to that environment? I think that's the right approach.

[viduni94]

This has a dependancy to #205194 since we are removing all serverless tests and adding them to DA tests.

Does this mean you won't merge this until the deployment agnostic testing environment is available? And then move this over to that environment? I think that's the right approach.

Hey @sorenlouv
Yes that's what I was thinking.

[elasticmachine]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: aa7de68

Failed CI Steps

• Jest Tests #5

Metrics [docs]

✅ unchanged

History

• 💔 Build #264493 failed c32cb2fcca87d91847ee5acddd6c6db18ccf7fd4
• 💔 Build #264459 failed 60287e4dd40d0bbf2f1c72446eca9e18edcb6cde

cc @viduni94

[kibanamachine]

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7655

[❌] x-pack/test_serverless/api_integration/test_suites/observability/ai_assistant/config.ts: 119/150 tests passed.

see run history

[neptunian]

Does this mean you won't merge this until the deployment agnostic testing environment is available? And then move this over to that environment? I think that's the right approach.

@sorenlouv or we can merge it now and have arturo move it over in his PR. That way we could remove all the serverless environment like the api client in that PR.

[sorenlouv]

@sorenlouv or we can merge it now and have arturo move it over in his PR. That way we could remove all the serverless environment like the api client in that PR.

Sgtm. What I'm a little worried about is having duplicate tests that will eventually drift apart and thus increase the maintenance cost. Let's aim to move this to the agnostic environment asap.

[kibanamachine]

Starting backport for target branches: 8.x

https://github.com/elastic/kibana/actions/runs/12662534084

[kibanamachine]

💚 All backports created successfully

Status	Branch	Result
✅	8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation