elastic · dmlemeshko · Sep 10, 2025 · Aug 25, 2025 · Sep 10, 2025
@@ -1254,11 +1254,18 @@ x-pack/solutions/observability/plugins/observability/server/lib/esql_extensions
 
 
 # Observability UI
-/x-pack/test_serverless/api_integration/test_suites/observability/config.ts @elastic/observability-ui @elastic/appex-qa
-/x-pack/test_serverless/api_integration/test_suites/observability/index.ts @elastic/observability-ui
-/x-pack/test_serverless/api_integration/test_suites/observability/config.logs_essentials.ts @elastic/observability-ui @elastic/appex-qa
-/x-pack/test_serverless/api_integration/test_suites/observability/index.logs_essentials.ts @elastic/observability-ui
-/x-pack/test_serverless/api_integration/test_suites/observability/logs_essentials_only @elastic/observability-ui
+/x-pack/solutions/observability/test/README.md @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/README.md @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/api_integration/ftr_provider_context.d.ts @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/api_integration/services/ @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/api_integration/configs/config.ts @elastic/observability-ui @elastic/appex-qa
+/x-pack/solutions/observability/test/serverless/api_integration/configs/index.ts @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/api_integration/configs/config.logs_essentials.ts @elastic/observability-ui @elastic/appex-qa
+/x-pack/solutions/observability/test/serverless/api_integration/configs/index.logs_essentials.ts @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/api_integration/test_suites/logs_essentials_only @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/functional/services/ @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/functional/page_objects/ @elastic/observability-ui
+/x-pack/solutions/observability/test/serverless/functional/ftr_provider_context.d.ts @elastic/observability-ui
 /x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/serverless/oblt.logs_essentials.index.ts @elastic/observability-ui
 /x-pack/platform/test/api_integration_deployment_agnostic/configs/serverless/oblt.logs_essentials.serverless.config.ts @elastic/observability-ui
 /x-pack/solutions/observability/test/kibana.jsonc @elastic/observability-ui
@@ -1791,10 +1798,11 @@ x-pack/platform/plugins/shared/ml/server/models/data_recognizer/modules/security
 /x-pack/test_serverless/functional/test_suites/common/README.md @elastic/appex-qa
 /x-pack/test_serverless/functional/page_objects/index.ts @elastic/appex-qa
 /x-pack/test_serverless/functional/ftr_provider_context.d.ts @elastic/appex-qa
-/x-pack/test_serverless/functional/test_suites/common/management/index.ts @elastic/appex-qa
-/x-pack/test_serverless/functional/test_suites/common/examples/index.ts @elastic/appex-qa
-/x-pack/test_serverless/functional/page_objects/svl_common_page.ts @elastic/appex-qa
-/x-pack/test_serverless/README.md @elastic/appex-qa
+/x-pack/platform/test/serverless/functional/test_suites/management/index.ts @elastic/appex-qa
+/x-pack/platform/test/serverless/functional/test_suites/examples/index.ts @elastic/appex-qa
+/x-pack/platform/test/serverless/functional/page_objects/svl_common_page.ts @elastic/appex-qa
+/x-pack/platform/test/README.md @elastic/appex-qa
+/x-pack/platform/test/serverless/README.md @elastic/appex-qa
 /x-pack/test_serverless/api_integration/ftr_provider_context.d.ts @elastic/appex-qa
 /x-pack/platform/test/serverless/api_integration/test_suites/README.md @elastic/appex-qa
 /src/dev/code_coverage @elastic/appex-qa
@@ -1823,11 +1831,7 @@ x-pack/platform/plugins/shared/ml/server/models/data_recognizer/modules/security
 /x-pack/platform/test/tsconfig.json @elastic/appex-qa
 /x-pack/platform/test/api_integration_basic/config.basic_license.ts @elastic/appex-qa
 /x-pack/platform/test/api_integration_basic/ftr_provider_context.d.ts @elastic/appex-qa
-/x-pack/solutions/observability/test/kibana.jsonc @elastic/appex-qa
-/x-pack/solutions/observability/test/tsconfig.json @elastic/appex-qa
-/x-pack/solutions/observability/test/api_integration/config.ts @elastic/appex-qa
-/x-pack/solutions/observability/test/api_integration/ftr_provider_context.d.ts @elastic/appex-qa
-/x-pack/solutions/observability/test/api_integration_deployment_agnostic/ftr_provider_context.d.ts @elastic/appex-qa
+/x-pack/solutions/security/test/README.md @elastic/appex-qa
 /x-pack/solutions/security/test/kibana.jsonc @elastic/appex-qa
 /x-pack/solutions/security/test/tsconfig.json @elastic/appex-qa
 /x-pack/solutions/security/test/api_integration/config.ts @elastic/appex-qa

@@ -0,0 +1,181 @@
+# Kibana Functional Test Runner (FTR) Tests
+
+The Functional Test Runner (FTR) is Kibana's comprehensive testing framework that powers both API and UI tests using WebDriver and a custom Mocha runner. This directory contains FTR services, page objects, configuration files for different types of tests and actual tests itself. This directory is only for tests targeting "platform" shared plugins and should be solution-agnostic (no imports from solution-specific code source).
+
+## Test Organization and Structure
+
+FTR tests are organized by type and deployment target to ensure proper test isolation and execution context. Understanding where to place your tests is crucial for maintainability and CI pipeline efficiency.
+
+### 1. Accessibility Tests - `/accessibility`
+
+**Purpose**: Automated accessibility (a11y) testing to ensure Kibana meets WCAG guidelines and accessibility standards.
+
+**Location**: `x-pack/platform/test/accessibility/`
+
+**When to use**:
+
+- Testing keyboard navigation and screen reader compatibility
+- Validating color contrast and visual accessibility
+- Ensuring proper ARIA attributes and semantic HTML
+- Testing focus management and tab order
+
+### 2. Stateful-Only API Tests
+
+**Purpose**: API integration tests that only run against traditional stateful environments.
+
+#### `/api_integration` - Core API Tests
+
+**Location**: `x-pack/platform/test/api_integration/`
+**Use for**: General API functionality, CRUD operations, data management APIs
+
+#### `/alerting_api_integration` - Alerting & Actions APIs
+
+**Location**: `x-pack/platform/test/alerting_api_integration/`
+**Use for**: Alerting rules, connectors, and notification testing
+
+#### `/api_integration_basic` - Basic License API Tests
+
+**Location**: `x-pack/platform/test/api_integration_basic/`
+**Use for**: API validation for Elastic Basic license
+
+#### `/automatic_import_api_integration` - Import APIs
+
+**Location**: `x-pack/platform/test/automatic_import_api_integration/`
+**Use for**: Data import, migration, and transformation APIs
+
+#### `/cases_api_integration` - Cases Management APIs
+
+**Location**: `x-pack/platform/test/cases_api_integration/`
+**Use for**: Cases creation, management, and workflow APIs
+
+### 3. Deployment Agnostic API Tests - `/api_integration_deployment_agnostic`
+
+**Purpose**: API tests designed to run in both stateful and serverless environments.
+
+**Location**: `x-pack/platform/test/api_integration_deployment_agnostic/`
+
+**When to use**:
+
+- APIs that work identically in both deployment types
+- Core platform functionality that spans deployment models
+- Tests that need to validate consistency across environments
+
+**Key considerations**:
+
+- Must not rely on stateful-specific features (like Watcher, ML jobs with persistence)
+- Should use deployment-agnostic services and utilities
+- Must use SAML authentication (cookie header for internal APIs or API key for public APIs)
+
+### 4. Functional UI Tests - `/functional` and `/functional_*`
+
+**Purpose**: End-to-end UI tests using WebDriver for browser automation.
+
+**Locations**:
+
+- `x-pack/platform/test/functional/` - Main functional tests
+- `x-pack/platform/test/functional_*` - Specialized functional test suites
+
+**Types of functional test directories**:
+
+#### Core Functional Tests
+
+- **`/functional`** - Primary UI test suite
+- **`/functional_basic`** - UI tests for Elastic Basic license
+- **`/functional_embedded`** - Embedded Kibana scenarios
+- **`/functional_cors`** - Cross-origin resource sharing tests
+
+#### Specialized UI Test Suites
+
+- **`/functional_with_es_ssl`** - SSL-enabled Elasticsearch tests
+
+**Key functional testing concepts**:
+
+- **Page Objects**: Encapsulate UI interactions and selectors
+- **Services**: Provide reusable utilities (browser, retry, find)
+
+### 5. Serverless-Only Tests - `/serverless`
+
+> For detailed serverless testing documentation, see [x-pack/platform/test/serverless/README.md](./serverless/README.md)
+
+**Purpose**: Tests specifically designed for serverless Kibana deployments.
+
+**Location**: `x-pack/platform/test/serverless/`
+
+**When to use**:
+
+- Serverless-specific features and limitations
+- Platform functionality shared between different project types (Security, Observability, Search)
+- Serverless authentication and authorization patterns
+
+**Note**: Project-type specific scenarios should be located in respective solution test directories, not here.
+
+## Test Configuration and Services
+
+### Configuration Files
+
+Each test suite has its own `config.ts` file that defines:
+
+- Test server settings (Elasticsearch, Kibana)
+- Service providers and page objects
+- Test file inclusion patterns
+- Browser settings and capabilities
+- Authentication configuration
+
+### Common Services
+
+- **`supertest`** - HTTP API testing
+- **`es`** - Elasticsearch client
+- **`esArchiver`** - Elasticsearch test data management
+- **`kibanaServer`** - Kibana instance management
+- **`browser`** - WebDriver browser control
+- **`find`** - WebDriver element selectors
+- **`testSubjects`** - Element selectors for UI elements with `data-test-subj` attribute
+
+### Page Objects
+
+Reusable UI interaction patterns organized by application:
+
+- `PageObjects.common` - Shared navigation and utilities
+- `PageObjects.dashboard` - Dashboard-specific interactions
+- `PageObjects.discover` - Discover app interactions
+- `PageObjects.visualize` - Visualization creation and editing
+
+## Running Tests
+
+### Local Development
+
+```bash
+# Start test server (replace with your actual config file path)
+node scripts/functional_tests_server.js --config x-pack/platform/test/functional/apps/advanced_settings/config.ts
+
+# Run tests (replace with your actual config file path)
+node scripts/functional_test_runner.js --config x-pack/platform/test/functional/apps/advanced_settings/config.ts
+```
+
+**Note**: The config paths shown above are examples. Replace it with the actual path to the config file for the test suite you want to run.
+
+## Best Practices
+
+### Test Organization
+
+- Group related tests in logical directories
+- Use descriptive test and suite names
+- Implement proper setup and teardown hooks
+- Follow the AAA pattern (Arrange, Act, Assert)
+
+### Performance Considerations
+
+- Use `esArchiver` for consistent test data (avoid overriding system indexes as it restores old index versions and makes testing less relevant)
+- Use `kbnArchiver` to load/unload saved objects
+- Implement proper waits and retries
+- Clean up test data after execution
+- Use selective test runs during development
+
+### Cross-Environment Testing
+
+- Design tests to work across deployment types when possible
+- Use deployment-agnostic services and utilities
+- Account for different authentication mechanisms
+- Test against both local and cloud environments
+
+This structure ensures comprehensive test coverage while maintaining clear separation of concerns between different deployment models and testing approaches.
@@ -0,0 +1,108 @@
+# Observability Solution Test Directory
+
+This directory contains test suites specific to the Observability solution. For comprehensive FTR (Functional Test Runner) documentation, architecture details, and testing best practices, see the main platform documentation: [`x-pack/platform/test/README.md`](../../../platform/test/README.md).
+
+## Platform Services and Page Objects Integration
+
+Observability tests leverage platform-shared services and page objects from the `@kbn/test-suites-xpack-platform` package, extending them with solution-specific functionality as needed.
+
+Platform services are available from:
+
+- `@kbn/test-suites-xpack-platform/api_integration/services`
+- `@kbn/test-suites-xpack-platform/api_integration_deployment_agnostic/services`
+- `@kbn/test-suites-xpack-platform/functional/services`
+
+Platform page objects are available from:
+
+- `@kbn/test-suites-xpack-platform/functional/page_objects`
+
+Platform base configurations are available from:
+
+- `@kbn/test-suites-xpack-platform/functional/config.base.ts`
+- `@kbn/test-suites-xpack-platform/api_integration/config.ts`
+
+Example configuration:
+
+```typescript
+// config.ts
+import { FtrConfigProviderContext } from '@kbn/test';
+import { services as platformServices } from '@kbn/test-suites-xpack-platform/functional/services';
+import { pageObjects as platformPageObjects } from '@kbn/test-suites-xpack-platform/functional/page_objects';
+import { ObservabilitySpecificService } from './services/observability_service';
+import { ObservabilityPageObject } from './page_object/observability_page_object';
+
+export default function ({ readConfigFile }: FtrConfigProviderContext) {
+  const baseConfig = readConfigFile(
+    require.resolve('@kbn/test-suites-xpack-platform/functional/config.base.ts')
+  );
+
+  return {
+    ...baseConfig.getAll(), // Extend base platform config
+    services: {
+      ...platformServices,
+      obltService: ObservabilitySpecificService, // Solution-specific extension
+    },
+    pageObjects: {
+      ...platformPageObjects,
+      obltPageObject: ObservabilitySpecificPageObject, // Solution-specific page objects
+    },
+    // ... rest of config
+  };
+}
+```
+
+### Service Extension Guidelines
+
+When extending functionality:
+
+**✅ Extend platform services** when adding shared functionality that could benefit other solutions
+
+**✅ Create solution-specific services** only for Observability-unique functionality
+
+## Test Organization
+
+### API Integration Tests
+
+#### `/api_integration` - Observability API Tests
+
+**Location**: `x-pack/solutions/observability/test/api_integration/`
+**Use for**: Observability-specific API testing, stateful-only environments
+
+#### `/api_integration_deployment_agnostic` - Cross-Environment API Tests
+
+**Location**: `x-pack/solutions/observability/test/api_integration_deployment_agnostic/`
+**Use for**: Observability-specific API tests designed to run in both stateful and serverless environments
+
+### UI Testing
+
+#### `/functional` - Observability Functional Tests
+
+**Location**: `x-pack/solutions/observability/test/functional/`
+**Use for**: End-to-end UI tests for Observability apps (APM, Logs, Metrics, Uptime)
+
+## Running Tests
+
+### Local Development
+
+```bash
+# Start test server for API integration tests
+node scripts/functional_tests_server.js --config x-pack/solutions/observability/test/api_integration/apis/cases/config.ts
+
+# Run API integration tests
+node scripts/functional_test_runner.js --config x-pack/solutions/observability/test/api_integration/apis/cases/config.ts
+
+# Start test server for functional tests
+node scripts/functional_tests_server.js --config x-pack/solutions/observability/test/functional/apps/apm/config.ts
+
+# Run functional tests
+node scripts/functional_test_runner.js --config x-pack/solutions/observability/test/functional/apps/apm/config.ts
+```
+
+**Note**: The config paths shown above are examples. Replace it with the actual path to the config file for the test suite you want to run.
+
+## Best Practices
+
+- **Reuse platform services** whenever possible to maintain consistency
+- **Contribute shared functionality** back to platform services rather than duplicating code
+- **Follow naming conventions** established in platform documentation
+- **Use deployment-agnostic patterns** when tests should work in both stateful and serverless environments