[SecuritySolution] [Dashboard Migrations] Add security automatic migrations evaluation suite#261568

Merged

enriquesanchez-elastic merged 30 commits into

mainfrom

scaffold-evals-suite-automatic-migrations

Apr 29, 2026

Commits on Apr 28, 2026

Add security automatic migrations evaluation suite
enriquesanchez-elastic
committed
Changes from node scripts/lint_ts_projects --fix

kibanamachine
authored and
enriquesanchez-elastic
committed
Changes from node scripts/generate codeowners

kibanamachine
authored and
enriquesanchez-elastic
committed
Changes from node scripts/regenerate_moon_projects.js --update

kibanamachine
authored and
enriquesanchez-elastic
committed
Changes from node scripts/eslint_all_files --no-cache --fix

kibanamachine
authored and
enriquesanchez-elastic
committed
Add rule dataset types for automatic migrations eval suite

enriquesanchez-elastic
and
claude
committed
Add RuleMigrationClient for rule migration API lifecycle

enriquesanchez-elastic
and
claude
committed
Add shared helper utilities for automatic migrations eval suite

enriquesanchez-elastic
and
claude
committed
Add structural evaluators for automatic migrations eval suite

enriquesanchez-elastic
and
claude
committed
Add matching evaluators for security automatic migrations eval suite

enriquesanchez-elastic
and
claude
committed
Add LLM-as-judge evaluators and barrel export for rules evaluators

enriquesanchez-elastic
and
claude
committed
Add evaluate dataset orchestration module for rules eval suite

enriquesanchez-elastic
and
claude
committed
Add rule migration fixtures to evaluate.ts root fixture

enriquesanchez-elastic
and
claude
committed
Add Splunk SPL dataset and rule migration test spec

enriquesanchez-elastic
and
claude
committed
Add QRadar dataset and test spec for automatic migrations eval suite

enriquesanchez-elastic
and
claude
committed
[Security Evals] Final integration: barrel exports, lint fixes, and formatting

enriquesanchez-elastic
and
claude
committed
fix(evals): add empty-rules guard and move TranslationResult to shared evaluators

enriquesanchez-elastic
and
claude
committed
fix(evals): add Scout deployment tags and logging to rule migration specs

enriquesanchez-elastic
and
claude
committed
refactor(evals): update rule dataset handling and dashboard metadata
enriquesanchez-elastic
committed
refactor(evals): rename esql_syntax_validity to esql_completeness and add queries to metadata

enriquesanchez-elastic
and
claude
committed
Changes from node scripts/generate codeowners

kibanamachine
authored and
enriquesanchez-elastic
committed
Update CODEOWNERS and refactor index pattern validity evaluator
enriquesanchez-elastic
committed
Update regex in extractIndexPatternFromPanel for improved query matching
enriquesanchez-elastic
committed
Changes from node scripts/generate codeowners

kibanamachine
authored and
enriquesanchez-elastic
committed
[SecuritySolution][Dashboard Migrations] Fix splHasLookups missing standalone lookup

enriquesanchez-elastic
and
claude
committed
[SecuritySolution][Dashboard Migrations] Guard translation_fidelity against missing eai:data

enriquesanchez-elastic
and
claude
committed
[SecuritySolution][Dashboard Migrations] Transfer package ownership to threat-hunting

enriquesanchez-elastic
and
claude
committed
Changes from node scripts/regenerate_moon_projects.js --update

kibanamachine
authored and
enriquesanchez-elastic
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[SecuritySolution] [Dashboard Migrations] Add security automatic migrations evaluation suite#261568

[SecuritySolution] [Dashboard Migrations] Add security automatic migrations evaluation suite#261568
enriquesanchez-elastic merged 30 commits into
mainfrom
scaffold-evals-suite-automatic-migrations

Commits on Apr 28, 2026

Add security automatic migrations evaluation suite

Changes from node scripts/lint_ts_projects --fix

Changes from node scripts/generate codeowners

Changes from node scripts/regenerate_moon_projects.js --update

Changes from node scripts/eslint_all_files --no-cache --fix

Add rule dataset types for automatic migrations eval suite

Add RuleMigrationClient for rule migration API lifecycle

Add shared helper utilities for automatic migrations eval suite

Add structural evaluators for automatic migrations eval suite

Add matching evaluators for security automatic migrations eval suite

Add LLM-as-judge evaluators and barrel export for rules evaluators

Add evaluate dataset orchestration module for rules eval suite

Add rule migration fixtures to evaluate.ts root fixture

Add Splunk SPL dataset and rule migration test spec

Add QRadar dataset and test spec for automatic migrations eval suite

[Security Evals] Final integration: barrel exports, lint fixes, and formatting

fix(evals): add empty-rules guard and move TranslationResult to shared evaluators

fix(evals): add Scout deployment tags and logging to rule migration specs

refactor(evals): update rule dataset handling and dashboard metadata

refactor(evals): rename esql_syntax_validity to esql_completeness and add queries to metadata

Changes from node scripts/generate codeowners

Update CODEOWNERS and refactor index pattern validity evaluator

Update regex in extractIndexPatternFromPanel for improved query matching

Changes from node scripts/generate codeowners

[SecuritySolution][Dashboard Migrations] Fix splHasLookups missing standalone lookup

[SecuritySolution][Dashboard Migrations] Guard translation_fidelity against missing eai:data

[SecuritySolution][Dashboard Migrations] Transfer package ownership to threat-hunting

Changes from node scripts/regenerate_moon_projects.js --update

Commits on Apr 29, 2026

Merge branch 'main' into scaffold-evals-suite-automatic-migrations

Merge branch 'main' into scaffold-evals-suite-automatic-migrations