Skip to content

ESQL: Unmute test and add extra logging to generative test validation#143168

Merged
ivancea merged 2 commits intoelastic:mainfrom
ivancea:esql-generative-extra-logging
Feb 27, 2026
Merged

ESQL: Unmute test and add extra logging to generative test validation#143168
ivancea merged 2 commits intoelastic:mainfrom
ivancea:esql-generative-extra-logging

Conversation

@ivancea
Copy link
Copy Markdown
Contributor

@ivancea ivancea commented Feb 26, 2026

Closes #142739

@ivancea ivancea added >test Issues or PRs that are addressing/adding tests Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) :Analytics/ES|QL AKA ESQL v9.4.0 labels Feb 26, 2026
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@ivancea
Copy link
Copy Markdown
Contributor Author

ivancea commented Feb 26, 2026

This technically won't "close"/fix the linked issue, but if it fails again, I think it's better to have a new issue with failing checks with the new logging instead of mixing them

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR addresses a flaky test failure in GenerativeMetricsIT by improving error messages to include column names for better debugging, and unmuting the test. The enhanced logging will help diagnose column count mismatches when they occur in the generative test validation framework.

Changes:

  • Enhanced error message in expectSameColumns to include actual column names alongside counts
  • Unmuted GenerativeMetricsIT.test which was failing with unclear column count mismatch errors

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
x-pack/plugin/esql/qa/testFixtures/src/main/java/org/elasticsearch/xpack/esql/generator/command/CommandGenerator.java Improved validation error message to include column names for debugging
muted-tests.yml Removed the muted test entry for GenerativeMetricsIT

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@ivancea ivancea enabled auto-merge (squash) February 26, 2026 17:17
@ivancea ivancea merged commit b4371da into elastic:main Feb 27, 2026
35 checks passed
@ivancea ivancea deleted the esql-generative-extra-logging branch February 27, 2026 12:04
PeteGillinElastic pushed a commit to PeteGillinElastic/elasticsearch that referenced this pull request Feb 27, 2026
szybia added a commit to szybia/elasticsearch that referenced this pull request Feb 27, 2026
…cations

* upstream/main: (35 commits)
  Create ARM bulk sqrI8 implementation (elastic#142461)
  Rework get-snapshots predicates (elastic#143161)
  Refactor downsampling fetchers and producers (elastic#140357)
  ESQL: Unmute test and add extra logging to generative test validation (elastic#143168)
  Fix metadata fields being nullified/loaded by unmapped_fields setting (elastic#143155)
  Determine remote cluster version (elastic#142494)
  Populate failure message for aborted clones (elastic#143206)
  Allow kibana_system role to read and manage logs streams (elastic#143053)
  Mute org.elasticsearch.xpack.esql.CsvIT test {csv-spec:eval.DocsLength} elastic#143224
  Mute org.elasticsearch.xpack.esql.CsvIT test {csv-spec:eval.DocsByteLength} elastic#143223
  Mute org.elasticsearch.xpack.esql.CsvIT test {csv-spec:docs.DocsBitLength} elastic#143222
  Fix FloatVectorScorerSupplier bulkScore bug (elastic#143211)
  ESQL: Add data node execution for external sources (elastic#143209)
  [ESQL] Cleanup commands docs (elastic#143058)
  [ML]Fix latest transforms disregarding updates when sort and sync fields are non-monotonic (elastic#142856)
  Mute org.elasticsearch.index.mapper.IpFieldMapperTests testSyntheticSourceInObject elastic#143212
  Tests: Fix StoreDirectoryMetricsIT (elastic#143084)
  ESQL: Add distribution strategy for external sources (elastic#143194)
  CSV IT spec (elastic#142585)
  Fix VectorScorerOSQBenchmark.score to read corrections properly (elastic#143137)
  ...
tballison pushed a commit to tballison/elasticsearch that referenced this pull request Mar 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test Issues or PRs that are addressing/adding tests v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CI] GenerativeMetricsIT test failing

4 participants