Skip to content

ESQL: Add support for ORC file format#142900

Merged
bpintea merged 7 commits intoelastic:mainfrom
bpintea:esql/ds/orc
Feb 24, 2026
Merged

ESQL: Add support for ORC file format#142900
bpintea merged 7 commits intoelastic:mainfrom
bpintea:esql/ds/orc

Conversation

@bpintea
Copy link
Copy Markdown
Contributor

@bpintea bpintea commented Feb 23, 2026

This adds support for the Apache ORC file format as an ESQL data source plugin.

🤖 Developed AI-assisted.

This adds support for the Apache ORC file format as an ESQL data source
plugin.
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Hi @bpintea, I've created a changelog YAML for you.

}
for (String columnName : projectedColumns) {
Attribute attr = attributeMap.get(columnName);
if (attr != null) {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This means the resulting page will not have as many blocks as requested in projectedColumns. Won't this cause issues in the caller?

In the NDJSON datasource we return a ConstantNullBlock for projected columns that aren't found in the schema.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point, thanks, addressed.

@bpintea bpintea marked this pull request as ready for review February 24, 2026 10:42
@bpintea bpintea requested a review from a team as a code owner February 24, 2026 10:42
@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Feb 24, 2026
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

Copy link
Copy Markdown
Member

@costin costin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. LGTM

@bpintea bpintea added the auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Feb 24, 2026
@bpintea bpintea merged commit 8c36eff into elastic:main Feb 24, 2026
34 of 35 checks passed
@bpintea bpintea deleted the esql/ds/orc branch February 24, 2026 14:43
szybia added a commit to szybia/elasticsearch that referenced this pull request Feb 24, 2026
…on-sliced-reindex

* upstream/main:
  Activity logging improvements (elastic#142901)
  Fix serialization of NodeGpuStatsResponse when no GPU is present (elastic#142937)
  Add doc on master elections in DistributedArchitectureGuide (elastic#142435)
  ESQL: Account for missing StubRelation due to SurrogateExpressions replacement (elastic#142882)
  Add BulkByScrollTask Serialization Tests (elastic#142697)
  Rebalance CI test partitions to reduce Part3 bottleneck (elastic#142930)
  Mute org.elasticsearch.xpack.esql.qa.multi_node.EsqlClientYamlIT test {p0=esql/40_tsdb/to_aggregate_metric_double with multi_values} elastic#142964
  Bump OpenTelemetry dependencies (elastic#142323)
  SQL: add support for API key to JDBC and CLI (elastic#142021)
  Ensure requested capability exists (elastic#142695)
  Warn and fall back to local branches.json (elastic#142606)
  [CI] Mute testWithFetchFailures, testAddCompletionListenerScheduleErr… (elastic#142926)
  ESQL: Add support for ORC file format (elastic#142900)
  Update wolfi (versioned) (elastic#142948)
  Add BulkByScrollResponse Serialization Tests (elastic#142688)
  Run 25_id_generation with and without synthetic id (elastic#142770)
@tylerperk tylerperk added the ES|QL|DS ES|QL datasources label Mar 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) ES|QL|DS ES|QL datasources >feature Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants