Skip to content

Add ConnectorSplitAddressProvider in SPI#29138

Open
chenjian2664 wants to merge 3 commits intotrinodb:masterfrom
chenjian2664:jack/host-address-provider-spi
Open

Add ConnectorSplitAddressProvider in SPI#29138
chenjian2664 wants to merge 3 commits intotrinodb:masterfrom
chenjian2664:jack/host-address-provider-spi

Conversation

@chenjian2664
Copy link
Copy Markdown
Contributor

@chenjian2664 chenjian2664 commented Apr 16, 2026

Description

ConnectorSplit is intended to be a fully serializable data object
from coordinator to workers. Introduce ConnectorSplitAddressProvider,
supplies addresses and isRemotelyAccessible at scheduling time on
the coordinator, separate from the split data.
Also, add the IcebergSplitAddressProvider to support in the Iceberg
connector.

Additional context and related issues

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

## Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot Bot added the cla-signed label Apr 16, 2026
@github-actions github-actions Bot added iceberg Iceberg connector delta-lake Delta Lake connector hive Hive connector labels Apr 16, 2026
@chenjian2664 chenjian2664 changed the title Jack/host address provider spi Add ConnectorSplitAddressProvider in SPI Apr 16, 2026
@chenjian2664 chenjian2664 force-pushed the jack/host-address-provider-spi branch 3 times, most recently from a7255ff to 55134bb Compare April 16, 2026 13:33
Comment thread core/trino-spi/src/main/java/io/trino/spi/connector/ConnectorSplit.java Outdated
@chenjian2664 chenjian2664 force-pushed the jack/host-address-provider-spi branch 4 times, most recently from 58d9fd5 to c5de119 Compare April 17, 2026 07:29
`ConnectorSplit` is intended to be a fully serializable data object
from coordinator to workers. Introduce `ConnectorSplitAddressProvider`,
supplies `addresses` and `isRemotelyAccessible` at scheduling time on
the coordinator, separate from the split data.
Also, add the `IcebergSplitAddressProvider` to support in the Iceberg
connector.
@chenjian2664 chenjian2664 force-pushed the jack/host-address-provider-spi branch from 2fd2516 to 49f0456 Compare April 20, 2026 04:02
@chenjian2664 chenjian2664 requested a review from ebyhr April 20, 2026 08:46
@electrum
Copy link
Copy Markdown
Member

Can you move the connector changes to a separate commit from the SPI/engine changes?

Also, are the existing methods on ConnectorSplit now deprecated?

@raunaqmorarka
Copy link
Copy Markdown
Member

We're working on an alternative to this, its not exactly achieving what I was hoping for

@raunaqmorarka
Copy link
Copy Markdown
Member

#29182 is the approach i'd like to go with

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed delta-lake Delta Lake connector hive Hive connector iceberg Iceberg connector

Development

Successfully merging this pull request may close these issues.

4 participants