Initial MVP implementation of Catalog Federation to remote Iceberg REST Catalogs by dennishuo · Pull Request #1305 · apache/polaris

Commits on Apr 4, 2025

Initial prototype of catalog federation just passing special properties into internal properties.
dennishuo
committed
Defined internal representation classes for connection config

XJDKC
authored and
dennishuo
committed
Construct and initialize federated iceberg catalog based on connection config

XJDKC
authored and
dennishuo
committed
Apply the same spec renames to the internal ConnectionConfiguration representations.
dennishuo
committed
Manually pick @XJDKC fixes for integration tests and omittign secrets in response objects
dennishuo
committed
Fix internal connection structs with updated naming from spec PR
dennishuo
committed
Push CreateCatalogRequest down to PolarisAdminService::createCatalog just like UpdateCatalogRequest in updateCatalog.
dennishuo
committed
Add new interface UserSecretsManager along with a default implementation
dennishuo
committed
Wire in UserSecretsManager to createCatalog and federated Iceberg API handlers
dennishuo
committed
Since we already use commons-codec DigestUtils.sha256Hex, use that for the hash in UnsafeInMemorySecretsManager
dennishuo
committed
Rename the persistence-objects corresponding to API model objects with a new naming
dennishuo
committed
Use UserSecretsManagerFactory to Produce the UserSecretsManager (#1)
XJDKC
authored
Gate all federation logic behind a new FeatureConfiguration - ENABLE_CATALOG_FEDERATION
dennishuo
committed
Also rename some variables and method names to be consistent with prior rename to ConnectionConfigInfoDpo
dennishuo
committed
Merge branch 'main' of github.com:dennishuo/polaris into dhuo-catalog-federation-mvp-clean
dennishuo
committed

Commits on Apr 10, 2025

Merge branch 'main' of github.com:dennishuo/polaris into dhuo-catalog-federation-mvp-clean
dennishuo
committed

Commits on Apr 14, 2025

Commits on Apr 15, 2025

Add javadoc comment to IcebergCatalogPropertiesProvider
dennishuo
committed

Commits on Apr 17, 2025

Add some constraints on the expected format of the URN in UserSecretReference and placeholders
dennishuo
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Initial MVP implementation of Catalog Federation to remote Iceberg REST Catalogs#1305

Initial MVP implementation of Catalog Federation to remote Iceberg REST Catalogs#1305
eric-maynard merged 20 commits intoapache:mainfrom
dennishuo:dhuo-catalog-federation-mvp-clean

Commits on Apr 4, 2025

Initial prototype of catalog federation just passing special properties into internal properties.

Defined internal representation classes for connection config

Construct and initialize federated iceberg catalog based on connection config

Apply the same spec renames to the internal ConnectionConfiguration representations.

Manually pick @XJDKC fixes for integration tests and omittign secrets in response objects

Fix internal connection structs with updated naming from spec PR

Push CreateCatalogRequest down to PolarisAdminService::createCatalog just like UpdateCatalogRequest in updateCatalog.

Add new interface UserSecretsManager along with a default implementation

Wire in UserSecretsManager to createCatalog and federated Iceberg API handlers

Since we already use commons-codec DigestUtils.sha256Hex, use that for the hash in UnsafeInMemorySecretsManager

Rename the persistence-objects corresponding to API model objects with a new naming

Use UserSecretsManagerFactory to Produce the UserSecretsManager (#1)

Gate all federation logic behind a new FeatureConfiguration - ENABLE_CATALOG_FEDERATION

Also rename some variables and method names to be consistent with prior rename to ConnectionConfigInfoDpo

Merge branch 'main' of github.com:dennishuo/polaris into dhuo-catalog-federation-mvp-clean

Commits on Apr 10, 2025

Merge branch 'main' of github.com:dennishuo/polaris into dhuo-catalog-federation-mvp-clean

Commits on Apr 14, 2025

Merge branch 'main' of github.com:dennishuo/polaris into dhuo-catalog-federation-mvp-clean

Change ConnectionType and AuthenticationType to be stored as int codes in persistence objects.

Commits on Apr 15, 2025

Add javadoc comment to IcebergCatalogPropertiesProvider

Commits on Apr 17, 2025

Add some constraints on the expected format of the URN in UserSecretReference and placeholders

Initial MVP implementation of Catalog Federation to remote Iceberg REST Catalogs#1305eric-maynard merged 20 commits intoapache:mainapache/polaris:mainfrom dennishuo:dhuo-catalog-federation-mvp-cleandennishuo/polaris:dhuo-catalog-federation-mvp-cleanCopy head branch name to clipboard

Commits

Commits on Apr 4, 2025

Commits on Apr 10, 2025

Commits on Apr 14, 2025

Commits on Apr 15, 2025

Commits on Apr 17, 2025

Initial MVP implementation of Catalog Federation to remote Iceberg REST Catalogs#1305
eric-maynard merged 20 commits intoapache:mainfrom
dennishuo:dhuo-catalog-federation-mvp-clean