Skip to content

Conversation

@zhangbutao
Copy link
Contributor

@zhangbutao zhangbutao commented Apr 16, 2025

Currently, this PR only focus on from clause against the HMS native catalog, and does not involve other external catalogs such as JDBC catalog or Iceberg REST catalog.

We can have some discussions based on this PR and formulate a complete solution for Hive's multi-catalog functionality

For example, we can query a iceberg table by the catalog.db.tbl pattern:

// The catalog of hive can be the HMS native catalog or other external catalog(rest)
// This PR only foucs on HMS native catalog
select * from hive.testicedb.testice;

For the iceberg metadata table, we can use the catalog.db.tbl.meta pattern

select * from hive.testicedb.testice.history;

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

@zhangbutao zhangbutao marked this pull request as draft April 16, 2025 08:50
@sonarqubecloud
Copy link

@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
Feel free to reach out on the [email protected] list if the patch is in need of reviews.

@deniskuzZ
Copy link
Member

@zhangbutao, this PR is not yet ready for review, right?

@zhangbutao
Copy link
Contributor Author

@zhangbutao, this PR is not yet ready for review, right?

Yes, I'll optimize this PR later.

@deniskuzZ
Copy link
Member

i am not sure that could provide complete functionality without the Catalog properties support used to deduct client-impl and catalog related configs. for more info please see HIVE-29178

@zhangbutao
Copy link
Contributor Author

i am not sure that could provide complete functionality without the Catalog properties support used to deduct client-impl and catalog related configs. for more info please see HIVE-29178

This PR is currently only an attempt to explore the scenario of federated querying across multiple internal catalogs(HIVE-26227). As for federated queries involving other catalogs such as Iceberg & JDBC catalogs (related to HIVE-29178), I believe further implementation efforts will be explored in the future.

@zhangbutao zhangbutao force-pushed the HIVE-28908_from_catalog branch from a0d39ec to 55e9949 Compare October 22, 2025 03:16
@apache apache deleted a comment from github-actions bot Oct 22, 2025
@apache apache deleted a comment from github-actions bot Oct 22, 2025
@apache apache deleted a comment from sonarqubecloud bot Oct 22, 2025
@sonarqubecloud
Copy link

@aturoczy
Copy link

@zhangbutao Is this an abandoned PR draft?

@zhangbutao
Copy link
Contributor Author

@zhangbutao Is this an abandoned PR draft?

@aturoczy Thanks for taking care of this PR.

This PR will ultimately enable capabilities related to insert into catalog.db.tab xxx and select from catalog.db.tab xxx. I plan to proceed with the work for this PR after completing some major subtasks from HIVE-28879, such as the catalog semantics extensions for HIVE-29177 (catalog.db) and HIVE-29279 (catalog.db.tab). However, I may also incorporate the work for this PR into other JIRA tickets. I will provide updates here regarding any progress on this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants