Call out supported Iceberg catalogs #1151
Conversation
|
Important Review skippedAuto incremental reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the 📝 WalkthroughWalkthroughThe documentation for connecting to Iceberg REST catalogs has been updated to include new "Limitations" sections. These sections detail the current support status and maturity of Iceberg catalog integrations, with separate content for Redpanda Cloud and Redpanda Self-Managed environments. The Redpanda Cloud section features a matrix indicating support levels (GA, Beta) for various catalogs across AWS, Azure, and GCP, while the Self-Managed section presents a simpler table of catalog statuses. Both sections clarify that integrations are tested and released independently, advising users to monitor updates. Assessment against linked issues
Possibly related PRs
Suggested reviewers
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. 🪧 TipsChatThere are 3 ways to chat with CodeRabbit:
SupportNeed help? Create a ticket on our support page for assistance with any issues or questions. Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (Invoked using PR comments)
Other keywords and placeholders
CodeRabbit Configuration File (
|
✅ Deploy Preview for redpanda-docs-preview ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
| |=== | ||
| | |Databricks Unity Catalog |Snowflake Open Catalog |AWS Glue |Dremio Nessie | ||
|
|
||
| |AWS |Beta |GA |Beta |GA |
There was a problem hiding this comment.
I think values are not correct. The only one GA is AWS+Databricks
There was a problem hiding this comment.
Updated; @rpdevmp would you mind confirming?
There was a problem hiding this comment.
Correct, currently (as of of now) we have AWS + Databricks e2e flow
Working on Databricks on GCP, then Snowflake on AWS and GCP, there are unrelated blockers that we are trying to solve.. Might have more updates by tomorrow EOD
| The Iceberg integration for Redpanda Cloud supports multiple Iceberg catalogs across different cloud platforms, with progressive levels of release maturity. Each combination of cloud provider and catalog integration is tested and released independently. | ||
|
|
||
| The following matrix shows the current status of Iceberg integrations across different cloud providers and catalogs. Check this matrix regularly as Redpanda Cloud continues to expand GA coverage for Iceberg topics. |
![coderabbitai[bot]](https://avatars.githubusercontent.com/in/347564?s=60&v=4){kind=small}
There was a problem hiding this comment.
Actionable comments posted: 0
🧹 Nitpick comments (2)
modules/manage/partials/iceberg/use-iceberg-catalogs.adoc (2)
18-33: Label the first column header for clarity
The cloud matrix currently leaves the first header cell blank, which can be confusing. Replace it with "Cloud provider" and consider adding a brief table caption for accessibility:|=== -| |Databricks Unity Catalog |Snowflake Open Catalog |AWS Glue |Dremio Nessie +| Cloud provider |Databricks Unity Catalog |Snowflake Open Catalog |AWS Glue |Dremio Nessie |AWS |GA |Beta |Beta |Beta |Azure |Beta |Beta |Beta |Beta |GCP |Beta |Beta |Beta |Beta |===
35-51: Clean up trailing whitespace and unify styling
There’s an extra space afterBetaon the AWS Glue row. Also, for consistency, you might add a caption or similar styling (e.g., a table title) as in the cloud section:|Databricks Unity Catalog |GA |Snowflake Open Catalog |Beta -|AWS Glue |Beta +|AWS Glue |Beta |Dremio Nessie |Beta
kbatuigas
force-pushed
the
DOC-1411-iceberg-explicitly-call-out-the-catalogs-we-ve-tested
branch
from
9915b8d to
66bde37
Compare
| |Snowflake Open Catalog |Beta | ||
| |AWS Glue |Beta | ||
| |Dremio Nessie |Beta | ||
|
|
There was a problem hiding this comment.
@mattschumpert can you confirm the status for the individual catalogs on Self-managed?
| | |Databricks Unity Catalog |Snowflake Open Catalog |AWS Glue |Dremio Nessie | ||
| | |Databricks Unity Catalog |Snowflake Open Catalog |Dremio Nessie | ||
|
|
||
| |AWS |GA |Beta |Beta |Beta |
There was a problem hiding this comment.
We can't GA Databricks in Self hosted or Cloud yet due to a regression https://redpandadata.atlassian.net/browse/CORE-12152
| |=== | ||
| |Catalog service | Status | ||
|
|
||
| |Databricks Unity Catalog |Beta |
There was a problem hiding this comment.
so even if this is GA on AWS on Cloud, it's still Beta on Self-Managed?
There was a problem hiding this comment.
It should be beta in both cloud and SH.
kbatuigas
deleted the
DOC-1411-iceberg-explicitly-call-out-the-catalogs-we-ve-tested
branch
Description
This pull request adds documentation to clarify the limitations and maturity levels of Iceberg catalog integrations for Redpanda Cloud and Redpanda Self-Managed environments. It also introduces a matrix and list to summarize the current status of integrations across various cloud providers and catalog services.
Documentation Updates:
modules/manage/partials/iceberg/use-iceberg-catalogs.adoc: Added separate sections for Redpanda Cloud and Redpanda Self-Managed environments, detailing the limitations and maturity levels of Iceberg catalog integrations. Included a matrix for Redpanda Cloud and a list for Redpanda Self-Managed to summarize the status of integrations with catalog services like Databricks Unity Catalog, Snowflake Open Catalog, AWS Glue, and Dremio Nessie.Resolves https://redpandadata.atlassian.net/browse/
Review deadline: 12 June
Page previews
Cloud > Use Iceberg Catalogs > Connect to a REST catalog > Limitations
Self-managed > Use Iceberg Catalogs > Connect to a REST catalog > Limitations
Checks