Skip to content

Add documentation for Iceberg Glue catalog#11470

Merged
findepi merged 1 commit intotrinodb:masterfrom
alexjo2144:iceberg-glue-docs
Mar 16, 2022
Merged

Add documentation for Iceberg Glue catalog#11470
findepi merged 1 commit intotrinodb:masterfrom
alexjo2144:iceberg-glue-docs

Conversation

@alexjo2144
Copy link
Copy Markdown
Member

Description

Adds documentation for configuration of #10845

Is this change a fix, improvement, new feature, refactoring, or other?

Documentation

Is this a change to the core query engine, a connector, client library, or the SPI interfaces? (be specific)

Documentation

How would you describe this change to a non-technical end user or system administrator?

Related issues, pull requests, and links

Documentation

( ) No documentation is needed.
(x) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

( ) No release notes entries required.
( ) Release notes entries required with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@alexjo2144
Copy link
Copy Markdown
Member Author

Adding the WIP label until the code changes are actually merged.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Link to that section in the Hive connector docs

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We never talk about "catalog types" anywhere. Just say that two different metastores are supported.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why are we introducing a new concept of catalog type .. this is inconsistent with all other connectors. I would refactor this to be in line with Hive connector .. or at least something more logical like iceberge.metastore.type

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Catalog type should be a familiar term to Iceberg users. It doesn't refer to Trino Catalogs. https://iceberg.apache.org/docs/latest/spark-configuration/#catalogs

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the info.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be Hive metastore

@alexjo2144 alexjo2144 removed the WIP label Mar 15, 2022
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we should use the word "Generic" here.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Other"?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Universal"?

Copy link
Copy Markdown
Member

@findepi findepi Mar 15, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

General?
or "Iceberg configuration properties" like at https://trino.io/docs/current/connector/hive.html#hive-configuration-properties

(btw we seem to be using "Sentence case" and not "Upper Case" for section headers)

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like "General configuration"

And yes, will fix capitalization, thanks

@alexjo2144
Copy link
Copy Markdown
Member Author

Updated, and removed the WIP label since the code PR was merged.

@findepi findepi merged commit 8add1e7 into trinodb:master Mar 16, 2022
@github-actions github-actions bot added this to the 374 milestone Mar 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

3 participants