Skip to content

Doc: refactor Hive documentation with catalog loading examples #2544

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
yyanyy merged 14 commits into from
May 12, 2021
Merged

Doc: refactor Hive documentation with catalog loading examples #2544

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
7eb75b7
Doc: refactor Hive documentation with catalog loading examples
Apr 29, 2021
2dc696c
fix checkstyle
Apr 29, 2021
68a24b9
fix based on comments
Apr 29, 2021
4e21d49
add notes for create table
Apr 29, 2021
ce4b20b
fix based on comments
Apr 30, 2021
d64ec91
update purge behavior
Apr 30, 2021
3e24c1c
fix comma
Apr 30, 2021
b197417
move tez warning to top
May 3, 2021
8a56f54
fix based on comments
May 3, 2021
d5fa01b
fix based on comments
May 3, 2021
fa4c982
fix typo
May 3, 2021
9d14dfe
update based on comments
May 5, 2021
11e5379
update based on comments
May 7, 2021
c853033
temporarily remove iceberg to hive conversion, add version for tez wa…
May 12, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 1 addition & 6 deletions mr/src/main/java/org/apache/iceberg/mr/Catalogs.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,12 +45,7 @@
/**
* Class for catalog resolution and accessing the common functions for {@link Catalog} API.
* <p>
* Catalog resolution happens in this order:
* <ol>
* <li>Custom catalog if specified by {@link InputFormatConfig#CATALOG_LOADER_CLASS}
* <li>Hadoop or Hive catalog if specified by {@link InputFormatConfig#CATALOG}
* <li>Hadoop Tables
* </ol>
* See {@link Catalogs#getCatalogType(Configuration, String)} for catalog type resolution strategy.
*/
public final class Catalogs {

Expand Down
17 changes: 17 additions & 0 deletions mr/src/main/java/org/apache/iceberg/mr/InputFormatConfig.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,9 +49,26 @@ private InputFormatConfig() {
public static final String SERIALIZED_TABLE_PREFIX = "iceberg.mr.serialized.table.";
public static final String TABLE_CATALOG_PREFIX = "iceberg.mr.table.catalog.";
public static final String LOCALITY = "iceberg.mr.locality";

/**
* @deprecated please use {@link InputFormatConfig#CATALOG_TYPE_TEMPLATE} to specify the type of a catalog,
* and set {@link InputFormatConfig#CATALOG_NAME} in table property.
*/
@Deprecated
public static final String CATALOG = "iceberg.mr.catalog";

/**
* @deprecated please use {@link InputFormatConfig#CATALOG_WAREHOUSE_TEMPLATE} to specify the warehouse location.
*/
@Deprecated
public static final String HADOOP_CATALOG_WAREHOUSE_LOCATION = "iceberg.mr.catalog.hadoop.warehouse.location";

/**
* @deprecated please use {@link InputFormatConfig#CATALOG_CLASS_TEMPLATE} to set catalog implementation.
*/
@Deprecated
public static final String CATALOG_LOADER_CLASS = "iceberg.mr.catalog.loader.class";

public static final String SELECTED_COLUMNS = "iceberg.mr.selected.columns";
public static final String EXTERNAL_TABLE_PURGE = "external.table.purge";

Expand Down
Loading