[HUDI-4629] Create hive table from existing hoodie table failed when the table schema is not defined

[dongkelun]

Create table

use hudi;
CREATE TABLE  test_hudi_table_mor (
  id int,
  name string,
  price double,
  ts long,
  dt string
) using hudi
options (
  primaryKey = 'id',
  preCombineField = 'ts',
  type = 'mor'
 )
 partitioned by (dt);

Create _rt table

CREATE TABLE test_hudi_table_mor_rt
using hudi
OPTIONS (
  'hoodie.query.as.ro.table' = 'false'
)
location 'hdfs://cluster1/warehouse/tablespace/managed/hive/hudi.db/test_hudi_table_mor';

Failed exception:

WARN CreateHoodieTableCommand: Failed to create catalog table in metastore: org.apache.hadoop.hive.ql.metadata.HiveException: at least one column must be specified for the table

Related pr: [HUDI-4149] Drop-Table fails when underlying table directory is broken

Change Logs

Describe context and summary for this change. Highlight if any code was copied.

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level: none | low | medium | high

Choose one. If medium or high, explain what verification was done to mitigate the risks.

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[dongkelun]

@hudi-bot run azure

[hudi-bot]

CI report:

• 6adf14d Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[xushiyan]

this already handled in parseSchemaAndConfigs() , isn't it?

[xushiyan]

@jinxing64 can you also have a look pls? given this is based on your previous change

[dongkelun]

this already handled in parseSchemaAndConfigs() , isn't it?
yes

[YannByron]

I prefer to call loadTableSchemaByMetaClient directly without having to decide if table.schema is empty.
Parsing the metadata on spark does not need to depend on the meta from metastore.

[dongkelun]

@YannByron The table.schema is not obtained from the hive metastore, but is specified by the user. Only when the user does not specify a schema, we can parse and obtain the schema from the file through the method loadTableSchemaByMetaClient