[HUDI-5951] Replace format org.apache.hudi with short name hudi in Spark Datasource

[yihua]

Change Logs

HUDI-372 (#1054) adds support for the short name "hudi" in Spark Datasource read and write (df.write.format("hudi"), df.read.format("hudi")). All places should use "hudi" with format() now.

Impact

None. Code clean-up.

Risk level

none

Documentation Update

N/A

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[hudi-bot]

CI report:

• 27203c2 Azure: FAILURE

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[codope]

The change looks good but can you check why the tests are failing?

[yihua]

The change looks good but can you check why the tests are failing?

Yes, I'm going to check the CI failure.

[yihua]

I found out that if I replace format("org.apache.hudi") with format("hudi") in the test TestCOWDataSource.testSaveAsTableInDifferentModes fails with the following error (even without any production code changes):

java.lang.IllegalArgumentException: Insert Overwrite Partition can not use bulk insert.
	at org.apache.spark.sql.hudi.ProvidesHoodieConfig$$anonfun$9.apply(ProvidesHoodieConfig.scala:149)
	at org.apache.spark.sql.hudi.ProvidesHoodieConfig$$anonfun$9.apply(ProvidesHoodieConfig.scala:145)

We need to investigate this. Supposedly, format("hudi") is the way to go and there shouldn't be any failure.

[yihua]

Closing this stale PR