Skip to content

Conversation

@manasaks
Copy link
Contributor

What is the purpose of the pull request

Add ORC Support in Bootstrap Op

Verify this pull request

(Please pick either of the following options)

This pull request is a trivial rework / code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

  • *Added TestOrcBootstrap to test bootstrap functionality

Committer checklist

  • Has a corresponding JIRA in PR title & commit

  • Commit message is descriptive of the change

  • CI is green

  • Necessary doc changes done or have another open PR

  • For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

manasaks added 14 commits July 6, 2021 20:18
# Conflicts:
#	hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieBootstrapConfig.java
#	hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/bootstrap/SparkBootstrapCommitActionExecutor.java
#	hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java
#	hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala
#	hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala
@codecov-commenter
Copy link

codecov-commenter commented Jul 14, 2021

Codecov Report

Merging #3275 (3c64539) into master (5a94b6b) will increase coverage by 8.20%.
The diff coverage is 8.33%.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #3275      +/-   ##
============================================
+ Coverage     50.77%   58.97%   +8.20%     
- Complexity      482     1226     +744     
============================================
  Files            79      169      +90     
  Lines          3541     6655    +3114     
  Branches        436      697     +261     
============================================
+ Hits           1798     3925    +2127     
- Misses         1585     2448     +863     
- Partials        158      282     +124     
Flag Coverage Δ
hudiclient 65.24% <5.71%> (?)
hudisync ?
hudiutilities 51.74% <100.00%> (-21.62%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...va/org/apache/hudi/client/SparkRDDWriteClient.java 72.05% <ø> (ø)
.../bootstrap/HoodieSparkBootstrapSchemaProvider.java 0.00% <0.00%> (ø)
...java/org/apache/hudi/io/HoodieRowCreateHandle.java 92.50% <ø> (ø)
...io/storage/HoodieInternalRowFileWriterFactory.java 84.21% <ø> (ø)
...udi/io/storage/HoodieInternalRowParquetWriter.java 94.11% <ø> (ø)
...apache/hudi/io/storage/HoodieRowParquetConfig.java 100.00% <ø> (ø)
.../hudi/io/storage/HoodieRowParquetWriteSupport.java 84.61% <ø> (ø)
...va/org/apache/hudi/keygen/BuiltinKeyGenerator.java 72.97% <ø> (ø)
...va/org/apache/hudi/keygen/ComplexKeyGenerator.java 92.30% <ø> (ø)
...g/apache/hudi/keygen/GlobalDeleteKeyGenerator.java 100.00% <ø> (ø)
... and 142 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5a94b6b...3c64539. Read the comment docs.

@vinothchandar vinothchandar self-assigned this Sep 7, 2021
@nsivabalan
Copy link
Contributor

@manasaks : Are you sure patch's commit history is in good shape? I see 28 commits in total and 272 files have been changed. Can you please check that out and clean up the PR. or put up a new clean PR.

@hudi-bot
Copy link
Collaborator

hudi-bot commented Nov 5, 2021

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@nsivabalan nsivabalan closed this Dec 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants