Skip to content

Conversation

@xushiyan
Copy link
Member

@xushiyan xushiyan commented Mar 24, 2022

Fix testcases in

-TestHoodieMultiTableDeltaStreamer

  • testCsvDFSSourceNoHeaderWithoutSchemaProviderAndNoTransformer
  • testParquetDFSSourceWithoutSchemaProviderAndTransformer

Disable test cases with both schema provider and transfomer in TestHoodieDeltaStreamer
Disable flaky testDeletePartitions

@yihua
Copy link
Contributor

yihua commented Mar 24, 2022

As a reference, before this PR, the failed tests are:

[ERROR] Failures: 
[ERROR]   TestHoodieDeltaStreamer.testParquetDFSSourceWithoutSchemaProviderAndTransformer:1619->testParquetDFSSource:1429->testParquetDFSSource:1441 expected: <5> but was: <105>
[ERROR] Errors: 
[ERROR]   TestHoodieDeltaStreamer.testCsvDFSSourceNoHeaderWithSchemaProviderAndTransformer:1773->testCsvDFSSource:1687 » Hoodie
[ERROR]   TestHoodieDeltaStreamer.testCsvDFSSourceNoHeaderWithoutSchemaProviderAndNoTransformer:1742->testCsvDFSSource:1688 » IllegalArgument
[ERROR]   TestHoodieDeltaStreamer.testCsvDFSSourceWithHeaderAndSepWithSchemaProviderAndTransformer:1731->testCsvDFSSource:1687 » Hoodie
[ERROR]   TestHoodieDeltaStreamer.testDeletePartitions:1919 » IllegalArgument Cannot fin...
[ERROR]   TestHoodieDeltaStreamer.testParquetDFSSourceWithSchemaFilesAndTransformer:1629->testParquetDFSSource:1429->testParquetDFSSource:1440 » Spark
[ERROR]   TestHoodieMultiTableDeltaStreamer.testMultiTableExecutionWithKafkaSource:164 » IllegalArgument
[WARNING] Flakes: 
[WARNING] org.apache.hudi.utilities.functional.TestHoodieDeltaStreamer.testORCDFSSourceWithoutSchemaProviderAndNoTransformer(boolean,List)
[INFO]   Run 1: PASS
[ERROR]   Run 2: TestHoodieDeltaStreamer.testORCDFSSourceWithoutSchemaProviderAndNoTransformer:1635->testORCDFSSource:1482 » Hoodie
[INFO] 
[INFO] 
[ERROR] Tests run: 173, Failures: 1, Errors: 6, Skipped: 2, Flakes: 1

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@yihua yihua merged commit ff13665 into apache:master Mar 24, 2022
@1Ricco
Copy link

1Ricco commented Mar 26, 2022

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@xushiyan xushiyan deleted the HUDI-3689-fix-deltastreamertests branch March 26, 2022 17:40
vingov pushed a commit to vingov/hudi that referenced this pull request Apr 3, 2022
stayrascal pushed a commit to stayrascal/hudi that referenced this pull request Apr 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants