Skip to content

Conversation

@MaxGekk
Copy link
Member

@MaxGekk MaxGekk commented Mar 22, 2020

What changes were proposed in this pull request?

  1. The tests added by [SPARK-31183][SQL] Rebase date/timestamp from/to Julian calendar in Avro #27953 are moved from AvroLogicalTypeSuite to AvroSuite.
  2. Checking of the rebaseDateTime flag is moved out from functions bodies.

This is a backport of #27964

Why are the changes needed?

  1. The tests are moved because they are not directly related to logical types.
  2. Checking the flag out of functions bodies should improve performance.

Does this PR introduce any user-facing change?

No

How was this patch tested?

By running Avro tests via the command build/sbt avro/test

Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if tests pass. Thanks @dongjoon-hyun and @MaxGekk

@SparkQA
Copy link

SparkQA commented Mar 22, 2020

Test build #120151 has finished for PR 27977 at commit eba6648.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@cloud-fan cloud-fan changed the title [SPARK-31183][SQL][FOLLOWUP] Move rebase tests to AvroSuite and check the rebase flag out of function bodies [SPARK-31183][SQL][FOLLOWUP][3.0] Move rebase tests to AvroSuite and check the rebase flag out of function bodies Mar 23, 2020
@HyukjinKwon
Copy link
Member

Merged to branch-3.0.

HyukjinKwon pushed a commit that referenced this pull request Mar 23, 2020
…d check the rebase flag out of function bodies

### What changes were proposed in this pull request?
1. The tests added by #27953 are moved from `AvroLogicalTypeSuite` to `AvroSuite`.
2. Checking of the `rebaseDateTime` flag is moved out from functions bodies.

This is a backport of #27964

### Why are the changes needed?
1. The tests are moved because they are not directly related to logical types.
2. Checking the flag out of functions bodies should improve performance.

### Does this PR introduce any user-facing change?
No

### How was this patch tested?
By running Avro tests via the command `build/sbt avro/test`

Closes #27977 from MaxGekk/rebase-avro-datetime-followup-3.0.

Authored-by: Maxim Gekk <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
@dongjoon-hyun
Copy link
Member

Thank you, @MaxGekk and @HyukjinKwon !

@cloud-fan
Copy link
Contributor

thanks!

@MaxGekk MaxGekk deleted the rebase-avro-datetime-followup-3.0 branch June 5, 2020 19:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants