Skip to content

Conversation

@zsxwing
Copy link
Member

@zsxwing zsxwing commented Mar 13, 2020

What changes were proposed in this pull request?

This PR manually reverts changes in #25292 and then wraps java.lang.Error with QueryExecutionException to notify QueryExecutionListener to send it to QueryExecutionListener.onFailure which only accepts Exception.

The bug fix PR for 2.4 is #27904. It needs a separate PR because the touched codes were changed a lot.

Why are the changes needed?

Avoid API changes and fix a bug.

Does this PR introduce any user-facing change?

Yes. Reverting an API change happening in 3.0. QueryExecutionListener APIs will be the same as 2.4.

How was this patch tested?

The new added test.

@dongjoon-hyun
Copy link
Member

Thank you, @zsxwing .
I added this to SPARK-31085 as a subtask to give a more context.

@SparkQA
Copy link

SparkQA commented Mar 13, 2020

Test build #119769 has finished for PR 27907 at commit edb435d.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Could you fix sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/DummyListeners.scala, too?

@SparkQA
Copy link

SparkQA commented Mar 13, 2020

Test build #119770 has finished for PR 27907 at commit 25ca976.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Merged to master/3.0.
Thank you, @zsxwing !

dongjoon-hyun pushed a commit that referenced this pull request Mar 13, 2020
…QueryExecutionListener

### What changes were proposed in this pull request?

This PR manually reverts changes in #25292 and then wraps java.lang.Error with `QueryExecutionException` to notify `QueryExecutionListener` to send it to `QueryExecutionListener.onFailure` which only accepts `Exception`.

The bug fix PR for 2.4 is #27904. It needs a separate PR because the touched codes were changed a lot.

### Why are the changes needed?

Avoid API changes and fix a bug.

### Does this PR introduce any user-facing change?

Yes. Reverting an API change happening in 3.0. QueryExecutionListener APIs will be the same as 2.4.

### How was this patch tested?

The new added test.

Closes #27907 from zsxwing/SPARK-31144.

Authored-by: Shixiong Zhu <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 1ddf44d)
Signed-off-by: Dongjoon Hyun <[email protected]>
@zsxwing
Copy link
Member Author

zsxwing commented Mar 14, 2020

@dongjoon-hyun thanks!

@zsxwing zsxwing deleted the SPARK-31144 branch March 14, 2020 07:49
Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 LGTM!

sjincho pushed a commit to sjincho/spark that referenced this pull request Apr 15, 2020
…QueryExecutionListener

### What changes were proposed in this pull request?

This PR manually reverts changes in apache#25292 and then wraps java.lang.Error with `QueryExecutionException` to notify `QueryExecutionListener` to send it to `QueryExecutionListener.onFailure` which only accepts `Exception`.

The bug fix PR for 2.4 is apache#27904. It needs a separate PR because the touched codes were changed a lot.

### Why are the changes needed?

Avoid API changes and fix a bug.

### Does this PR introduce any user-facing change?

Yes. Reverting an API change happening in 3.0. QueryExecutionListener APIs will be the same as 2.4.

### How was this patch tested?

The new added test.

Closes apache#27907 from zsxwing/SPARK-31144.

Authored-by: Shixiong Zhu <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants