Skip to content

Conversation

@rxin
Copy link
Contributor

@rxin rxin commented Feb 20, 2017

What changes were proposed in this pull request?

To ease debugging, most of Spark SQL internals have public level visibility. Two of the most important internal states, sharedState and sessionState, however, are package private. It would make more sense to open these up as well with clear documentation that they are internal.

In addition, users currently have way to set active/default SparkSession, but no way to actually get them back. We should open those up as well.

How was this patch tested?

N/A - only visibility change.

*/
@InterfaceStability.Unstable
@transient
private[sql] lazy val sessionState: SessionState = {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Like sharedState, also remove private[sql]?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oops

@gatorsmile
Copy link
Member

LGTM

@SparkQA
Copy link

SparkQA commented Feb 20, 2017

Test build #73181 has finished for PR 17002 at commit 7d3cdd6.

  • This patch fails to build.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Feb 20, 2017

Test build #73176 has finished for PR 17002 at commit a0c22a8.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile
Copy link
Member

Thanks! Merging to master.

@asfgit asfgit closed this in 0733a54 Feb 20, 2017
@windpiger
Copy link
Contributor

@gatorsmile @rxin
the latest success test build at commit a0c22a8 not the latest commit 7d3cdd6.
The open session state will cause the TestSQLContext compile failed, I have make a hotfix for this #17008

@gatorsmile
Copy link
Member

uh... I missed that.

@rxin
Copy link
Contributor Author

rxin commented Feb 21, 2017

Yea @gatorsmile be careful in the future and check the commit hash.

@gatorsmile
Copy link
Member

Yeah. Will be more careful in the future. Sorry for that.

Yunni pushed a commit to Yunni/spark that referenced this pull request Feb 27, 2017
…and a few other functions

## What changes were proposed in this pull request?
To ease debugging, most of Spark SQL internals have public level visibility. Two of the most important internal states, sharedState and sessionState, however, are package private. It would make more sense to open these up as well with clear documentation that they are internal.

In addition, users currently have way to set active/default SparkSession, but no way to actually get them back. We should open those up as well.

## How was this patch tested?
N/A - only visibility change.

Author: Reynold Xin <[email protected]>

Closes apache#17002 from rxin/SPARK-19669.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants