Skip to content

Commit 2d0150c

Browse files
kayousterhoutmateiz
authored andcommitted
Remove the getStageInfo() method from SparkContext.
This method exposes the Stage objects, which are private to Spark and should not be exposed to the user. This method was added in 01d77f3; ccing @squito here in case there's a good reason to keep this! Author: Kay Ousterhout <[email protected]> Closes #308 from kayousterhout/remove_public_method and squashes the following commits: 2e2f009 [Kay Ousterhout] Remove the getStageInfo() method from SparkContext.
1 parent 7c18428 commit 2d0150c

File tree

2 files changed

+1
-5
lines changed

2 files changed

+1
-5
lines changed

core/src/main/scala/org/apache/spark/SparkContext.scala

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -731,10 +731,6 @@ class SparkContext(
731731
*/
732732
def getPersistentRDDs: Map[Int, RDD[_]] = persistentRdds.toMap
733733

734-
def getStageInfo: Map[Stage, StageInfo] = {
735-
dagScheduler.stageToInfos
736-
}
737-
738734
/**
739735
* Return information about blocks stored in all of the slaves
740736
*/

core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -86,7 +86,7 @@ class DAGScheduler(
8686
private[scheduler] val shuffleToMapStage = new TimeStampedHashMap[Int, Stage]
8787
private[scheduler] val jobIdToActiveJob = new HashMap[Int, ActiveJob]
8888
private[scheduler] val resultStageToJob = new HashMap[Stage, ActiveJob]
89-
private[spark] val stageToInfos = new TimeStampedHashMap[Stage, StageInfo]
89+
private[scheduler] val stageToInfos = new TimeStampedHashMap[Stage, StageInfo]
9090

9191
// Stages we need to run whose parents aren't done
9292
private[scheduler] val waitingStages = new HashSet[Stage]

0 commit comments

Comments
 (0)