Skip to content

Commit 46f6c8c

Browse files
committed
fixed the NPE caused by closures being cleaned before being passed into the aggregate function
1 parent 7e1a481 commit 46f6c8c

File tree

1 file changed

+1
-1
lines changed
  • core/src/main/scala/org/apache/spark/rdd

1 file changed

+1
-1
lines changed

core/src/main/scala/org/apache/spark/rdd/RDD.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1195,7 +1195,7 @@ abstract class RDD[T: ClassTag](
11951195

11961196
/** User code that created this RDD (e.g. `textFile`, `parallelize`). */
11971197
@transient private[spark] val creationSiteInfo = Utils.getCallSiteInfo
1198-
private[spark] def getCreationSite: String = creationSiteInfo.toString
1198+
private[spark] def getCreationSite: String = Option(creationSiteInfo).getOrElse("").toString
11991199

12001200
private[spark] def elementClassTag: ClassTag[T] = classTag[T]
12011201

0 commit comments

Comments
 (0)