Skip to content

Commit 024178c

Browse files
marmbruspwendell
authored andcommitted
[HOTFIX][SQL] Remove cleaning of UDFs
It is not safe to run the closure cleaner on slaves. #2153 introduced this which broke all UDF execution on slaves. Will re-add cleaning of UDF closures in a follow-up PR. Author: Michael Armbrust <[email protected]> Closes #2174 from marmbrus/fixUdfs and squashes the following commits: 55406de [Michael Armbrust] [HOTFIX] Remove cleaning of UDFs
1 parent dafe343 commit 024178c

File tree

1 file changed

+0
-3
lines changed
  • sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions

1 file changed

+0
-3
lines changed

sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -23,9 +23,6 @@ import org.apache.spark.util.ClosureCleaner
2323
case class ScalaUdf(function: AnyRef, dataType: DataType, children: Seq[Expression])
2424
extends Expression {
2525

26-
// Clean function when not called with default no-arg constructor.
27-
if (function != null) { ClosureCleaner.clean(function) }
28-
2926
type EvaluatedType = Any
3027

3128
def nullable = true

0 commit comments

Comments
 (0)