Skip to content

Commit 6db3157

Browse files
committed
[SPARK-4102] Remove unused ShuffleReader.stop() method.
This method is not implemented by the only subclass (HashShuffleReader), nor is it ever called. While the use of Scala's fancy "???" was pretty exciting, the method's existence can only lead to confusion and it therefore should be deleted. mateiz was there a reason for adding this that I'm missing? Author: Kay Ousterhout <[email protected]> Closes apache#2966 from kayousterhout/SPARK-4102 and squashes the following commits: 532c564 [Kay Ousterhout] Added back commented-out method, as per Matei's request 904655e [Kay Ousterhout] [SPARK-4102] Remove unused ShuffleReader.stop() method.
1 parent cd739bd commit 6db3157

File tree

2 files changed

+6
-5
lines changed

2 files changed

+6
-5
lines changed

core/src/main/scala/org/apache/spark/shuffle/ShuffleReader.scala

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,10 @@ private[spark] trait ShuffleReader[K, C] {
2424
/** Read the combined key-values for this reduce task */
2525
def read(): Iterator[Product2[K, C]]
2626

27-
/** Close this reader */
28-
def stop(): Unit
27+
/**
28+
* Close this reader.
29+
* TODO: Add this back when we make the ShuffleReader a developer API that others can implement
30+
* (at which point this will likely be necessary).
31+
*/
32+
// def stop(): Unit
2933
}

core/src/main/scala/org/apache/spark/shuffle/hash/HashShuffleReader.scala

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -66,7 +66,4 @@ private[spark] class HashShuffleReader[K, C](
6666
aggregatedIter
6767
}
6868
}
69-
70-
/** Close this reader */
71-
override def stop(): Unit = ???
7269
}

0 commit comments

Comments
 (0)