[SNAP-1233] clear InMemorySorter before calling its reset (#35)

This is done so that any spill call (due to no EVICTION_DOWN) from within the spill
call will return without doing anything, else it results in NPE trying to read
page tables which have already been cleared.

Author: Sumedh Wale

core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java

@@ -226,7 +226,17 @@ public long spill(long size, MemoryConsumer trigger) throws IOException {
     // Note that this is more-or-less going to be a multiple of the page size, so wasted space in
     // pages will currently be counted as memory spilled even though that space isn't actually
     // written to disk. This also counts the space needed to store the sorter's pointer array.
-    inMemSorter.reset();
+
+    // temporarily clear inMemorySorter so that a recursive spill call will return
+    final UnsafeInMemorySorter memSorter = inMemSorter;
+    if (memSorter != null) {
+      inMemSorter = null;
+      try {
+        memSorter.reset();
+      } finally {
+        inMemSorter = memSorter;
+      }
+    }
     // Reset the in-memory sorter's pointer array only after freeing up the memory pages holding the
     // records. Otherwise, if the task is over allocated memory, then without freeing the memory
     // pages, we might not be able to get memory for the pointer array.