Skip to content

Commit c78a6f0

Browse files
zsxwingnemccarthy
authored andcommitted
[HOTFIX] Use 'new Job' in fsBasedParquet.scala
Same issue as apache#6095 cc liancheng Author: zsxwing <[email protected]> Closes apache#6136 from zsxwing/hotfix and squashes the following commits: 4beea54 [zsxwing] Use 'new Job' in fsBasedParquet.scala
1 parent ccde597 commit c78a6f0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

sql/core/src/main/scala/org/apache/spark/sql/parquet/fsBasedParquet.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -231,7 +231,7 @@ private[sql] class FSBasedParquetRelation(
231231
filters: Array[Filter],
232232
inputPaths: Array[String]): RDD[Row] = {
233233

234-
val job = Job.getInstance(SparkHadoopUtil.get.conf)
234+
val job = new Job(SparkHadoopUtil.get.conf)
235235
val conf = ContextUtil.getConfiguration(job)
236236

237237
ParquetInputFormat.setReadSupportClass(job, classOf[RowReadSupport])

0 commit comments

Comments
 (0)