Skip to content

Commit 9be51d1

Browse files
committed
Adds more comments
1 parent 6db1368 commit 9be51d1

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -194,6 +194,10 @@ private[sql] class ParquetRelation2(
194194
committerClass,
195195
classOf[ParquetOutputCommitter])
196196

197+
// We're not really using `ParquetOutputFormat[Row]` for writing data here, because we override
198+
// it in `ParquetOutputWriter` to support appending and dynamic partitioning. The reason why
199+
// we set it here is to setup the output committer class to `ParquetOutputCommitter`, which is
200+
// bundled with `ParquetOutputFormat[Row]`.
197201
job.setOutputFormatClass(classOf[ParquetOutputFormat[Row]])
198202

199203
// TODO There's no need to use two kinds of WriteSupport

0 commit comments

Comments
 (0)