Skip to content

Commit f4e8c28

Browse files
scwfmarmbrus
authored andcommitted
[SPARK-4042][SQL] Append columns ids and names before broadcast
Append columns ids and names before broadcast ```hiveExtraConf``` in ```HadoopTableReader```. Author: scwf <[email protected]> Closes #2885 from scwf/HadoopTableReader and squashes the following commits: a8c498c [scwf] append columns ids and names before broadcast
1 parent 3a9d66c commit f4e8c28

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScan.scala

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -68,6 +68,9 @@ case class HiveTableScan(
6868
@transient
6969
private[this] val hiveExtraConf = new HiveConf(context.hiveconf)
7070

71+
// append columns ids and names before broadcast
72+
addColumnMetadataToConf(hiveExtraConf)
73+
7174
@transient
7275
private[this] val hadoopReader =
7376
new HadoopTableReader(attributes, relation, context, hiveExtraConf)
@@ -105,8 +108,6 @@ case class HiveTableScan(
105108
hiveConf.set(serdeConstants.LIST_COLUMNS, relation.attributes.map(_.name).mkString(","))
106109
}
107110

108-
addColumnMetadataToConf(hiveExtraConf)
109-
110111
/**
111112
* Prunes partitions not involve the query plan.
112113
*

0 commit comments

Comments
 (0)