Commit ca6c59e
## What changes were proposed in this pull request?
This was a suggestion by rxin at #17780 (comment)
## How was this patch tested?
- modified existing unit test
- manual testing:
```
scala> hc.sql(" SELECT * FROM tejasp_bucketed_partitioned_1 where name = '' ").explain(true)
== Parsed Logical Plan ==
'Project [*]
+- 'Filter ('name = )
+- 'UnresolvedRelation `tejasp_bucketed_partitioned_1`
== Analyzed Logical Plan ==
user_id: bigint, name: string, ds: string
Project [user_id#24L, name#25, ds#26]
+- Filter (name#25 = )
+- SubqueryAlias tejasp_bucketed_partitioned_1
+- CatalogRelation `default`.`tejasp_bucketed_partitioned_1`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [user_id#24L, name#25], [ds#26]
== Optimized Logical Plan ==
Filter (isnotnull(name#25) && (name#25 = ))
+- CatalogRelation `default`.`tejasp_bucketed_partitioned_1`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [user_id#24L, name#25], [ds#26]
== Physical Plan ==
*Filter (isnotnull(name#25) && (name#25 = ))
+- HiveTableScan [user_id#24L, name#25, ds#26], CatalogRelation `default`.`tejasp_bucketed_partitioned_1`, org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, [user_id#24L, name#25], [ds#26]
```
Author: Tejas Patil <[email protected]>
Closes #17806 from tejasapatil/add_serde.
(cherry picked from commit 814a61a)
Signed-off-by: gatorsmile <[email protected]>
1 parent 1405862 commit ca6c59e
File tree
2 files changed
+8
-2
lines changed- sql
- catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees
- hive/src/test/scala/org/apache/spark/sql/hive/execution
2 files changed
+8
-2
lines changedLines changed: 5 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
444 | 444 | | |
445 | 445 | | |
446 | 446 | | |
447 | | - | |
| 447 | + | |
| 448 | + | |
| 449 | + | |
| 450 | + | |
| 451 | + | |
448 | 452 | | |
449 | 453 | | |
450 | 454 | | |
| |||
Lines changed: 3 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
46 | | - | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
47 | 49 | | |
48 | 50 | | |
49 | 51 | | |
| |||
0 commit comments