-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-4552][SQL] Query for empty parquet table in spark sql hive get IllegalArgumentException #3413
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Need to add a test for this. |
|
Test build #23737 has started for PR 3413 at commit
|
|
Test build #23739 has started for PR 3413 at commit
|
|
Test build #23737 has finished for PR 3413 at commit
|
|
Test FAILed. |
|
Test build #23739 has finished for PR 3413 at commit
|
|
Test FAILed. |
|
Test build #23742 has started for PR 3413 at commit
|
|
Test build #23742 has finished for PR 3413 at commit
|
|
Test PASSed. |
|
Thanks for working on this! I think it might be better to make sure that we fix this as part of #3441. What do you think? |
|
Thanks, ok to close this |
create table test_parquet(key int, value string) stored as parquet;
select * from test_parquet;
get error as follow
java.lang.IllegalArgumentException: Could not find Parquet metadata at path file:/user/hive/warehouse/test_parquet
at org.apache.spark.sql.parquet.ParquetTypesConverter$$anonfun$readMetaData$4.apply(ParquetTypes.scala:459)
at org.apache.spark.sql.parquet.ParquetTypesConverter$$anonfun$readMetaData$4.apply(ParquetTypes.scala:459)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.sql.parquet.ParquetTypesConverter$.readMetaData(ParquetTypes.sc
link to #3352