Skip to content

Conversation

@scwf
Copy link
Contributor

@scwf scwf commented Nov 22, 2014

create table test_parquet(key int, value string) stored as parquet;
select * from test_parquet;
get error as follow
java.lang.IllegalArgumentException: Could not find Parquet metadata at path file:/user/hive/warehouse/test_parquet
at org.apache.spark.sql.parquet.ParquetTypesConverter$$anonfun$readMetaData$4.apply(ParquetTypes.scala:459)
at org.apache.spark.sql.parquet.ParquetTypesConverter$$anonfun$readMetaData$4.apply(ParquetTypes.scala:459)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.sql.parquet.ParquetTypesConverter$.readMetaData(ParquetTypes.sc

link to #3352

@scwf
Copy link
Contributor Author

scwf commented Nov 22, 2014

Need to add a test for this.

@SparkQA
Copy link

SparkQA commented Nov 22, 2014

Test build #23737 has started for PR 3413 at commit 1e9cdfc.

  • This patch merges cleanly.

@scwf scwf changed the title [SPARK-4552][SQL] query for empty parquet table in spark sql hive get IllegalArgumentException [SPARK-4552][SQL] Query for empty parquet table in spark sql hive get IllegalArgumentException Nov 22, 2014
@SparkQA
Copy link

SparkQA commented Nov 22, 2014

Test build #23739 has started for PR 3413 at commit 9083f64.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 22, 2014

Test build #23737 has finished for PR 3413 at commit 1e9cdfc.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23737/
Test FAILed.

@SparkQA
Copy link

SparkQA commented Nov 22, 2014

Test build #23739 has finished for PR 3413 at commit 9083f64.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23739/
Test FAILed.

@SparkQA
Copy link

SparkQA commented Nov 22, 2014

Test build #23742 has started for PR 3413 at commit e6c7d8a.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Nov 22, 2014

Test build #23742 has finished for PR 3413 at commit e6c7d8a.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23742/
Test PASSed.

@marmbrus
Copy link
Contributor

marmbrus commented Dec 1, 2014

Thanks for working on this! I think it might be better to make sure that we fix this as part of #3441. What do you think?

@scwf
Copy link
Contributor Author

scwf commented Dec 4, 2014

Thanks, ok to close this

@scwf scwf closed this Dec 4, 2014
@scwf scwf deleted the parquet-empty branch December 4, 2014 00:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants