Skip to content

Test: Handle missing StorageDescriptor in Hive Glue tables #11103

Closed
findepi wants to merge 6 commits intomasterfrom
findepi/pr/test/hive/missing-sd
Closed

Test: Handle missing StorageDescriptor in Hive Glue tables #11103
findepi wants to merge 6 commits intomasterfrom
findepi/pr/test/hive/missing-sd

Conversation

@findepi
Copy link
Copy Markdown
Member

@findepi findepi commented Feb 18, 2022

Test #11092

@cla-bot cla-bot bot added the cla-signed label Feb 18, 2022
@findepi
Copy link
Copy Markdown
Member Author

findepi commented Feb 18, 2022

cc @alexjo2144

@alexjo2144
Copy link
Copy Markdown
Member

hdp-3 failure looks like an external failure, but it is a Glue test so it might be worth a rerun

2022-02-18T19:56:28.8537420Z [ERROR] io.trino.plugin.hive.metastore.glue.TestHiveGlueMetastore.testUpdateBasicPartitionStatistics  Time elapsed: 2.784 s  <<< FAILURE!
2022-02-18T19:56:28.8538684Z io.trino.spi.TrinoException: InternalServiceException: Internal server error (Service: AmazonDynamoDBv2; Status Code: 500; Error Code: InternalServerError; Request ID: LJ6OMJL7JQCTBMLRU5DJIHK0C3VV4KQNSO5AEMVJF66Q9ASUAAJG; Proxy: null)
2022-02-18T19:56:28.8540145Z 	at io.trino.plugin.hive.metastore.glue.GlueHiveMetastore.propagatePartitionErrorToTrinoException(GlueHiveMetastore.java:1013)
2022-02-18T19:56:28.8541178Z 	at io.trino.plugin.hive.metastore.glue.GlueHiveMetastore.lambda$addPartitions$33(GlueHiveMetastore.java:978)
2022-02-18T19:56:28.8542295Z 	at io.trino.plugin.hive.metastore.glue.GlueMetastoreApiStats.call(GlueMetastoreApiStats.java:35)
2022-02-18T19:56:28.8543197Z 	at io.trino.plugin.hive.metastore.glue.GlueHiveMetastore.addPartitions(GlueHiveMetastore.java:963)
2022-02-18T19:56:28.8544260Z 	at io.trino.plugin.hive.HiveMetastoreClosure.addPartitions(HiveMetastoreClosure.java:245)
2022-02-18T19:56:28.8545322Z 	at io.trino.plugin.hive.AbstractTestHive.createDummyPartitionedTable(AbstractTestHive.java:3207)
2022-02-18T19:56:28.8546683Z 	at io.trino.plugin.hive.AbstractTestHive.testUpdateBasicPartitionStatistics(AbstractTestHive.java:3071)
2022-02-18T19:56:28.8547804Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2022-02-18T19:56:28.8549188Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2022-02-18T19:56:28.8551328Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2022-02-18T19:56:28.8552599Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
2022-02-18T19:56:28.8553816Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2022-02-18T19:56:28.8554764Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2022-02-18T19:56:28.8556047Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2022-02-18T19:56:28.8557174Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2022-02-18T19:56:28.8558213Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2022-02-18T19:56:28.8559218Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2022-02-18T19:56:28.8560068Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2022-02-18T19:56:28.8561255Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2022-02-18T19:56:28.8561962Z 	at java.base/java.lang.Thread.run(Thread.java:829)

@findepi
Copy link
Copy Markdown
Member Author

findepi commented Feb 19, 2022

@alexjo2144 rerun

@findepi
Copy link
Copy Markdown
Member Author

findepi commented Feb 21, 2022

57 successful, 1 cancelled, and 1 failing checks
ci / hive-tests (config-empty) (pull_request) Cancelled after 60m — hive-tests (config-empty)
ci / test (:trino-hive -P test-failure-recovery) (pull_request) Failing after 27m — test (:trino-hive -P test-failure-recovery)

@findepi
Copy link
Copy Markdown
Member Author

findepi commented Feb 21, 2022

@alexjo2144 rerun

@findepi
Copy link
Copy Markdown
Member Author

findepi commented Feb 21, 2022

same again. @alexjo2144 please investigate the results.

@alexjo2144
Copy link
Copy Markdown
Member

The test-failure-recovery module is the only thing that was failing for the last two runs, and it was also failing on master yesterday

https://github.com/trinodb/trino/runs/5280866004?check_suite_focus=true

@findepi
Copy link
Copy Markdown
Member Author

findepi commented Feb 23, 2022

I was more concerned about ci / hive-tests (config-empty) (pull_request) Cancelled after 60m

@findepi findepi closed this Feb 24, 2022
@findepi findepi deleted the findepi/pr/test/hive/missing-sd branch February 24, 2022 20:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

2 participants