Skip to content

Remove testReadMetadataWithRelationsConcurrentModifications test#19872

Merged
findepi merged 1 commit intotrinodb:masterfrom
findepi:findepi/remove-testreadmetadatawithrelationsconcurrentmodifications-test-935d5a
Nov 23, 2023
Merged

Remove testReadMetadataWithRelationsConcurrentModifications test#19872
findepi merged 1 commit intotrinodb:masterfrom
findepi:findepi/remove-testreadmetadatawithrelationsconcurrentmodifications-test-935d5a

Conversation

@findepi
Copy link
Copy Markdown
Member

@findepi findepi commented Nov 23, 2023

This test covers an important aspect of Trino connectors -- metadata
listing should work also while tables/views/materialized views are being
created or dropped. It helped discover real problems, e.g.

However, this turned out to be hard to test. The existing test is pretty complicated, takes a lot of time, has high timeout value and remains one of the more flaky tests. The test author does not know how to make it robust and perhaps does not want to remain as the author of the top flaky test in the project.

Fixes #19747
Fixes #14230

@cla-bot cla-bot bot added the cla-signed label Nov 23, 2023
@findepi findepi force-pushed the findepi/remove-testreadmetadatawithrelationsconcurrentmodifications-test-935d5a branch from 13dceff to 3f65ff7 Compare November 23, 2023 09:13
This test covers an important aspect of Trino connectors -- metadata
listing should work also while tables/views/materialized views are being
created or dropped. It helped discover real problems, e.g.

- in Iceberg, that's why it was created
- in Kudu: trinodb#12974,
- in SQL Server https://github.com/trinodb/trino/blob/8edaa86c6b43e5f5fe03bb9427d3f26439a60d15/plugin/trino-sqlserver/src/test/java/io/trino/plugin/sqlserver/BaseSqlServerConnectorTest.java#L151-L152

However, this turned out to be hard to test. The existing test is pretty
complicated, takes a lot of time, has high timeout value and remains one
of the more flaky tests. The test author does not know how to make it
robust and perhaps does not want to remain as the author of the top
flaky test in the project.
@findepi findepi force-pushed the findepi/remove-testreadmetadatawithrelationsconcurrentmodifications-test-935d5a branch from 3f65ff7 to d9f1495 Compare November 23, 2023 09:15
@findepi findepi requested a review from a team November 23, 2023 09:16
@github-actions github-actions bot added the bigquery BigQuery connector label Nov 23, 2023
@sopel39
Copy link
Copy Markdown
Member

sopel39 commented Nov 23, 2023

The test author does not know how to make it robust and perhaps does not want to remain as the author of the top flaky test in the project.

@findepi did you happen to talk with the author?

@wendigo
Copy link
Copy Markdown
Contributor

wendigo commented Nov 23, 2023

giphy

@findepi findepi merged commit fea2b9a into trinodb:master Nov 23, 2023
@findepi findepi deleted the findepi/remove-testreadmetadatawithrelationsconcurrentmodifications-test-935d5a branch November 23, 2023 12:21
@github-actions github-actions bot added this to the 434 milestone Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bigquery BigQuery connector cla-signed

Development

Successfully merging this pull request may close these issues.

Flaky TestIcebergMinioOrcConnectorTest.testReadMetadataWithRelationsConcurrentModifications Fix concurrent metadata modification tests on BigQuery

4 participants