Skip to content

Remove filtering of unsupported column names in Delta#16992

Merged
ebyhr merged 1 commit intotrinodb:masterfrom
pajaks:pajaks/special_chars_in_column_names_tests
Apr 13, 2023
Merged

Remove filtering of unsupported column names in Delta#16992
ebyhr merged 1 commit intotrinodb:masterfrom
pajaks:pajaks/special_chars_in_column_names_tests

Conversation

@pajaks
Copy link
Member

@pajaks pajaks commented Apr 12, 2023

Description

Fixes #11297

Release notes

(x) This is not user-visible or docs only and no release notes are required.

@cla-bot cla-bot bot added the cla-signed label Apr 12, 2023
@github-actions github-actions bot added the delta-lake Delta Lake connector label Apr 12, 2023
@pajaks pajaks marked this pull request as ready for review April 13, 2023 07:55
@pajaks pajaks requested review from ebyhr and findepi April 13, 2023 07:55
}

@Override
protected Optional<String> filterColumnNameTestData(String columnName)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have column name tests with none column mapping mode in product tests? I remember there's TestDeltaLakeColumnMappingMode#testSpecialCharacterColumnNamesWithColumnMappingMode for id and name mappings, but I'm not sure about existing none mapping tests.

As you know, we create tables and verify the result by ourselves in BaseDeltaLakeMinioConnectorTest, so it doesn't guarantee whether the column is accessible from Databricks or OSS Delta Lake.

Removing this override itself is fine.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I cannot find any. It would be good follow up I guess.

@ebyhr ebyhr merged commit 8286f99 into trinodb:master Apr 13, 2023
@github-actions github-actions bot added this to the 414 milestone Apr 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed delta-lake Delta Lake connector

Development

Successfully merging this pull request may close these issues.

Properly reject unsupported column names in Delta Lake

2 participants