-
Notifications
You must be signed in to change notification settings - Fork 13.7k
[FLINK-38510][table-planner] Remove targetColumns from the digest generation of SinkReuser #27107
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
73ff406
to
8cf78a2
Compare
@yunfengzhou-hub @xuyangzhong PTAL when u have time~ |
@flinkbot run azure |
1 similar comment
@flinkbot run azure |
…eration of SinkReuser
Thanks for the PR. LGTM |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for driving this. I have left some comments.
public void testSinkReuseWithPartialColumns() { | ||
public void testSinkReuseWithPartialColumnsNotSupportsTargetColumnWriting() { | ||
StatementSet statementSet = util.tableEnv().createStatementSet(); | ||
/// sink1 has not implemented the {@link SupportsTargetColumnWriting} sink ability |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit use //
instead of using ///
@Test | ||
public void testSinkReuseWithPartialColumnsAndSupportsTargetColumnWriting() { | ||
StatementSet statementSet = util.tableEnv().createStatementSet(); | ||
/// sink2 has implemented the {@link SupportsTargetColumnWriting} sink ability |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ditto
</Resource> | ||
<Resource name="optimized exec plan"> | ||
<![CDATA[ | ||
Sink(table=[default_catalog.default_database.sink1], targetColumns=[[0]], fields=[x, EXPR$1]) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The plan is a bit strange with the description targetColumns=[[0]]
in Sink.
I think we can either:
- In the PhysicalSink, check whether SupportsTargetColumnWriting is present before printing targetColumns, and avoid printing targetColumns if it's not.
- In the PhysicalSink, reference SupportsTargetColumnWriting when printing targetColumns, regardless of the targetColumns themselves.
- Complete the printing of targetColumns based on https://issues.apache.org/jira/browse/FLINK-37708.
As of now, since targetColumns has not been removed from PhysicalSink, I tend to prefer option 1. What do you think, or do you have any other suggestions?
What is the purpose of the change
Remove targetColumns from the digest generation of SinkReuser since it is deprecated now.
Brief change log
Remove the targetColumns from the digest generation of SinkReuser.
Verifying this change
This change added tests and can be verified as follows:
Does this pull request potentially affect one of the following parts:
@Public(Evolving)
: noDocumentation