Skip to content

KAFKA-9706: Handle null keys/values in Flatten transformation#8279

Merged
kkonstantine merged 3 commits into
apache:trunkfrom
gharris1727:flatten-tombstone
Mar 30, 2020
Merged

KAFKA-9706: Handle null keys/values in Flatten transformation#8279
kkonstantine merged 3 commits into
apache:trunkfrom
gharris1727:flatten-tombstone

Conversation

@gharris1727

Copy link
Copy Markdown
Contributor
  • Fix DataException thrown when handling tombstone events with null value
  • Passes through original record when finding a tombstone record
  • Add tests for schema and schemaless data

Signed-off-by: Greg Harris gregh@confluent.io

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

* Fix DataException thrown when handling tombstone events with null value
* Passes through original record when finding a tombstone record
* Add tests for schema and schemaless data

Signed-off-by: Greg Harris <gregh@confluent.io>
@gharris1727

Copy link
Copy Markdown
Contributor Author

This is very similar to #6914 for the InsertField transformation, and uses the same solution and testing strategy.

@gharris1727

Copy link
Copy Markdown
Contributor Author

cc @ncliang @C0urante for review

@ncliang ncliang left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks, @gharris1727 !

@gharris1727

Copy link
Copy Markdown
Contributor Author

cc @kkonstantine @rhauch for review

Signed-off-by: Greg Harris <gregh@confluent.io>

@kkonstantine kkonstantine left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @gharris1727
Only nits as comments but otherwise, LGTM

Signed-off-by: Greg Harris <gregh@confluent.io>
@gharris1727

Copy link
Copy Markdown
Contributor Author

@kkonstantine I fixed the whitespace, can you verify that it's correct?

@kkonstantine

Copy link
Copy Markdown
Contributor

ok to test

@kkonstantine

Copy link
Copy Markdown
Contributor

JDK11 green
JDK8 one failure on a single unrelated integration test that is known to be flaky lately.
org.apache.kafka.streams.integration.QueryableStateIntegrationTest.concurrentAccesses

Given the above, I'll move forward with merging this simple bugfix.

@kkonstantine
kkonstantine merged commit 2c969b1 into apache:trunk Mar 30, 2020
kkonstantine pushed a commit that referenced this pull request Mar 30, 2020
… is used (#8279)

* Fixed DataException thrown when handling tombstone events with null value
* Passes through original record when finding a null key when it's configured for keys or a null value when it's configured for values. 
* Added unit tests for schema and schemaless data
kkonstantine pushed a commit that referenced this pull request Mar 30, 2020
… is used (#8279)

* Fixed DataException thrown when handling tombstone events with null value
* Passes through original record when finding a null key when it's configured for keys or a null value when it's configured for values. 
* Added unit tests for schema and schemaless data
kkonstantine pushed a commit that referenced this pull request Mar 30, 2020
… is used (#8279)

* Fixed DataException thrown when handling tombstone events with null value
* Passes through original record when finding a null key when it's configured for keys or a null value when it's configured for values. 
* Added unit tests for schema and schemaless data
kkonstantine pushed a commit that referenced this pull request Mar 30, 2020
… is used (#8279)

* Fixed DataException thrown when handling tombstone events with null value
* Passes through original record when finding a null key when it's configured for keys or a null value when it's configured for values. 
* Added unit tests for schema and schemaless data
kkonstantine pushed a commit that referenced this pull request Mar 30, 2020
… is used (#8279)

* Fixed DataException thrown when handling tombstone events with null value
* Passes through original record when finding a null key when it's configured for keys or a null value when it's configured for values. 
* Added unit tests for schema and schemaless data
qq619618919 pushed a commit to qq619618919/kafka that referenced this pull request May 12, 2020
… is used (apache#8279)

* Fixed DataException thrown when handling tombstone events with null value
* Passes through original record when finding a null key when it's configured for keys or a null value when it's configured for values. 
* Added unit tests for schema and schemaless data
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants