Skip to content

Make Serdes less confusing in Scala#4963

Merged
guozhangwang merged 1 commit into
apache:trunkfrom
joan38:serdes
May 8, 2018
Merged

Make Serdes less confusing in Scala#4963
guozhangwang merged 1 commit into
apache:trunkfrom
joan38:serdes

Conversation

@joan38

@joan38 joan38 commented May 3, 2018

Copy link
Copy Markdown
Contributor

This is the corresponding PR of lightbend/kafka-streams-scala#70

Serdes are confusing in the Scala wrapper:

  1. We have wrappers around Serializer, Deserializer and Serde which are not very useful.
  2. We have Serdes in 2 places org.apache.kafka.common.serialization.Serde and in com.lightbend.kafka.scala.streams.DefaultSerdes, instead we should be having only one place where to find all the Serdes.

I wanted to do this PR before the release as this is a breaking change.

This shouldn't add more so the current tests should be enough.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@joan38

joan38 commented May 4, 2018

Copy link
Copy Markdown
Contributor Author

This is ready to be reviewed.

@joan38

joan38 commented May 7, 2018

Copy link
Copy Markdown
Contributor Author

@guozhangwang would it be possible to have a look at this before any release?

@guozhangwang guozhangwang left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@debasishg could you also take a look and see if it makes sense to you?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These two window and session serdes are not included in the new class anymore: is this intentional?

@joan38 joan38 May 7, 2018

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a mistake while porting the change from lightbend/kafka-streams-scala, I will add them back.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since we are moving around these classes, we'd also need to double check if any of the corresponding web docs in docs/streams need to be updated. I'd suggest making a pass over the doc changes in #4756 and see if any of them need to be updated accordingly.

For example, if we have in any places mentions about the wrapper serializer / deserializer / etc, we should remove them then.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was thinking about this indeed. I will have a check this evening and push any changes.

@joan38

joan38 commented May 7, 2018

Copy link
Copy Markdown
Contributor Author

@guozhangwang I pushed the correction, let me know if there is anything else.

@guozhangwang guozhangwang left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Leave to @debasishg to make another pass.

@joan38

joan38 commented May 7, 2018

Copy link
Copy Markdown
Contributor Author

Thanks @guozhangwang for your review.

@debasishg

Copy link
Copy Markdown
Contributor

LGTM.

@joan38

joan38 commented May 8, 2018

Copy link
Copy Markdown
Contributor Author

I just pushed with a rebase to make the CI run again since I believe the failing test is a flaky one.

@guozhangwang
guozhangwang merged commit b88d70b into apache:trunk May 8, 2018
@guozhangwang

Copy link
Copy Markdown
Contributor

Thanks @joan38 , merged to trunk!

@joan38
joan38 deleted the serdes branch May 8, 2018 16:15
@joan38

joan38 commented May 8, 2018

Copy link
Copy Markdown
Contributor Author

@guozhangwang @debasishg Thanks

ying-zheng pushed a commit to ying-zheng/kafka that referenced this pull request Jul 6, 2018
Serdes are confusing in the Scala wrapper:

* We have wrappers around Serializer, Deserializer and Serde which are not very useful.
* We have Serdes in 2 places org.apache.kafka.common.serialization.Serde and in DefaultSerdes, instead we should be having only one place where to find all the Serdes.

I wanted to do this PR before the release as this is a breaking change.
This shouldn't add more so the current tests should be enough.

Reviewers: Debasish Ghosh <dghosh@acm.org>, Guozhang Wang <guozhang@confluent.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants