Confluent: Sync AK/3.0 to CCS/3.0 up to 14 sep 2022 - #798
Merged
Conversation
When running our Connect system tests with JDK 10+, we hit the error
AttributeError: 'ClusterNode' object has no attribute 'version'
because util.py attempts to check the version variable for non-Kafka service objects.
Reviewers: Konstantine Karantasis <k.karantasis@gmail.com>
…s log message (apache#12201) Minor change to use ' and not LEFT SINGLE QUOTATION MARK in this log message, as it's the only place we are using such a quote and it can break ingestion pipelines Reviewers: Kvicii <Karonazaba@gmail.com>, Divij Vaidya <diviv@amazon.com>, Konstantine Karantasis <k.karantasis@gmail.com>
…#12371) The NPE causes the kraft controller to be in an inconsistent state. Reviewers: Jason Gustafson <jason@confluent.io>
… the offset map (apache#12390) When cleaning a topic with transactional data, if the keys used in the user data happen to conflict with the keys in the transaction markers, it is possible for the markers to get removed before the corresponding data from the transaction is removed. This results in a hanging transaction or the loss of the transaction's atomicity since it would effectively get bundled into the next transaction in the log. Currently control records are excluded when building the offset map, but not when doing the cleaning. This patch fixes the problem by checking for control batches in the `shouldRetainRecord` callback. Reviewers: Jun Rao <junrao@gmail.com>
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Aaron Freeland <afreeland@gmail.com>
When deserializing KRPC (which is used for RPCs sent to Kafka, Kafka Metadata records, and some other things), check that we have at least N bytes remaining before allocating an array of size N. Remove DataInputStreamReadable since it was hard to make this class aware of how many bytes were remaining. Instead, when reading an individual record in the Raft layer, simply create a ByteBufferAccessor with a ByteBuffer containing just the bytes we're interested in. Add SimpleArraysMessageTest and ByteBufferAccessorTest. Also add some additional tests in RequestResponseTest. Reviewers: Tom Bentley <tbentley@redhat.com>, Mickael Maison <mickael.maison@gmail.com>, Colin McCabe <colin@cmccabe.xyz> Co-authored-by: Colin McCabe <colin@cmccabe.xyz> Co-authored-by: Manikumar Reddy <manikumar.reddy@gmail.com> Co-authored-by: Mickael Maison <mickael.maison@gmail.com>
…ests This adds a new configuration `sasl.server.max.receive.size` that sets the maximum receive size for requests before and during authentication. Reviewers: Tom Bentley <tbentley@redhat.com>, Mickael Maison <mickael.maison@gmail.com> Co-authored-by: Manikumar Reddy <manikumar.reddy@gmail.com> Co-authored-by: Mickael Maison <mickael.maison@gmail.com>
Reviewers: Mickael Maison <mickael.maison@gmail.com>
…e#12376) Reviewers: Luke Chen <showuon@gmail.com>
3.0.2-rc0
…2022 * apache-kafka/3.0: (15 commits) MINOR: Update 3.0 branch version to 3.0.3-SNAPSHOT Upgrade Netty and Jackson versions for CVE fixes [KAFKA-14044] (apache#12376) Bump version to 3.0.2 KAFKA-10712; Update release scripts to Python3 (apache#11538) MINOR: Update LICENSE-binary MINOR: Update docs/upgrade.html MINOR: Update version to 3.0.2 MINOR: Add configurable max receive size for SASL authentication requests MINOR: Add more validation during KRPC deserialization MINOR: Add note on IDEMPOTENT_WRITE ACL to notable changes (apache#12260) ...
Feng Min (fmin)
requested review from
Anastasia Vela (anatasiavela),
Ismael Juma (ijuma) and
Manikumar Reddy (omkreddy)
September 14, 2022 21:37
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
13 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Notable merge conflict.
Commits:
* apache-kafka/3.0: (15 commits)
MINOR: Update 3.0 branch version to 3.0.3-SNAPSHOT
Upgrade Netty and Jackson versions for CVE fixes [KAFKA-14044] (apache#12376)
Bump version to 3.0.2
KAFKA-10712; Update release scripts to Python3 (apache#11538)
MINOR: Update LICENSE-binary
MINOR: Update docs/upgrade.html
MINOR: Update version to 3.0.2
MINOR: Add configurable max receive size for SASL authentication requests
MINOR: Add more validation during KRPC deserialization
MINOR: Add note on IDEMPOTENT_WRITE ACL to notable changes (apache#12260)