Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix seek at batchIndex level receive duplicated messages #11826

Merged
merged 1 commit into from
Sep 2, 2021

Conversation

aloyszhang
Copy link
Contributor

@aloyszhang aloyszhang commented Aug 28, 2021

Fixes #11825

Motivation

If AcknowledgmentAtBatchIndexLevelEnabled, consumer may receive duplicated messages after seek to batchIndex.
This pull request tries to resolve this problem.

Modifications

Set the duringSeek before reveived seek response.

Verifying this change

This change added tests and can be verified as follows:
SubscriptionSeekTest.testSeekForBatchMessageAndSpecifiedBatchIndex

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API: (no)
  • The schema: (no)
  • The default values of configurations: (v)
  • The wire protocol: (no)
  • The rest endpoints: (no)
  • The admin cli options: (v)
  • Anything that affects deployment: (no)

Documentation

  • no-need-doc

no doc need since it's a bug fix and has nothing to do with configurations or apis.

Sorry, something went wrong.

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
s
@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang
Copy link
Contributor Author

@hangc0276 @BewareMyPower PTAL

@BewareMyPower BewareMyPower requested review from eolivelli, codelipenghui and wolfstudy and removed request for eolivelli and codelipenghui August 30, 2021 16:21
@BewareMyPower BewareMyPower added area/broker type/bug The PR fixed a bug or issue reported a bug labels Aug 30, 2021
@sijie sijie added this to the 2.9.0 milestone Sep 2, 2021
@codelipenghui codelipenghui merged commit fe4cd09 into apache:master Sep 2, 2021
codelipenghui pushed a commit that referenced this pull request Sep 9, 2021
Fixes #11825 

### Motivation
If AcknowledgmentAtBatchIndexLevelEnabled, consumer may receive duplicated messages after seek to batchIndex.
This pull request tries to resolve this problem.

### Modifications
Set the `duringSeek` before reveived seek response.

### Verifying this change

This change added tests and can be verified as follows:
SubscriptionSeekTest.testSeekForBatchMessageAndSpecifiedBatchIndex

(cherry picked from commit fe4cd09)
@codelipenghui codelipenghui added the cherry-picked/branch-2.8 Archived: 2.8 is end of life label Sep 9, 2021
nicoloboschi pushed a commit to datastax/pulsar that referenced this pull request Oct 27, 2021
Fixes apache#11825

### Motivation
If AcknowledgmentAtBatchIndexLevelEnabled, consumer may receive duplicated messages after seek to batchIndex.
This pull request tries to resolve this problem.

### Modifications
Set the `duringSeek` before reveived seek response.

### Verifying this change

This change added tests and can be verified as follows:
SubscriptionSeekTest.testSeekForBatchMessageAndSpecifiedBatchIndex

(cherry picked from commit fe4cd09)
(cherry picked from commit 6763969)
codelipenghui pushed a commit that referenced this pull request Dec 11, 2021
Fixes #11825

### Motivation
If AcknowledgmentAtBatchIndexLevelEnabled, consumer may receive duplicated messages after seek to batchIndex.
This pull request tries to resolve this problem.

### Modifications
Set the `duringSeek` before reveived seek response.

### Verifying this change

This change added tests and can be verified as follows:
SubscriptionSeekTest.testSeekForBatchMessageAndSpecifiedBatchIndex

(cherry picked from commit fe4cd09)
@codelipenghui codelipenghui added the cherry-picked/branch-2.7 Archived: 2.7 is end of life label Dec 11, 2021
@aloyszhang aloyszhang deleted the seek branch January 20, 2022 14:08
bharanic-dev pushed a commit to bharanic-dev/pulsar that referenced this pull request Mar 18, 2022
Fixes apache#11825 

### Motivation
If AcknowledgmentAtBatchIndexLevelEnabled, consumer may receive duplicated messages after seek to batchIndex.
This pull request tries to resolve this problem.

### Modifications
Set the `duringSeek` before reveived seek response.

### Verifying this change

This change added tests and can be verified as follows:
SubscriptionSeekTest.testSeekForBatchMessageAndSpecifiedBatchIndex
aloyszhang pushed a commit to aloyszhang/pulsar that referenced this pull request Aug 5, 2022
…master branch (merge request !25)


Squash merge branch 'merge-2.8.1.1' into 'inlong-2.8.1.1'
This merge request including two genaral parts.
1. Internal modifies
a) introduce TAuth authentaciation and Apache Ranger authenrization
b) introduce produce&consume metrics at minute level and support reporter for both local file and ngcp
c) add log configurations for local file metric reporter
d) add INLONG-RELEASE log which record all internal changes and cherry-picks 

2. Cherry-picks 
fix ttl expiry does not take effect (apache#12266)
Fix seek at batchIndex level receive duplicated messages (apache#11826)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/client cherry-picked/branch-2.7 Archived: 2.7 is end of life cherry-picked/branch-2.8 Archived: 2.8 is end of life release/2.7.4 release/2.8.2 type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Consumer may receive duplicated message after seek if AcknowledgmentAtBatchIndexLevelEnabled
4 participants