Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MINOR: Await consumer group membership before verifying/modifying sink connector offsets in OffsetsApiIntegrationTest #16519

Conversation

C0urante
Copy link
Contributor

@C0urante C0urante commented Jul 3, 2024

Draft; will flesh out description if this yields positive results.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@C0urante C0urante added connect tests Test fixes (including flaky tests) labels Jul 3, 2024
@C0urante
Copy link
Contributor Author

C0urante commented Jul 8, 2024

I've filed #16551 to run every affected test case 5 times each.

…ink connector offsets in OffsetsApiIntegrationTest
@C0urante C0urante force-pushed the offsets-api-integration-test-wait-for-consumer-groups branch from 9d73236 to 660da5c Compare July 9, 2024 15:36
@C0urante C0urante changed the title MINOR: Await formation of consumer groups before verifying expected sink connector offsets in OffsetsApiIntegrationTest MINOR: Await consumer group membership before verifying expected sink connector offsets in OffsetsApiIntegrationTest Jul 9, 2024
@C0urante C0urante changed the title MINOR: Await consumer group membership before verifying expected sink connector offsets in OffsetsApiIntegrationTest MINOR: Await consumer group membership before verifying/altering sink connector offsets in OffsetsApiIntegrationTest Jul 9, 2024
@C0urante C0urante changed the title MINOR: Await consumer group membership before verifying/altering sink connector offsets in OffsetsApiIntegrationTest MINOR: Await consumer group membership before verifying/modifying sink connector offsets in OffsetsApiIntegrationTest Jul 9, 2024
* @throws InterruptedException if the thread is interrupted while waiting for the consumer
* group to form
*/
private void verifyConsumerGroupMembers(
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: If this method is useful, it will obviate the existing modifySinkConnectorOffsetsWithRetry method, which we will then be able to remove.

@C0urante C0urante force-pushed the offsets-api-integration-test-wait-for-consumer-groups branch from e3c4bfe to 1c443c4 Compare July 9, 2024 17:03
@C0urante
Copy link
Contributor Author

It seems like there's a real consumer bug that's been causing this flakiness: https://issues.apache.org/jira/browse/KAFKA-17115

Closing this PR in favor of the bug fix.

@C0urante C0urante closed this Jul 10, 2024
@C0urante C0urante deleted the offsets-api-integration-test-wait-for-consumer-groups branch July 10, 2024 20:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
connect tests Test fixes (including flaky tests)
Projects
None yet
1 participant