Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky tests for Dec 18, 2024 #18263

Merged
merged 1 commit into from
Dec 19, 2024
Merged

Flaky tests for Dec 18, 2024 #18263

merged 1 commit into from
Dec 19, 2024

Conversation

mumrah
Copy link
Member

@mumrah mumrah commented Dec 18, 2024

Marking a few flaky tests.

@github-actions github-actions bot added core Kafka Broker consumer tests Test fixes (including flaky tests) clients small Small PRs labels Dec 18, 2024
@mumrah
Copy link
Member Author

mumrah commented Dec 18, 2024

cc @jolshan and @AndrewJSchofield -- thanks for filing the JIRAs.

cc @frankvicky and @chia7712 -- WDYT about re-enabling testWakeupAfterSyncGroupReceivedExternalCompletion in the flaky suite?

Copy link
Member

@AndrewJSchofield AndrewJSchofield left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved for the AbstractCoordinatorTest tagging.

@@ -1435,6 +1435,7 @@ public void testWakeupAfterJoinGroupReceivedExternalCompletion() throws Exceptio
awaitFirstHeartbeat(heartbeatReceived);
}

@Tag("flaky") // "KAFKA-18310"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, I was wondering how to do that because @Flaky wasn't doing the job.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should disallow "disabled" flag by import control due to quarantine mechanism.

@@ -870,6 +870,7 @@ class TransactionsTest extends IntegrationTestHarness {
}
}

@Flaky("KAFKA-18306")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have the PR open for this -- #18264, so do we still want to mark it?
As an aside, what is the process for removing the tag? I removed the others in my PR but didn't know if there was a time we wanted to analyze the new results before removing.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think our general strategy should be to aggressive in marking things as flaky, and cautious about un-marking them. There's also no harm in marking something flaky and immediately removing the tag in a subsequent PR (assuming we are confident in the fix).

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would you mind taking a look at my PR fixing it? 😉

Copy link
Contributor

@frankvicky frankvicky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
It's more effective to manage this flaky test instead of disabling it.

@mumrah mumrah merged commit 64279d2 into apache:trunk Dec 19, 2024
8 of 9 checks passed
ijuma added a commit to ijuma/kafka that referenced this pull request Dec 20, 2024
…e-old-protocol-versions

* apache-github/trunk:
  KAFKA-18312: Added entityType: topicName to SubscribedTopicNames in ShareGroupHeartbeatRequest.json (apache#18285)
  HOTFIX: fix incompatible types: Optional<TimestampAndOffset> cannot be converted to Option<TimestampAndOffset> (apache#18284)
  MINOR Fix some test-catalog issues (apache#18272)
  KAFKA-18180: Move OffsetResultHolder to storage module (apache#18100)
  KAFKA-18301; Make coordinator records first class citizen (apache#18261)
  KAFKA-18262 Remove DefaultPartitioner and UniformStickyPartitioner (apache#18204)
  KAFKA-18296 Remove deprecated KafkaBasedLog constructor (apache#18257)
  KAFKA-12829: Remove old Processor and ProcessorSupplier interfaces (apache#18238)
  KAFKA-18292 Remove deprecated methods of UpdateFeaturesOptions (apache#18245)
  KAFKA-12829: Remove deprecated Topology#addProcessor of old Processor API (apache#18154)
  KAFKA-18035, KAFKA-18306, KAFKA-18092: Address TransactionsTest flaky tests (apache#18264)
  MINOR: change the default linger time in the new coordinator (apache#18274)
  KAFKA-18305: validate controller.listener.names is not in inter.broker.listener.name for kcontrollers (apache#18222)
  KAFKA-18207: Serde for handling transaction records (apache#18136)
  KAFKA-13722: Refactor Kafka Streams store interfaces (apache#18243)
  KAFKA-17131: Refactor TimeDefinitions (apache#18241)
  MINOR: Fix MessageFormatters (apache#18266)
  Mark flaky tests for Dec 18, 2024 (apache#18263)
tedyu pushed a commit to tedyu/kafka that referenced this pull request Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
clients consumer core Kafka Broker small Small PRs tests Test fixes (including flaky tests)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants