Skip to content

Fix Kudu tests to also run on MacOS#10802

Merged
hashhar merged 1 commit intotrinodb:masterfrom
grantatspothero:gn/fixKuduTestsOnMac
Feb 1, 2022
Merged

Fix Kudu tests to also run on MacOS#10802
hashhar merged 1 commit intotrinodb:masterfrom
grantatspothero:gn/fixKuduTestsOnMac

Conversation

@grantatspothero
Copy link
Copy Markdown
Contributor

@grantatspothero grantatspothero commented Jan 25, 2022

Resolves #3415

See the comments for the ugly workaround, but the good news is I'm able to run the tests locally without fixed port mappings.

Going to try stress testing multiple instances of the tests and see what happens

Copy link
Copy Markdown
Member

@hashhar hashhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks a lot for getting this to work.

Please squash commits as Use ToxiProxy to forward traffic from host to kudu tablets + some description of why (the javadoc of TestingKuduServer maybe?)

@grantatspothero grantatspothero force-pushed the gn/fixKuduTestsOnMac branch 2 times, most recently from 5a88745 to 710aff6 Compare January 31, 2022 21:14
Copy link
Copy Markdown
Member

@hashhar hashhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

I'll merge once CI is done. (Rebased to ensure maven-checks are now green).

Kudu tablets needs to know the host/mapped port it will be bound to in
order to configure --rpc_advertised_addresses. However when using
non-fixed ports in testcontainers, we only know the mapped port after
the container starts up.

In order to workaround this, create a proxy to forward traffic from the
host to the underlying tablets. Since the ToxiProxy container starts up
*before* kudu, we know the mapped port when configuring the kudu
tablets.
@hashhar hashhar force-pushed the gn/fixKuduTestsOnMac branch from 710aff6 to f081d19 Compare February 1, 2022 08:19
@hashhar hashhar changed the title Gn/fix kudu tests on mac Fix Kudu tests to also run on MacOS Feb 1, 2022
@hashhar hashhar merged commit 148c692 into trinodb:master Feb 1, 2022
@github-actions github-actions bot added this to the 370 milestone Feb 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

Kudu tests cannot be run on Mac

3 participants