Skip to content

Allow setting grpc send and recv message sizes independently#481

Merged
pbibra merged 4 commits intoslack-15.0from
hnr-separate-grpc-size-flags
Aug 12, 2024
Merged

Allow setting grpc send and recv message sizes independently#481
pbibra merged 4 commits intoslack-15.0from
hnr-separate-grpc-size-flags

Conversation

@henryr
Copy link

@henryr henryr commented Aug 9, 2024

We would like to set the send and recv max message sizes independently on vtgates. This allows us to keep a small limit on the size of the messages received from tablets, while allowing vtgates to send a large aggregated response to clients.

Two new flags are added: grpc_max_message_send_size and grpc_max_message_recv_size. These are 0 by default, in which case the existing grpc_max_message_size flag is used with no change from the existing behaviour. If set to non-0, they override the setting for grpc_max_message_size.

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
@henryr henryr requested a review from a team as a code owner August 9, 2024 14:07
@github-actions github-actions bot added this to the v15.0.5 milestone Aug 9, 2024
Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
rjlaine
rjlaine previously approved these changes Aug 9, 2024
Copy link

@rjlaine rjlaine left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pbibra
Copy link

pbibra commented Aug 9, 2024

this lgtm! I think we'll want to update all the txt help files with the two new flags to get some of the unit tests passing. Since they all use these grpc common options

topo2topo.txt
vtbackup.txt
vtbench.txt
vtclient.txt
vtcombo.txt
vtctlclient.txt
vtctld.txt
vtctldclient.txt
vtgate.txt
vtgateclienttest.txt
vtorc.txt
vttablet.txt
vttestserver.txt

@henryr
Copy link
Author

henryr commented Aug 12, 2024

@pbibra where are those files? I don't see them in my slack-15 checkout (alternatively, which tests should I run locally to trigger those failures?)

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
@henryr
Copy link
Author

henryr commented Aug 12, 2024

@pbibra I found some of them, let me know if others (like topo2topo.txt) still need updating.

rjlaine
rjlaine previously approved these changes Aug 12, 2024
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
@pbibra
Copy link

pbibra commented Aug 12, 2024

@pbibra I found some of them, let me know if others (like topo2topo.txt) still need updating.

No sorry! That list was from the v19 branch - you got all of them here! The tests are in flags_test.go and can be run locally after running make build.

/usr/bin/go test -timeout 30s -run ^TestHelpOutput$ vitess.io/vitess/go/flags/endtoend

@pbibra pbibra merged commit 0f06ea0 into slack-15.0 Aug 12, 2024
@pbibra pbibra deleted the hnr-separate-grpc-size-flags branch August 12, 2024 21:48
tanjinx pushed a commit that referenced this pull request Oct 24, 2024
* Allow setting grpc send and recv message sizes independently

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Add comments

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Update .txt files

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* update help txt ordering

Signed-off-by: Priya Bibra <pbibra@slack-corp.com>

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>
tanjinx added a commit that referenced this pull request Oct 24, 2024
…ntly (#481) (#540)

* Allow setting grpc send and recv message sizes independently (#481)

* Allow setting grpc send and recv message sizes independently

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Add comments

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Update .txt files

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* update help txt ordering

Signed-off-by: Priya Bibra <pbibra@slack-corp.com>

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>

* remove vtgr

* fix test

* fix spaces

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Henry Robinson <hrobinson@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>
tanjinx added a commit that referenced this pull request Feb 3, 2026
…ntly (#481) (#540)

* Allow setting grpc send and recv message sizes independently (#481)

* Allow setting grpc send and recv message sizes independently

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Add comments

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Update .txt files

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* update help txt ordering

Signed-off-by: Priya Bibra <pbibra@slack-corp.com>

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>

* remove vtgr

* fix test

* fix spaces

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Henry Robinson <hrobinson@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>
Signed-off-by: Tanjin Xu <tanjin.xu@slack-corp.com>
tanjinx added a commit that referenced this pull request Feb 3, 2026
…sizes independe… (#787)

* forward-fit: Allow setting grpc send and recv message sizes independently (#481) (#540)

* Allow setting grpc send and recv message sizes independently (#481)

* Allow setting grpc send and recv message sizes independently

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Add comments

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Update .txt files

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* update help txt ordering

Signed-off-by: Priya Bibra <pbibra@slack-corp.com>

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>

* remove vtgr

* fix test

* fix spaces

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Henry Robinson <hrobinson@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>
Signed-off-by: Tanjin Xu <tanjin.xu@slack-corp.com>

* Remove accidentally committed vtgateproxy binary

Co-Authored-By: Claude <svc-devxp-claude@slack-corp.com>
Signed-off-by: Tanjin Xu <tanjin.xu@slack-corp.com>

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Signed-off-by: Tanjin Xu <tanjin.xu@slack-corp.com>
Co-authored-by: Henry Robinson <hrobinson@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Claude <svc-devxp-claude@slack-corp.com>
sbaker617 pushed a commit that referenced this pull request Feb 5, 2026
…sizes independe… (#787)

* forward-fit: Allow setting grpc send and recv message sizes independently (#481) (#540)

* Allow setting grpc send and recv message sizes independently (#481)

* Allow setting grpc send and recv message sizes independently

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Add comments

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* Update .txt files

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>

* update help txt ordering

Signed-off-by: Priya Bibra <pbibra@slack-corp.com>

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>

* remove vtgr

* fix test

* fix spaces

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Henry Robinson <hrobinson@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>
Signed-off-by: Tanjin Xu <tanjin.xu@slack-corp.com>

* Remove accidentally committed vtgateproxy binary

Co-Authored-By: Claude <svc-devxp-claude@slack-corp.com>
Signed-off-by: Tanjin Xu <tanjin.xu@slack-corp.com>

---------

Signed-off-by: Henry Robinson <hrobinson@slack-corp.com>
Signed-off-by: Priya Bibra <pbibra@slack-corp.com>
Signed-off-by: Tanjin Xu <tanjin.xu@slack-corp.com>
Co-authored-by: Henry Robinson <hrobinson@slack-corp.com>
Co-authored-by: Priya Bibra <pbibra@slack-corp.com>
Co-authored-by: Claude <svc-devxp-claude@slack-corp.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants