Skip to content

upgrade aws-sdk-go to 1.28.8#5777

Merged
deepthi merged 1 commit intovitessio:masterfrom
planetscale:ds-upgrade-aws-sdk
Jan 31, 2020
Merged

upgrade aws-sdk-go to 1.28.8#5777
deepthi merged 1 commit intovitessio:masterfrom
planetscale:ds-upgrade-aws-sdk

Conversation

@deepthi
Copy link
Copy Markdown
Collaborator

@deepthi deepthi commented Jan 30, 2020

This fixes a problem with vttablet consuming too much memory during a restore from backup when running with option -s3_backup_log_level LogDebugWithRequestRetries

Signed-off-by: deepthi deepthi@planetscale.com

Signed-off-by: deepthi <deepthi@planetscale.com>
@deepthi deepthi requested a review from sougou as a code owner January 30, 2020 22:24
@deepthi deepthi requested a review from enisoc January 30, 2020 22:24
@deepthi deepthi changed the title [WIP] upgrade aws-sdk-go to 1.28.8 upgrade aws-sdk-go to 1.28.8 Jan 31, 2020
@deepthi
Copy link
Copy Markdown
Collaborator Author

deepthi commented Jan 31, 2020

Tested the following cases with a 250G shard:

  1. restore a backup taken with a previous build
  2. take a backup with new build and restore
  3. restore with -s3_backup_log_level=LogDebugWithRequestRetries

There was no difference in memory usage between 2 & 3.

@rafael
Copy link
Copy Markdown
Member

rafael commented Jan 31, 2020

For completeness, prior to this change, were you able to reproduce the issues we were seeing with the memory leak?

Copy link
Copy Markdown
Member

@enisoc enisoc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@deepthi
Copy link
Copy Markdown
Collaborator Author

deepthi commented Jan 31, 2020

For completeness, prior to this change, were you able to reproduce the issues we were seeing with the memory leak?

I did not try the older version with -s3_backup_log_level=LogDebugWithRequestRetries which was identified as the culprit by the team at slack.

EDIT[Feb 3, 2020]:
I restored with the older build and reproduced the OOM, so now we can be completely certain that upgrading the library fixes the problem.

@deepthi deepthi merged commit 05b559d into vitessio:master Jan 31, 2020
@deepthi deepthi deleted the ds-upgrade-aws-sdk branch January 31, 2020 19:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants