-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unable to download entire rds log file with download_db_log_file_portion #987
Comments
If I manually start a new request with the marker returned from the last request, the download proceeds, but eventually fails again in a similar way. I am thus able to get all the way to the end of the file with some retry logic. I noticed that the size of the returned data is 1048576 bytes when additional_data_pending=false, but 1048611 when true, so I'm guessing something about the data or how it's processed is causing the abort. |
Here is a work around that works:
|
That makes sense, this looks essentially like multipart download functionality. Looking at this as a feature request now. |
Closing this issue, I've added the feature request and it looks like we have a workaround in the meantime (the feature would just be a high level wrapper around this same workaround). Feel free to reach out if you have any questions or further issues. |
I'm using aws-sdk 2.1.35 to try and download a postgresql rds log file
When using either the block based pagination, or doing it manually, I'm unable to download the entire rds log file. The entire log file is 260MB, but either method only gets 100MB. The final paged request shows additional_data_pending=false, marker ="17:105920837" for either method. I am able to download the entire file using the web console. The code I'm using is shown below.
Is there some other way to download the entire log file? That is, a way to get a handle on the signed url the console generates to download the entire thing directly would be great.
The text was updated successfully, but these errors were encountered: