Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Outputs bigger than 15G are not being saved #700

Open
JakubKC opened this issue Jan 5, 2021 · 0 comments
Open

[BUG] Outputs bigger than 15G are not being saved #700

JakubKC opened this issue Jan 5, 2021 · 0 comments
Labels
triage Issues that are pending triage / validation by a SHIELD contributor

Comments

@JakubKC
Copy link

JakubKC commented Jan 5, 2021

Describe the bug
Outputs bigger than 15G are not being saved by the s3 plugin on the s3 bucket (they just don't show there after) despite that it says: "upload complete; uploaded xxx bytes of data" and ends with 0 exit code.

To Reproduce
Steps to reproduce the behavior:

  1. Create simple pipe in shell:
pv --stop-at-size -s 15G /dev/zero | \
/shield/plugins/s3 store -e "${SHIELD_STORE_ENDPOINT}"
  1. Run it and verify that it ends successfully, but there is no such file on s3 after.
  2. Change size to for example "-s 14990M" and run again. Verify that now there is a file.

Expected behavior
Size should be limited only by s3 limits:
https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html

Screenshots
If applicable, add screenshots to help explain your problem.

SHIELD versions (please complete the following information):

  • SHIELD 8.7.0
@JakubKC JakubKC added the triage Issues that are pending triage / validation by a SHIELD contributor label Jan 5, 2021
@JakubKC JakubKC changed the title [BUG] [BUG] Outputs bigger than 15G are not being saved Sep 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triage Issues that are pending triage / validation by a SHIELD contributor
Development

No branches or pull requests

1 participant