-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Fail fast option in ProcessAll, so that file write errors can be fatal. #906
Conversation
Pull Request Test Coverage Report for Build 5952
💛 - Coveralls |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 6 of 7 files at r1.
Reviewable status:complete! 1 of 1 approvals obtained (waiting on @gfr10598 and @stephen-soltesz)
storage/storage.go, line 61 at r1 (raw file):
return nil, false, err } else if strings.Contains(err.Error(), "unexpected EOF") { // We are seeing these metrics, but logs at 113
I don't understand this comment.
storage/storage.go, line 365 at r1 (raw file):
return rdr, 0, err } attr, err := obj.Attrs(ctx)
I added this comment in the draft PR. #902
This is a bug. attr
is not guaranteed to be valid when err != nil
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewable status:
complete! 1 of 1 approvals obtained (waiting on @gfr10598 and @stephen-soltesz)
storage/storage.go, line 61 at r1 (raw file):
Previously, stephen-soltesz (Stephen Soltesz) wrote…
I don't understand this comment.
I think I was mistaken. I've improved the comments near line 113, and change next to nextHeader here. I think I may have been confused because the metric labels weren't distinct before.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewable status:
complete! 1 of 1 approvals obtained (waiting on @stephen-soltesz)
storage/storage.go, line 365 at r1 (raw file):
Previously, stephen-soltesz (Stephen Soltesz) wrote…
I added this comment in the draft PR. #902
This is a bug.
attr
is not guaranteed to be valid whenerr != nil
.
Done.
When we move to GCS json output, we need to be able to terminate parsing if there is a write error.
This also migrates some APIs to use stiface.Client to allow future injection of fakes.
This change is