Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restore Data from Glacier Lifecycle to S3 #338

Open
nateiam opened this issue May 13, 2017 · 0 comments
Open

Restore Data from Glacier Lifecycle to S3 #338

nateiam opened this issue May 13, 2017 · 0 comments

Comments

@nateiam
Copy link
Contributor

nateiam commented May 13, 2017

As a Herd Consumer I want to restore a Bdata to S3 that had been archived to Glacier so I can access the data.

Existing restore endpoint currently restores from old Glacier 0d bucket. This story updates restore to work with data archived by the new approach as implemented in #324

Acceptance Criteria

  • Restore is triggered by existing BData Restore POST endpoint.
    • Only change to endpoint is additional input for restore duration. Default if value not provided by user is configurable and defaults to 30d.
  • Herd uses new AWS 'Bulk' restore tier, see AWS documentation
  • Herd checks at configurable interval for completion of restore
  • Once Glacier restore for all S3 Objects (Herd Storage Files) is complete, the following should occur
    • Herd validates metadata against restored files in original S3 locations
    • Herd modifies metadata to reflect completed restore and availability of data
  • Glacier Storage is removed
    • Availability and DDL services behave as expected after data is restored
FINRAOSS pushed a commit that referenced this issue Jun 18, 2018
* commit '05109e2ca0442cf992b344d5d924e26fd8072395':
  DM-10868 Search and manage status of suggested changes to BDef Description
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant