Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support configuring storage class for new objects/files #34

Closed
jamesbornholt opened this issue Dec 24, 2022 · 1 comment · Fixed by #400
Closed

Support configuring storage class for new objects/files #34

jamesbornholt opened this issue Dec 24, 2022 · 1 comment · Fixed by #400
Labels
good first issue Good for newcomers

Comments

@jamesbornholt
Copy link
Member

jamesbornholt commented Dec 24, 2022

Creating new files in S3 Intelligent-Tiering as a default, with an option to write to S3 Standard, S3 Standard-Infrequent Access, S3 Glacier Instant Retrieval, and S3 One Zone-Infrequent Access storage classes instead

We should be able to configure the connector to support creating objects in the immediate retrieval storage classes besides S3 Standard:

  • Intelligent-Tiering
  • Standard-Infrequent Access
  • One Zone-Infrequent Access
  • Glacier Instant Retrieval
@jamesbornholt jamesbornholt converted this from a draft issue Dec 24, 2022
@jamesbornholt jamesbornholt added the good first issue Good for newcomers label Dec 24, 2022
@jamesbornholt jamesbornholt added this to the 1.0 milestone Dec 24, 2022
@jamesbornholt jamesbornholt changed the title Support non-STANDARD storage classes Support non-STANDARD storage classes for writes Feb 7, 2023
@jamesbornholt jamesbornholt changed the title Support non-STANDARD storage classes for writes Support writes to additional storage classes Mar 3, 2023
@jamesbornholt jamesbornholt changed the title Support writes to additional storage classes Writes to additional storage classes Mar 12, 2023
@dannycjones dannycjones changed the title Writes to additional storage classes Create new files in S3 Intelligent-Tiering as a default Mar 14, 2023
@jamesbornholt jamesbornholt changed the title Create new files in S3 Intelligent-Tiering as a default Support other storage classes + create new files in S3 Intelligent-Tiering by default Mar 14, 2023
@dannycjones dannycjones changed the title Support other storage classes + create new files in S3 Intelligent-Tiering by default Support configuring storage class for new objects/files Jul 24, 2023
@dannycjones dannycjones linked a pull request Jul 24, 2023 that will close this issue
@jamesbornholt
Copy link
Member Author

This now works, using the --storage-class option at mount time. See the PutObject documentation for storage class names: https://docs.aws.amazon.com/AmazonS3/latest/API/API_PutObject.html#AmazonS3-PutObject-request-header-StorageClass

For example:

$ mount-s3 DOC-EXAMPLE-BUCKET ~/mnt --storage-class GLACIER
$ cp test20MiB ~/mnt/test20MiB
$ aws s3api head-object --bucket DOC-EXAMPLE-BUCKET --key test20MiB
{
    "AcceptRanges": "bytes",
    "LastModified": "2023-07-28T16:29:34+00:00",
    "ContentLength": 20971520,
    "ETag": "\"1dfe895c9a9b42eca9666ce666836d85-3\"",
    "ContentType": "binary/octet-stream",
    "ServerSideEncryption": "AES256",
    "Metadata": {},
    "StorageClass": "GLACIER"
}

Note that reading of Glacier Flexible Retrieval and Glacier Deep Archive objects isn't supported (#152).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Development

Successfully merging a pull request may close this issue.

1 participant