mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

S3 storage classes expansion

Browse source 
Added support for storageclass=STANDARD_IA to use Amazon's
new Infrequently Accessed storage.

Also allows using storageclass=NEARLINE to use Google's NearLine storage.

The necessary changes to aws to support this are in
https://github.com/aristidb/aws/pull/176
This commit is contained in:
Joey Hess 2015-09-17 17:20:01 -04:00
parent 89238e9595
commit 26d6566307
6 changed files with 42 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

18
doc/bugs/Support_non-default_storage_classes_with_Google_Cloud_Storage/comment_1_a10aaa758daee3ca0b064c60c0382ce8._comment Normal file
View file

@ -0,0 +1,18 @@
[[!comment format=mdwn
username="joey"
subject="""comment 1"""
date="2015-09-17T21:09:24Z"
content="""
It's now possible to use storageclass=NEARLINE, when git-annex is built
with aws-0.13.0. So, the approach of manually creating the bucket with the
desired storage class should work now.
I'm unsure if the first method, of letting git-annex create the bucket,
will work now. Can you test? It may work now too with
storageclass=NEARLINE. While no storage class is currently specified when
creating the bucket (that's not in the S3 api at all); but once the bucket
exists, with whatever storage class is default, git-annex will specify
NEARLINE when storing objects in it. Seems a good chance this will work,
and it'd be easier than extending the aws library with google-specific
features.
"""]]

16
doc/special_remotes/S3.mdwn
View file

@ -37,9 +37,19 @@ the S3 remote.
"us-west-1", "us-west-2", "ap-southeast-1", "ap-southeast-2", and
"sa-east-1".
* `storageclass` - Default is "STANDARD". If you have configured git-annex
to preserve multiple [[copies]], consider setting this to "REDUCED_REDUNDANCY"
to save money.
* `storageclass` - Default is "STANDARD".
Consult S3 provider documentation for pricing details and available
storage classes.
When using Amazon S3, if you have configured git-annex to preserve
multiple [[copies]], consider setting this to "REDUCED_REDUNDANCY"
to save money. Or, if the remote will be used for backup or archival,
and so its files are Infrequently Accessed, "STANDARD_IA" is also a
good choice to save money.
Note that changing the storage class of an existing S3 remote will
affect new objects sent to the remote, but not objects already
stored there.
* `host` and `port` - Specify in order to use a different, S3 compatable
service.