diff options
| author |  Joey Hess <joey@kitenet.net> | 2014-10-28 14:17:30 -0400 |
|---|---|---|
| committer | Joey Hess <joey@kitenet.net> | 2014-10-28 14:17:30 -0400 |
| commit | 9d7f923e5b3466a8fe3b34781483cb6a115fe5fc (patch) | |
| tree | 3be9f8251d87838acc5d95a5b3fa6c2170535cd7 /doc/special_remotes | |
| parent | 7d2548531ce895d909081b2eb3e594ebf4348ba7 (diff) | |
WIP multipart S3 upload
I'm a little stuck on getting the list of etags of the parts.
This seems to require taking the md5 of each part locally,
which doesn't get along well with lazily streaming in the part from the
file. It would need to read the file twice, or lose laziness and buffer a
whole part -- but parts might be quite large.
This seems to be a problem with the API provided; S3 is supposed to return
an etag, but that is not exposed. I have filed a bug:
https://github.com/aristidb/aws/issues/141
Diffstat (limited to 'doc/special_remotes')
| -rw-r--r-- | doc/special_remotes/S3.mdwn | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/doc/special_remotes/S3.mdwn b/doc/special_remotes/S3.mdwn index 492c247cb..c7c6f76c5 100644 --- a/doc/special_remotes/S3.mdwn +++ b/doc/special_remotes/S3.mdwn @@ -21,6 +21,11 @@ the S3 remote. * `chunk` - Enables [[chunking]] when storing large files. `chunk=1MiB` is a good starting point for chunking. +* `partsize` - Specifies the largest object to attempt to store in the + bucket. Multipart uploads will be used when storing larger objects. + This is not enabled by default, but can be enabled or changed at any + time. Setting `partsize=1GiB` is reasonable for S3. + * `keyid` - Specifies the gpg key to use for [[encryption]]. * `embedcreds` - Optional. Set to "yes" embed the login credentials inside |