git-annex/Remote
Joey Hess 8faeb25076 finish multipart support using unreleased update to aws lib to yield etags
Untested and not even compiled yet.

Testing should include checks that file content streams through without
buffering in memory.

Note that CL.consume causes all the etags to be buffered in memory.
This is probably nearly unavoidable, since a request has to be constructed
that contains the list of etags in its body. (While it might be possible to
stream generation of the body, that would entail making a http request that
dribbles out parts of the body as the multipart uploads complete, which is
not likely to work well..

To limit this being a problem, it's best for partsize to be set to some
suitably large value, like 1gb. Then a full terabyte file will need only
1024 etags to be stored, which will probably use around 1 mb of memory.
2014-11-03 16:04:55 -04:00
..
Directory pushed checkPresent exception handling out of Remote implementations 2014-08-06 13:45:19 -04:00
External unify exception handling into Utility.Exception 2014-08-07 22:03:29 -04:00
Helper enable frankfurt 2014-10-23 11:02:24 -04:00
Rsync rsync special remote: Fix slashes when used on Windows. 2014-03-18 13:02:10 -04:00
WebDAV WebDAV: Avoid buffering whole file in memory when downloading. 2014-08-08 13:40:55 -04:00
Bup.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
Ddar.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
Directory.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
External.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
GCrypt.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
Git.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
Glacier.hs include creds info for glacier and webdav 2014-10-22 13:56:14 -04:00
Hook.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
List.hs factor out getRemoteGitConfig 2014-05-16 16:08:20 -04:00
Rsync.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
S3.hs finish multipart support using unreleased update to aws lib to yield etags 2014-11-03 16:04:55 -04:00
Tahoe.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
Web.hs add per-remote-type info 2014-10-21 14:36:09 -04:00
WebDAV.hs include creds info for glacier and webdav 2014-10-22 13:56:14 -04:00