mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions
21758 commits 13 branches 451 tags 137 MiB
Commit graph

5385 commits

Author SHA1 Message Date
Joey Hess
8faeb25076 finish multipart support using unreleased update to aws lib to yield etags 
Untested and not even compiled yet.

Testing should include checks that file content streams through without
buffering in memory.

Note that CL.consume causes all the etags to be buffered in memory.
This is probably nearly unavoidable, since a request has to be constructed
that contains the list of etags in its body. (While it might be possible to
stream generation of the body, that would entail making a http request that
dribbles out parts of the body as the multipart uploads complete, which is
not likely to work well..

To limit this being a problem, it's best for partsize to be set to some
suitably large value, like 1gb. Then a full terabyte file will need only
1024 etags to be stored, which will probably use around 1 mb of memory.
 2014-11-03 16:04:55 -04:00
Joey Hess
e535ff8fa4 Merge branch 'master' into s3-aws 2014-10-28 12:39:22 -04:00
http://joeyh.name/
c7684de78e Added a comment 2014-10-24 16:02:24 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmUJBh1lYmvfCCiGr3yrdx-QhuLCSRnU5c
23bd3564d1 Added a comment 2014-10-24 04:49:20 +00:00
http://joeyh.name/
805abd3c8d Added a comment 2014-10-23 21:05:15 +00:00
http://joeyh.name/
9ac288d94f Added a comment 2014-10-23 19:51:46 +00:00
http://joeyh.name/
f8fceecd63 Added a comment 2014-10-23 18:52:49 +00:00
Joey Hess
346f0409a6 Merge branch 'master' of ssh://git-annex.branchable.com into s3-aws 2014-10-23 14:08:34 -04:00
Joey Hess
4eefc12295 Merge branch 'master' into s3-aws 2014-10-23 11:02:14 -04:00
vorlon78
6730ed4b8d 2014-10-23 14:25:19 +00:00
Joey Hess
f5deb32e87 typo 2014-10-22 17:38:14 -04:00
http://joeyh.name/
2dd944f50e Added a comment 2014-10-22 21:36:27 +00:00
Joey Hess
35551d0ed0 Merge branch 'master' into s3-aws 
Conflicts:
	Remote/S3.hs
 2014-10-22 17:14:38 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkck-Tokgfh_1Fwh6pkl69xPA_dYUgA4Tg
0502cb9075 Added a comment 2014-10-22 19:56:23 +00:00
http://joeyh.name/
62e00e766b Added a comment 2014-10-22 18:30:29 +00:00
Joey Hess
98881ffc6e Merge branch 'master' of ssh://git-annex.branchable.com 2014-10-22 13:13:42 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmUJBh1lYmvfCCiGr3yrdx-QhuLCSRnU5c
919485694b 2014-10-22 16:25:54 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkck-Tokgfh_1Fwh6pkl69xPA_dYUgA4Tg
d2aa21b3ee Added a comment: autobuild test 2014-10-21 22:09:47 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkvSZ1AFJdY_1FeutZr_KWeqtzjZta1PNE
0fcf88b1a8 Added a comment 2014-10-21 21:25:57 +00:00
http://joeyh.name/
9450921d68 Added a comment 2014-10-21 20:22:52 +00:00
Joey Hess
f23e6cb146 close 2014-10-21 16:22:12 -04:00
Joey Hess
af50200164 confirmed 2014-10-21 16:20:54 -04:00
http://joeyh.name/
cb54ec04c5 Added a comment 2014-10-21 20:20:25 +00:00
Joey Hess
df4d9fc28d url fix 2014-10-21 16:17:42 -04:00
Joey Hess
4fe2d01d21 retitle 2014-10-21 16:16:26 -04:00
Joey Hess
18a52bdf4c title 2014-10-21 16:10:33 -04:00
Joey Hess
17b66fb4ca move to todo 2014-10-21 16:08:53 -04:00
http://joeyh.name/
f0a7ade340 Added a comment 2014-10-21 20:07:40 +00:00
http://joeyh.name/
8c88b6a290 Added a comment 2014-10-21 20:02:40 +00:00
Joey Hess
658d62835c moreinfo 2014-10-21 16:00:12 -04:00
http://joeyh.name/
607aac4bfc Added a comment 2014-10-21 19:59:06 +00:00
Joey Hess
8387fac14e close 2014-10-21 15:56:52 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkvSZ1AFJdY_1FeutZr_KWeqtzjZta1PNE
2715ec0129 Added a comment 2014-10-21 17:47:35 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkvSZ1AFJdY_1FeutZr_KWeqtzjZta1PNE
d30679cc47 Added a comment 2014-10-21 17:35:17 +00:00
Joey Hess
15273015bb Merge branch 'master' of ssh://git-annex.branchable.com 2014-10-21 12:38:09 -04:00
Joey Hess
f09c91fc77 comment 2014-10-21 12:32:11 -04:00
http://joeyh.name/
fa130887a9 Added a comment 2014-10-21 16:31:04 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkvSZ1AFJdY_1FeutZr_KWeqtzjZta1PNE
511bd422f4 Added a comment 2014-10-21 04:10:16 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkck-Tokgfh_1Fwh6pkl69xPA_dYUgA4Tg
a9ac0c304a Added a comment: autobuild 2014-10-20 22:39:25 +00:00
https://id.koumbit.net/anarcat
f4cee141ec yet another 2014-10-20 19:59:54 +00:00
Joey Hess
fced322834 glacier: Fix pipe setup when calling glacier-cli to retrieve an object. 2014-10-20 15:11:01 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmfNiSqDmIbHqpAFhCpPLnO2BuEzTzJ6qI
83ea6aec2d 2014-10-18 13:43:38 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkck-Tokgfh_1Fwh6pkl69xPA_dYUgA4Tg
d6068bb26f formating, activate email comments 2014-10-16 22:49:38 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkck-Tokgfh_1Fwh6pkl69xPA_dYUgA4Tg
a1720ae456 2014-10-16 22:39:20 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlZ-6dtxJY4cP7shhvV8E6YyuV0Rak8it4
005be6625a Added a comment: I messed up that repo 2014-10-16 13:31:15 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlZ-6dtxJY4cP7shhvV8E6YyuV0Rak8it4
72c67a27ce 2014-10-16 12:08:52 +00:00
http://joeyh.name/
ff6894d63a Added a comment 2014-10-15 17:30:45 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnmF_9CAtfqdZkC4e-_dCX-rK5bqh4RWkw
f9aaabbe29 Added a comment: Not on hackage 2014-10-15 15:34:02 +00:00
Joey Hess
09946d245d close 2014-10-14 18:36:02 -04:00
https://www.google.com/accounts/o8/id?id=AItOawnmF_9CAtfqdZkC4e-_dCX-rK5bqh4RWkw
686ffa2416 2014-10-14 20:30:08 +00:00