Commit graph

5570 commits

Author SHA1 Message Date
Joey Hess
47a69c3eea current status 2014-11-03 21:13:59 -04:00
Joey Hess
628304136b Merge branch 'master' into s3-aws-multipart 2014-11-03 18:37:32 -04:00
Joey Hess
068bcdb3f3 comment 2014-11-03 17:31:12 -04:00
Joey Hess
a3ec6ed73b Merge branch 'master' into s3-aws-multipart 2014-11-03 16:05:03 -04:00
Joey Hess
8faeb25076 finish multipart support using unreleased update to aws lib to yield etags
Untested and not even compiled yet.

Testing should include checks that file content streams through without
buffering in memory.

Note that CL.consume causes all the etags to be buffered in memory.
This is probably nearly unavoidable, since a request has to be constructed
that contains the list of etags in its body. (While it might be possible to
stream generation of the body, that would entail making a http request that
dribbles out parts of the body as the multipart uploads complete, which is
not likely to work well..

To limit this being a problem, it's best for partsize to be set to some
suitably large value, like 1gb. Then a full terabyte file will need only
1024 etags to be stored, which will probably use around 1 mb of memory.
2014-11-03 16:04:55 -04:00
https://www.google.com/accounts/o8/id?id=AItOawlUGPPMvAP5Hu0NyNqeRMPC4pANeJNHZ0o
3dcc73e8ba 2014-11-03 18:17:56 +00:00
Joey Hess
46180eab4d todo item 2014-11-03 13:06:26 -04:00
Joey Hess
4f80dcc02a comment 2014-11-03 13:05:21 -04:00
Joey Hess
e57745b8d6 followup 2014-11-03 13:02:31 -04:00
Joey Hess
2819a466c7 close non-bug 2014-11-03 12:50:44 -04:00
https://gregy.mojeid.cz/#RQxWK6xlii
ec2c4bf67c 2014-11-03 10:21:31 +00:00
https://gregy.mojeid.cz/#RQxWK6xlii
8887b6df78 2014-11-03 10:10:59 +00:00
https://gregy.mojeid.cz/#RQxWK6xlii
fb1a3d2867 2014-11-03 10:08:00 +00:00
https://gregy.mojeid.cz/#RQxWK6xlii
6ed2654ada 2014-11-03 10:04:36 +00:00
https://www.google.com/accounts/o8/id?id=AItOawk9SYh6N-JUMkYkW4aOk55zC3Vr9KonDV4
3fd6a3171b 2014-11-02 19:19:28 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmp1ThsNNAbSn46ju-gwFELfStlhl8usJo
3630a12420 2014-11-02 13:03:49 +00:00
https://id.koumbit.net/lavamind
8e7dd00353 2014-11-02 00:25:53 +00:00
http://svario.it/gioele
e99809528b new bug "git annex status does not report added files" 2014-11-01 16:53:07 +00:00
https://renaud.casenave.fr/
a029e55878 2014-11-01 01:57:53 +00:00
Joey Hess
bfac20c744 comment 2014-10-31 17:23:02 -04:00
Joey Hess
0f6aaf8012 Windows: Fix crash when user.name is not set in git config. 2014-10-31 16:14:12 -04:00
Joey Hess
8c622ec100 commnt 2014-10-31 15:48:52 -04:00
Joey Hess
86b326782a getUserEntryForID does not work on windows
Throw an error instead, mentioning the relevant env vars.
2014-10-31 15:46:44 -04:00
http://jaen.saul.ee/id/
0da54c7ddd Added a comment: Re: why this happened 2014-10-30 19:04:57 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
0fbcfe09cf Added a comment 2014-10-30 18:07:28 +00:00
anarcat
680b056405 Added a comment 2014-10-30 15:22:32 +00:00
anarcat
c87e84fc90 add more information 2014-10-30 14:33:46 +00:00
anarcat
723653ab69 weird multiple password prompts problem 2014-10-30 14:21:20 +00:00
https://www.google.com/accounts/o8/id?id=AItOawn7OQLFQ6yc9sK5O6ekgYhLrZhqtm4JZBM
6a9c044caa 2014-10-29 22:29:29 +00:00
https://www.google.com/accounts/o8/id?id=AItOawn7OQLFQ6yc9sK5O6ekgYhLrZhqtm4JZBM
bc0830af0d 2014-10-29 22:28:14 +00:00
Joey Hess
c6f0a65832 close 2014-10-28 16:03:45 -04:00
Joey Hess
39dd5a2ac3 improve uuid mismatch message 2014-10-28 15:54:44 -04:00
Joey Hess
703d3d0bb7 Merge branch 'master' of ssh://git-annex.branchable.com 2014-10-28 14:45:56 -04:00
Joey Hess
2bcea7366b WIP branch 2014-10-28 14:43:07 -04:00
poelzi
6246514ef5 2014-10-28 18:23:27 +00:00
Joey Hess
dcaf89da2f aws library now supports multipart; initial design 2014-10-28 13:06:24 -04:00
Joey Hess
e535ff8fa4 Merge branch 'master' into s3-aws 2014-10-28 12:39:22 -04:00
http://joeyh.name/
c7684de78e Added a comment 2014-10-24 16:02:24 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmUJBh1lYmvfCCiGr3yrdx-QhuLCSRnU5c
23bd3564d1 Added a comment 2014-10-24 04:49:20 +00:00
http://joeyh.name/
805abd3c8d Added a comment 2014-10-23 21:05:15 +00:00
http://joeyh.name/
9ac288d94f Added a comment 2014-10-23 19:51:46 +00:00
http://joeyh.name/
f8fceecd63 Added a comment 2014-10-23 18:52:49 +00:00
Joey Hess
346f0409a6 Merge branch 'master' of ssh://git-annex.branchable.com into s3-aws 2014-10-23 14:08:34 -04:00
Joey Hess
4eefc12295 Merge branch 'master' into s3-aws 2014-10-23 11:02:14 -04:00
vorlon78
6730ed4b8d 2014-10-23 14:25:19 +00:00
Joey Hess
f5deb32e87 typo 2014-10-22 17:38:14 -04:00
http://joeyh.name/
2dd944f50e Added a comment 2014-10-22 21:36:27 +00:00
Joey Hess
35551d0ed0 Merge branch 'master' into s3-aws
Conflicts:
	Remote/S3.hs
2014-10-22 17:14:38 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkck-Tokgfh_1Fwh6pkl69xPA_dYUgA4Tg
0502cb9075 Added a comment 2014-10-22 19:56:23 +00:00
http://joeyh.name/
62e00e766b Added a comment 2014-10-22 18:30:29 +00:00