Commit graph

15314 commits

Author SHA1 Message Date
Joey Hess
dc2155c2b8 devblog 2014-08-10 15:17:59 -04:00
http://svario.it/gioele
0da82b1d68 Explain the problem better 2014-08-10 15:57:33 +00:00
Joey Hess
81e1b2078e devblog 2014-08-08 23:25:48 -04:00
Joey Hess
1412056b20 Merge branch 'newchunks' 2014-08-08 23:25:38 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmvzzyDA8uXFz8yokeCrepbh8PwWe_WrjE
d8a865a397 Added a comment: a more recent fork 2014-08-08 16:03:24 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmvzzyDA8uXFz8yokeCrepbh8PwWe_WrjE
5c24841d37 Added a comment: current status? 2014-08-08 16:00:18 +00:00
Joey Hess
a619175732 devbog 2014-08-07 19:57:55 -04:00
Joey Hess
2a94853e75 Merge branch 'master' of ssh://git-annex.branchable.com 2014-08-06 18:40:49 -04:00
Joey Hess
7e55fe6a1f devblog 2014-08-06 18:33:20 -04:00
Joey Hess
aacb0b2823 convert WebDAV to new special remote interface, adding new-style chunking support
Reusing http connection when operating on chunks is not done yet,
I had to submit some patches to DAV to support that. However, this is no
slower than old-style chunking was.

Note that it's a fileRetriever and a fileStorer, despite DAV using
bytestrings that would allow streaming. As a result, upload/download of
encrypted files is made a bit more expensive, since it spools them to temp
files. This was needed to get the progress meters to work.

There are probably ways to avoid that.. But it turns out that the current
DAV interface buffers the whole file content in memory, and I have
sent in a patch to DAV to improve its interfaces. Using the new interfaces,
it's certainly going to need to be a fileStorer, in order to read the file
size from the file (getting the size of a bytestring would destroy
laziness). It should be possible to use the new interface to make it be a
byteRetriever, so I'll change that when I get to it.

This commit was sponsored by Andreas Olsson.
2014-08-06 16:57:06 -04:00
Joey Hess
b4cf22a388 pushed checkPresent exception handling out of Remote implementations
I tend to prefer moving toward explicit exception handling, not away from
it, but in this case, I think there are good reasons to let checkPresent
throw exceptions:

1. They can all be caught in one place (Remote.hasKey), and we know
   every possible exception is caught there now, which we didn't before.
2. It simplified the code of the Remotes. I think it makes sense for
   Remotes to be able to be implemented without needing to worry about
   catching exceptions inside them. (Mostly.)
3. Types.StoreRetrieve.Preparer can only work on things that return a
   Bool, which all the other relevant remote methods already did.
   I do not see a good way to generalize that type; my previous attempts
   failed miserably.
2014-08-06 13:45:19 -04:00
gernot
70740bcc55 2014-08-06 12:53:04 +00:00
http://svario.it/gioele
1c738db295 Revert to normal forum page 2014-08-06 12:06:07 +00:00
https://renaud.casenave.fr/
63321f57fa 2014-08-06 06:50:04 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmraN_ldJplGunVGmnjjLN6jL9s9TrVMGE
a4de1c707d Added a comment: Can annex use existing backends when amending existing files? 2014-08-05 21:35:34 +00:00
gernot
b07b1d8ec8 2014-08-05 20:14:25 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkBTVYS5lTecuenAB01eHgfUxE20vWVpU4
beecf61fe0 How to remove a directory with git-annex added? 2014-08-05 18:07:56 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkBTVYS5lTecuenAB01eHgfUxE20vWVpU4
d0779c815a How to remove a directory with git-annex added? 2014-08-05 18:04:38 +00:00
jg123h12jh3y12g3y
353cf1eaca 2014-08-05 14:46:51 +00:00
annexuser123
f58930f26c Added a comment 2014-08-04 18:00:00 +00:00
zardoz
13827c8a97 Added a comment 2014-08-04 08:05:37 +00:00
http://svario.it/gioele
f12a00f159 Added a comment: Multipart S3 support files > 5 GB 2014-08-04 06:00:45 +00:00
annexuser123
9f3845669f 2014-08-04 01:32:26 +00:00
annexuser123
dd312f26f3 2014-08-04 01:29:09 +00:00
annexuser123
03f97a5f53 2014-08-04 01:04:31 +00:00
Joey Hess
3b577e4358 Merge branch 'master' of ssh://git-annex.branchable.com 2014-08-03 20:36:10 -04:00
Joey Hess
af620198fc devblog 2014-08-03 20:32:26 -04:00
Joey Hess
8587cd40ed Merge branch 'master' into newchunks 2014-08-03 19:48:50 -04:00
Joey Hess
93f20541f5 testremote --fast 2014-08-03 18:08:34 -04:00
Joey Hess
b35f7983ff convert gcrypt to new regime, including chunking
Some reorg of Remote.Rsync code to export the things gcrypt needs.
2014-08-03 17:31:10 -04:00
Joey Hess
e1e5853c94 rsync: support chunking
Chunking does not speed up rsync at all, so it's only useful for
interop with the directory special remote.
2014-08-03 15:07:43 -04:00
Joey Hess
c653e80829 Merge branch 'master' into newchunks 2014-08-03 15:04:10 -04:00
http://joeyh.name/
2d997d4d49 Added a comment 2014-08-03 18:59:58 +00:00
Joey Hess
c648548e1f formatting 2014-08-03 14:56:40 -04:00
http://joeyh.name/
63c00daa08 Added a comment 2014-08-03 18:40:26 +00:00
http://joeyh.name/
ac166a898e Added a comment 2014-08-03 18:27:32 +00:00
http://joeyh.name/
699a0a3bf8 Added a comment 2014-08-03 18:22:58 +00:00
zardoz
ef0404f5d4 2014-08-03 15:25:47 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmkuFJVGp6WVvJtIV5JYb8IqN8mRvSGQdI
116f70555e Added a comment: Would you accept a patch? 2014-08-03 01:18:54 +00:00
Joey Hess
f0adec1288 Merge branch 'master' of ssh://git-annex.branchable.com 2014-08-02 19:18:54 -04:00
Joey Hess
42655caacc correction 2014-08-02 19:16:35 -04:00
http://joeyh.name/
51f774f8c8 Added a comment 2014-08-02 23:13:41 +00:00
Joey Hess
b5eb02bf77 Merge branch 'master' of ssh://git-annex.branchable.com 2014-08-02 19:10:55 -04:00
http://joeyh.name/
2ca8ddca0f Added a comment 2014-08-02 23:08:44 +00:00
Joey Hess
3f8605870e devblog 2014-08-02 19:05:16 -04:00
divB
8fbdcd7d9f 2014-08-02 22:57:48 +00:00
Joey Hess
b261df735d convert bup to new ChunkedEncryptable API (but do not support chunking)
bup already splits files and does rolling deltas, so there is no reason to
use chunking here.

The new API made it easier to add progress support for storeKey, so that's
done. Unfortunately, bup-split still outputs its own progress with -q,
so a little ugly, but not too bad.

Made dropping remove the branch for an object, for two reasons:

1. The new API calls removeKey to roll back a storeKey when the content
   changed unexpectedly.
2. So that testremote will be happy.

Also, fixed a bug that caused a crash when removing the branch for an
object in rollback.
2014-08-02 18:48:49 -04:00
Joey Hess
0c7c39840d Merge branch 'master' into newchunks 2014-08-02 17:25:50 -04:00
Joey Hess
7f5cd868d7 hook: use ChunkedEncryptable 2014-08-02 17:25:16 -04:00
Joey Hess
d4dc1bce75 document that encryption + bup = inneficient 2014-08-02 17:04:40 -04:00