Commit graph

2498 commits

Author SHA1 Message Date
Joey Hess
b4cf22a388 pushed checkPresent exception handling out of Remote implementations
I tend to prefer moving toward explicit exception handling, not away from
it, but in this case, I think there are good reasons to let checkPresent
throw exceptions:

1. They can all be caught in one place (Remote.hasKey), and we know
   every possible exception is caught there now, which we didn't before.
2. It simplified the code of the Remotes. I think it makes sense for
   Remotes to be able to be implemented without needing to worry about
   catching exceptions inside them. (Mostly.)
3. Types.StoreRetrieve.Preparer can only work on things that return a
   Bool, which all the other relevant remote methods already did.
   I do not see a good way to generalize that type; my previous attempts
   failed miserably.
2014-08-06 13:45:19 -04:00
Joey Hess
b261df735d convert bup to new ChunkedEncryptable API (but do not support chunking)
bup already splits files and does rolling deltas, so there is no reason to
use chunking here.

The new API made it easier to add progress support for storeKey, so that's
done. Unfortunately, bup-split still outputs its own progress with -q,
so a little ugly, but not too bad.

Made dropping remove the branch for an object, for two reasons:

1. The new API calls removeKey to roll back a storeKey when the content
   changed unexpectedly.
2. So that testremote will be happy.

Also, fixed a bug that caused a crash when removing the branch for an
object in rollback.
2014-08-02 18:48:49 -04:00
Joey Hess
0f7b8de91b update roadmap 2014-08-01 18:22:13 -04:00
Joey Hess
5aa2286e7b Merge branch 'newchunks'
I am happy enough with this to make it live!
2014-08-01 18:00:47 -04:00
Joey Hess
83c58f17e0 mention possibility of parallel chunk upload/download 2014-07-30 10:43:21 -04:00
Joey Hess
b39506d1cf expand to rolling hash based design 2014-07-28 17:11:37 -04:00
Joey Hess
2474cf0032 make explicit the implicit requirement that CHECKPRESENT not say a key is present until it's all done being stored 2014-07-28 14:37:22 -04:00
Joey Hess
e47182920c chunk log format should be extensible to allow for eg, logging when rolling hash chunks are used 2014-07-28 13:00:46 -04:00
Joey Hess
85d17a698d Merge branch 'master' into newchunks
Conflicts:
	doc/design/assistant/chunks.mdwn
2014-07-27 12:24:03 -04:00
Joey Hess
729d38a763 update 2014-07-27 12:23:28 -04:00
Joey Hess
1755c5de40 thought about chunk key hashing 2014-07-25 15:12:51 -04:00
Joey Hess
e2c44bf656 implement chunk logs
Slightly tricky as they are not normal UUIDBased logs, but are instead maps
from (uuid, chunksize) to chunkcount.

This commit was sponsored by Frank Thomas.
2014-07-24 16:23:36 -04:00
Joey Hess
d751591ac8 add chunk metadata to Key
Added new fields for chunk number, and chunk size. These will not appear
in normal keys ever, but will be used for chunked data stored on special
remotes.

This commit was sponsored by Jouni K Seppanen.
2014-07-24 13:36:23 -04:00
Joey Hess
937197842e update 2014-07-24 12:41:34 -04:00
Joey Hess
ca1d80d708 chunk then encrypt 2014-07-23 22:38:14 -04:00
Joey Hess
a354bf488b link 2014-07-23 17:56:26 -04:00
Joey Hess
f15c1fdc8f minor 2014-07-23 17:55:28 -04:00
Joey Hess
20627e9fab 4 designs for better chunking
Having a hard time finding a way to totally obscure file sizes, but
otherwise happy with design #4.

This commit was sponsored by Michael Alan Dorman.
2014-07-23 17:41:48 -04:00
134.102.206.230
2ed3679809 poll vote (/sdcard/annex) 2014-07-21 12:40:30 +00:00
Joey Hess
eb015a1c96 update month 2014-07-08 12:39:07 -04:00
66.87.139.102
00cda7d582 poll vote (OpenStack SWIFT) 2014-07-07 05:44:00 +00:00
202.6.117.189
3cfcd54dad poll vote (OpenStack SWIFT) 2014-07-03 00:30:26 +00:00
86.132.35.224
91617d4a69 poll vote (Box.com (done)) 2014-06-28 19:32:13 +00:00
212.79.181.167
15133688c9 poll vote (My phone (or MP3 player)) 2014-06-28 00:23:11 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnwfqF4wL6l_O26RyzoBowUMvQ_955Vpao
0a478056dd Added a comment 2014-06-14 06:29:55 +00:00
Joey Hess
a7c15d0e51 update 2014-06-12 18:46:07 -04:00
Joey Hess
5903f438f0 change month 2014-06-04 15:16:26 -04:00
Joey Hess
a3be4c8f09 fix dead link 2014-06-04 15:16:03 -04:00
Joey Hess
0d70e36466 fix broken link 2014-05-30 15:32:42 -04:00
Joey Hess
970605964c
remove spam comment (will ban this spammer's openid) 2014-05-29 13:20:34 -04:00
https://www.google.com/accounts/o8/id?id=AItOawlAx-pYJ036y2lgKtLJvXm7s-HFRBiJlZY
730710b097 Added a comment 2014-05-28 13:27:20 +00:00
92.192.126.78
7a10cec87e poll vote (Same as for regular git-annex. ~/annex/) 2014-05-28 08:55:36 +00:00
Joey Hess
80e4d10afb update 2014-05-23 12:09:02 -04:00
http://joeyh.name/
8c92e0fb2e Added a comment 2014-05-19 15:47:19 +00:00
2a02:898:109::201:1
8544dd752f poll vote (/sdcard/annex) 2014-05-16 18:57:18 +00:00
Joey Hess
88d2a61947 update some comments re ssh password entry on Android 2014-05-15 15:20:24 -04:00
Joey Hess
dc72ea4ab5 deal with ssh key expiry
Not a perfect solution, but good enough, few users will wait 10 minutes in
the middle and see it expire, I hope.
2014-05-15 15:16:37 -04:00
Joey Hess
acbac3b8af Merge branch 'master' into sshpassword 2014-05-15 14:42:33 -04:00
Joey Hess
8cf3534194 gcrypt needs a new version, which I am releaseing 2014-05-15 14:36:39 -04:00
Joey Hess
a11176bab3 avoid clobbering existing env
This is necessary on windows, ssh couldn't resolve hostnames without env
for whatever reason.
2014-05-14 16:36:03 -04:00
Joey Hess
85e9e8c0cf webapp: Better ssh password prompting.
When setting up a remote on a ssh server, prompt for a password inside the
webapp, rather than relying on ssh's own password prompting in the terminal
the webapp was started from, or ssh-askpass.

Avoids double prompting for the ssh password (and triple-prompting on
windows for rsync.net), since the entered password is cached for 10 minutes
and this cached password is reused when setting up the repository, after
the initial probe.

When the user has an existing ssh key set up, they can choose to use it,
rather than entering a password. The webapp used to probe for this case
automatically, so this is a little harder, but it's an advanced user thing.

Note that this commit is known to break enabling existing rsync
repositories. It hs not been tested with gcrypt repositories. It's not been
successfully tested yet on Windows.

This commit was sponsored by Ralph Mayer.
2014-05-14 15:38:32 -04:00
212.194.32.144
51ea854367 poll vote (Google Drive) 2014-05-11 21:19:09 +00:00
Joey Hess
6abc6fe9d6 keep track of satisfied requests, and summarize 2014-05-09 16:41:05 -03:00
Joey Hess
4a99d835ba example preferred content expressions 2014-05-09 13:34:36 -03:00
Joey Hess
309fd966e7 update 2014-05-09 12:47:08 -03:00
http://johan.kiviniemi.name/
4d2a244a22 Added a comment 2014-05-07 06:27:11 +00:00
Joey Hess
312d82a2fd
devblog 2014-05-06 17:53:22 -03:00
Joey Hess
217774f72e Merge branch 'master' of ssh://git-annex.branchable.com 2014-05-06 16:33:06 -03:00
Joey Hess
5230c78bb6 reorg and add a start of a design for requests and ad-hoc routing with TTL in git-annex branch 2014-05-06 16:32:41 -03:00
50.56.228.64
52173d97c0 poll vote (OpenStack SWIFT) 2014-05-05 17:14:06 +00:00