Commit graph

73 commits

Author SHA1 Message Date
Joey Hess
cefbfc678d
document what importKey returning Nothing does
That was added for thirdpartypopulated remotes, but for others it also
has the effect of skipping including the file in the imported tree.
2020-12-30 13:23:16 -04:00
Joey Hess
c2d6f335a6
notes on ImportableContents history not being used for retrieval 2020-12-22 11:24:11 -04:00
Joey Hess
3eaaec3113
consistently use importKey when available
This avoids import with --no-content and with --content potentially
generating two different trees, leading to a merge conflict when run in
two different clones of a repo. And it's necessary groundwork to make
git-annex sync --no-content import from special remotes that support
importKey.

Only the directory special remote currently supports importKey, and it
generates the same key as git-annex usually does, so there is no
behavior change for it.

Future special remotes will need to take care when adding importKey,
if it generates different keys. Added some warnings about that to
comments.

This commit was sponsored by Noam Kremen on Patreon.
2020-09-28 15:27:46 -04:00
yarikoptic
661fdbf51e Added a comment: is -J shared between workers and ASYNC or "multipliticative"? 2020-09-24 15:37:21 +00:00
Joey Hess
05b2b46a82
async extension done 2020-08-14 15:24:34 -04:00
Joey Hess
198b709561
switch to TMVars for thread safety when using the async extension
TVars were not updated atomically, which was ok when each thread got its
own External that was the only thing using these TVars. But, with the
async extension, several External instances can share the same var, so
it needs to be a TMVar to avoid read/write conflicts.

In particular, this makes PREPARE only be sent once.
2020-08-14 14:50:09 -04:00
Joey Hess
7da2d4dd2d
one jobid per thread
And, relay ERROR on to all listening threads.
2020-08-14 14:24:46 -04:00
Joey Hess
72561563d9
rethought the async protocol some more
Moving jobid generation to the git-annex side lets it be simplified a
lot.

Note that it will also be possible to generate one jobid per connection,
rather than a new job per request. That will make overflow not an issue,
and will avoid some work, and will simplify some of the code.
2020-08-13 20:18:06 -04:00
Joey Hess
7546e686a2
async proto basically working
Simplified the protocol by removing END-ASYNC.

There's a STM crash when a non-async protocol message is sent, which
needs to be fixed.
2020-08-13 15:52:12 -04:00
Joey Hess
15706e6991
relayer receive loop is done
Receive loop looks right. Still need the send loop.

And, a complication is that some messages git-annex
sends need to be wrapped in REPLY_ASYNC, while others
do not. So will probably need to split externalSend
into two.
2020-08-12 15:56:58 -04:00
Joey Hess
7a21492f49
rethought this protocol again
Now that I've started implementation, I see it's really necessary that
every message the special remote sends use the protocol, otherwise
nasty edge cases abound.
2020-08-12 15:12:09 -04:00
Joey Hess
ddf69bf5b8
draft async extension 2020-08-11 16:42:09 -04:00
Joey Hess
c016527cb5
link 2020-07-03 14:40:13 -04:00
Joey Hess
28fee95d4e
extend proposed interface with IMPORTKEY 2020-07-03 14:23:04 -04:00
Joey Hess
925b2acb34
some improvements to docs 2019-11-11 12:52:45 -04:00
Joey Hess
f07d61c376
typo 2019-11-11 12:39:51 -04:00
Joey Hess
e42eb04182
fix language 2019-11-11 12:36:57 -04:00
Joey Hess
14f2c1eb92
typo 2019-11-11 12:36:05 -04:00
giuly.ippoliti@c1e2f0d5e40b128900f94f3d107d3719f87c3ff7
3d0330a555 Added a comment: Triggering which stage and when? 2019-10-24 20:30:11 +00:00
Joey Hess
56669728d7
response 2019-09-28 12:51:58 -04:00
yarikoptic
6dc5a0574e Added a comment: should there be FSCK and/or CLEAN? 2019-09-28 00:31:51 +00:00
Joey Hess
6e51b9ae88
clarify 2019-06-04 21:49:53 -04:00
Joey Hess
b6dfcf529e
indent 2019-05-28 16:21:35 -04:00
Joey Hess
08aa8e2010
break out export and import appending
The import protocol is WiP
2019-05-28 16:16:17 -04:00
Joey Hess
428435c37c
comment 2019-05-14 15:30:38 -04:00
michael.hanke@c60e12358aa3fc6060531bdead1f530ac4d582ec
53bee6dc5f Added a comment: Re: Empty lines sent by git-annex to an external special remote 2019-05-14 08:48:27 +00:00
michael.hanke@c60e12358aa3fc6060531bdead1f530ac4d582ec
c4abfcc368 Added a comment: Empty lines sent by git-annex to an external special remote 2019-05-14 06:36:12 +00:00
Joey Hess
8230b62e06
add todo 2019-01-17 11:49:56 -04:00
Joey Hess
3003e74a9d
inconclusive thoughts 2019-01-16 15:05:37 -04:00
lykos@d125a37d89b1cfac20829f12911656c40cb70018
ab1a78115a removed 2019-01-15 15:47:58 +00:00
lykos@d125a37d89b1cfac20829f12911656c40cb70018
91c7936ca7 Added a comment: PREPARE-LOCAL 2019-01-15 15:47:39 +00:00
lykos@d125a37d89b1cfac20829f12911656c40cb70018
59269fdd59 Added a comment: PREPARE-LOCAL 2019-01-15 15:46:07 +00:00
Joey Hess
3beab402e6
response 2018-10-29 15:40:52 -04:00
Ilya_Shlyakhter
97aaf38a3c Added a comment 2018-10-19 15:52:22 +00:00
Joey Hess
72ffb4a2da
response 2018-10-04 14:21:37 -04:00
Ilya_Shlyakhter
2c0300c8b9 Added a comment: question about special remote protocol 2018-09-26 17:16:13 +00:00
Joey Hess
b4abdda121
response 2018-09-24 11:40:34 -04:00
Ilya_Shlyakhter
7310a30dd5 Added a comment 2018-09-19 18:19:22 +00:00
Ilya_Shlyakhter
7ca7f8aee4 Added a comment 2018-09-19 11:01:31 +00:00
Joey Hess
33c00ab407
reply 2016-05-23 15:45:56 -04:00
xloem
f33d3b1d01 Added a comment: Retrieval progress message helpers 2016-05-20 19:42:24 +00:00
Joey Hess
3b7713b493
use DIRHASH-LOWER for consistency 2016-05-03 14:10:11 -04:00
grawity@2ea26be48562f66fcb9b66307da72b1e2e37453f
235212655d Added a comment 2016-05-03 18:02:03 +00:00
Joey Hess
4b9ddb9429
Added DIRHASH_LOWER to external special remote protocol. 2016-05-03 13:36:59 -04:00
grawity@2ea26be48562f66fcb9b66307da72b1e2e37453f
3f2f0aa667 Added a comment 2016-05-03 06:25:03 +00:00
szrc
08897ff3a2 Added a comment 2016-04-05 01:18:53 +00:00
Joey Hess
20d15f70dd
response 2016-04-04 16:21:30 -04:00
szrc
f1b7f407ee Added a comment: Local storage of creds 2016-04-04 03:59:02 +00:00
Joey Hess
175820ec63 response 2015-09-10 12:33:34 -04:00
https://me.yahoo.com/a/EbvxpTI_xP9Aod7Mg4cwGhgjrCrdM5s-#7c0f4
3c177565e7 Added a comment: but which of the 3? 2015-09-10 03:16:17 +00:00