Commit graph

31463 commits

Author SHA1 Message Date
Joey Hess
fa5b19f0ff
add formal description of the P2P protocol
This commit was sponsored by Fernando Jimenez on Patreon.
2018-03-07 15:14:16 -04:00
Joey Hess
f4103744c3
make sure that lockContentShared is always paired with an inAnnex check
lockContentShared had a screwy caveat that it didn't verify that the content
was present when locking it, but in the most common case, eg indirect mode,
it failed to lock when the content is not present.

That led to a few callers forgetting to check inAnnex when using it,
but the potential data loss was unlikely to be noticed because it only
affected direct mode I think.

Fix data loss bug when the local repository uses direct mode, and a
locally modified file is dropped from a remote repsitory. The bug
caused the modified file to be counted as a copy of the original file.
(This is not a severe bug because in such a situation, dropping
from the remote and then modifying the file is allowed and has the same
end result.)

And, in content locking over tor, when the remote repository is
in direct mode, it neglected to check that the content was actually
present when locking it. This could cause git annex drop to remove
the only copy of a file when it thought the tor remote had a copy.

So, make lockContentShared do its own inAnnex check. This could perhaps
be optimised for direct mode, to avoid the check then, since locking
the content necessarily verifies it exists there, but I have not bothered
with that.

This commit was sponsored by Jeff Goeke-Smith on Patreon.
2018-03-07 14:23:52 -04:00
Joey Hess
572a45ae00
add readonly mode to serve P2P protocol
This will be used by git-annex-shell when configured to be readonly.

This commit was sponsored by Nick Daly on Patreon.
2018-03-07 13:15:55 -04:00
Joey Hess
bd8c13e75b
update 2018-03-06 17:33:11 -04:00
Joey Hess
6f6146a3f7
Merge branch 'master' of ssh://git-annex.branchable.com 2018-03-06 15:34:07 -04:00
Joey Hess
d8a900a33d
devblog 2018-03-06 15:26:57 -04:00
Joey Hess
ba53f60801
refactor 2018-03-06 15:14:53 -04:00
yarikoptic
635b6a0959 Added a comment 2018-03-06 19:07:37 +00:00
Joey Hess
73704b22a9
comment typo 2018-03-06 14:58:24 -04:00
Joey Hess
9b8f6c9cb9
followup 2018-03-06 14:51:27 -04:00
Joey Hess
f42baedd4c
designing new git-annex-shell multi
This commit was supported by the NSF-funded DataLad project.
2018-03-06 14:48:44 -04:00
Joey Hess
dd63b4e744
followup 2018-03-06 13:51:06 -04:00
Joey Hess
4a45c34dc2
response 2018-03-06 13:40:00 -04:00
Joey Hess
bf98afb91a
comment 2018-03-06 13:38:55 -04:00
Joey Hess
a7dd4490f0
followup 2018-03-06 13:05:37 -04:00
Joey Hess
f668510754
comment 2018-03-06 12:22:50 -04:00
davi.castro@13c06889d1a1aef6321227888bd7d6b73d5692ea
ea0501e868 Added a comment: Is git annex config still supported? 2018-03-06 03:03:45 +00:00
yarikoptic
31be21289c new line was swallowed while copy pasting -- fixed 2018-03-05 19:48:29 +00:00
yarikoptic
2467f6f52b forgot to add my own meta 2018-03-05 19:47:48 +00:00
yarikoptic
24d379106b intial question about special remotes which do not support parallel mode downloads 2018-03-05 19:31:34 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
7b75103e32 Added a comment: opened github issue with glacier-cli 2018-03-05 17:28:53 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
f4095f7db8 Added a comment: thanks for the quick response! 2018-03-05 17:19:19 +00:00
Joey Hess
f71dc6aa05
Merge branch 'master' of ssh://git-annex.branchable.com 2018-03-05 11:30:59 -04:00
Joey Hess
07e253b1fb
Improve SHA*E extension extraction code
Do not treat parts of the filename that contain punctuation or other
non-alphanumeric characters as extensions. Before, such characters were
filtered out.

Note that in 45308ec78b "foo.ba__________r"
was munged to ".bar" and so incorrectly treated as an extension. That was
fixed by changing the filter order, but not allowing punctuation seems a
better fix.

This assumes that extensions containing punctuation are rare. "_" seems the
most likely character; I used it in ikiwiki "._comment" files. But I can't
recall seeing it anywhere else. It certianly seems that no commonly used
extensions contain punctuation. If git-annex doesn't treat "._comment"
as an extension, it's not likely to break software that expects to see that
extension like some software expects to see .epub or .mp3.

This commit was sponsored by Jack Hill on Patreon.
2018-03-05 11:25:01 -04:00
Joey Hess
6d6e3c6c49
comment 2018-03-05 10:59:18 -04:00
drunken_sapo
48c06f18a6 Added a comment: It is better to provide osx dmgs 2018-03-05 11:48:12 +00:00
Joey Hess
def6936be1
Merge branch 'master' of ssh://git-annex.branchable.com 2018-03-04 19:48:54 -04:00
Joey Hess
6063b3df3f
Dial back optimisation when building on arm
Prevent ghc and llc from running out of memory when optimising some
files.

Sean Whitton reported that doing this only in Test.hs was insufficient,
the build still OOMed by the time it got to Test.hs. He had earlier found
the build worked when these options are applied globally.

See https://ghc.haskell.org/trac/ghc/ticket/14821 for why it needs -O1;
once that's fixed it may suffice to use "GHC-Options: -O2 -optlo-O2",
although it may also be that the -O1 prevents ghc from using/leaking
as much memory.

os(arm) should match armel, armhf, armeb, and arm.
It probably also matches arm64, somewhat unfortunately since arm64
systems probably tend to have more memory. See list of arches in
https://hackage.haskell.org/package/Cabal-1.22.2.0/docs/src/Distribution-System.html

This commit was sponsored by Henrik Riomar on Patreon.
2018-03-04 19:48:07 -04:00
spwhitton
2dcd46683e Added a comment: armel+armhf available in stretch-backports 2018-03-04 19:03:19 +00:00
rameshvenk
fc7596ad8f Added a comment: dyld: Symbol not found: _inflateValidate 2018-03-04 03:59:42 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
b88042e23d removed 2018-03-03 16:55:32 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
d98f1afa9c Added a comment: fixed prev commend 2018-03-03 16:55:16 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
32adc7ccd7 Added a comment: it seems to affect regular text too. 2018-03-03 16:49:10 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
9370a74059 Added a comment: this has something to do with the dot and space 2018-03-03 16:43:27 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
e124392f96 Added a comment: I've also upgraded the repo to version 6 2018-03-03 16:23:37 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
fe8284297b Added a comment: checked 6.20180112 and it's the same 2018-03-03 16:21:07 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
ca233145bc 2018-03-03 16:15:32 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
6c2a26ff2f 2018-03-03 16:14:45 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
ccc2c54d4f 2018-03-03 13:17:56 +00:00
i@f4fc1d4ed8c7cc91fc284462cb631c270a5195e9
d4fda4e3e2 2018-03-03 13:16:45 +00:00
Joey Hess
0361937ee3
response 2018-03-02 15:10:51 -04:00
Joey Hess
e757635ffd
response 2018-03-02 15:08:22 -04:00
Joey Hess
51d3edc2ab
Merge branch 'master' of ssh://git-annex.branchable.com 2018-03-02 13:05:08 -04:00
Joey Hess
0d254385d1
mention stretch backports 2018-03-01 17:22:14 -04:00
bwong@047cc3a313979f155ea3d7ea765358b92116e045
f1f2db7030 2018-03-01 01:36:57 +00:00
bwong@047cc3a313979f155ea3d7ea765358b92116e045
17782b53a1 adding public keys to hybrid encryption remote 2018-03-01 01:35:31 +00:00
Joey Hess
a4bd508643
todo 2018-02-28 16:52:13 -04:00
Joey Hess
57fa459f15
devblog 2018-02-28 14:39:07 -04:00
Joey Hess
84d19add1c
response 2018-02-28 14:04:24 -04:00
Joey Hess
bed6773346
Support exporttree=yes for rsync special remotes.
Renaming is not supported; it might be possible to use --fuzzy to get rsync
to notice the file is being renamed, but that is a bit ..fuzzy.

On the other hand, interrupted transfers of an exported file are resumed,
since rsync is great at that. Had to adjust the exporttree docs, which
said interrupted transfers would restart.

Note that remove no longer makes the empty directory dummy, instead
sending the top-level empty directory. This works just as well and I
noticed the dummy was unncessary when refactoring it into removeGeneric.
Verified that behavior of remove is not changed, and git annex
testremote does pass.

This commit was sponsored by Brock Spratlen on Patreon.
2018-02-28 13:36:20 -04:00