Merge branch 'master' of ssh://git-annex.branchable.com

This commit is contained in:
Joey Hess 2018-10-29 13:47:14 -04:00
commit 0b8dd0c35f
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
4 changed files with 50 additions and 0 deletions

View file

@ -0,0 +1,23 @@
### Please describe the problem.
I'm trying to set up a gcrypt remote using the rsync backend because it can do incremental pushes. I know I won't be able to put annexed files on this remote, but even with `annex-ignore` set, the error arises.
### What steps will reproduce the problem?
[[!format sh """
% git remote add cryptremote gcrypt::rsync://host:repo
% git annex sync cryptremote
"""]]
### What version of git-annex are you using? On what operating system?
6.20181011-g426f0f3f4 on Arch Linux
### Please provide any additional information below.
[[!format sh """
git-annex: bad url rsync://host:repo
CallStack (from HasCallStack):
error, called at ./Git/Construct.hs:101:15 in main:Git.Construct
"""]]
-- Lykos

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="CandyAngel"
avatar="http://cdn.libravatar.org/avatar/15c0aade8bec5bf004f939dd73cf9ed8"
subject="comment 14"
date="2018-10-27T22:33:20Z"
content="""
I just tried this and git-annex doesn't add the cache in the location tracking for the files. Perfect! Yay! :D
"""]]

View file

@ -0,0 +1,16 @@
When an external special remote tells git-annex a fuller URL for a given file, git-annex-addurl does not use that information:
[2018-10-28 16:12:39.933464] git-annex-remote-dnanexus[1] <-- CLAIMURL dx://file-FJZjVx001pB2BQPVKY4zX8kk/
[2018-10-28 16:12:39.933515] git-annex-remote-dnanexus[1] --> CLAIMURL-SUCCESS
[2018-10-28 16:12:39.933568] git-annex-remote-dnanexus[1] <-- CHECKURL dx://file-FJZjVx001pB2BQPVKY4zX8kk/
[2018-10-28 16:12:40.469292] git-annex-remote-dnanexus[1] --> CHECKURL-MULTI dx://file-FJZjVx001pB2BQPVKY4zX8kk/A4.assembly1-trinity.fasta 11086 A4.assembly1-trinity.fasta
addurl dx://file-FJZjVx001pB2BQPVKY4zX8kk/ (from mydx) (to A4.assembly1_trinity.fasta) [2018-10-28 16:12:40.469503] read: git ["--version"]
It would be better if, in the above log, the URL key was based on dx://file-FJZjVx001pB2BQPVKY4zX8kk/A4.assembly1-trinity.fasta , which would preserve the .fasta extension in the key and therefore in the symlink target.
Also, it would be good if the external special remote could return an etag for the URL, which would be a value guaranteed to change if the URL's contents changes;
and if git-annex would then compute the URL key based on the combination of URL and etag.
It'd also be good if there was a option to automatically migrate URL keys to the default backend whenever a file from a URL key is downloaded. Also, to record
the checksummed key (e.g. MD5E) as metadata of the URL key (in a field named e.g. alternateKeys), and if addurl --fast is later done on a URL key for which
a checksummed key is recorded in the metadata, to add the checksummed key instead of the URL key .

View file

@ -0,0 +1,3 @@
I just created a [[bug report|bugs/gcrypt_rsync_remotes_don__39__t_work]] regarding gcrypt rsync remotes. In fact, I think the gcrypt special remote should allow rsync urls as well. The annexed files are going to be transferred using rsync anyway, aren't they? That would speed up `git annex sync` a lot, especially on slow (mobile) connections.
-- Lykos