mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Added a comment: 3rd party "mover" / speed up git annex move

Browse source
This commit is contained in:
mario 2018-09-17 12:16:08 +00:00 committed by admin
parent 239595d6a4
commit f929675566
1 changed files with 8 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
doc/git-annex-move/comment_2_f2908113a633034aa73b8564d22abba6._comment Normal file
View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="mario"
avatar="http://cdn.libravatar.org/avatar/4c63b0935789d29210d0bd8cad8d7ac7"
subject="3rd party "mover" / speed up git annex move"
date="2018-09-17T12:16:08Z"
content="""
git annex move seems to be quite slow if many small files have to be transferred. I think the main issue is that for each file a new TCP connection is opened. In this case reusing the TCP connection could significantly speed up the transfers. Two questions about this. a) Am I just doing something wrong? (I don't want to use -J because the remote is cluster and -J connects to different servers.) b) Is there an efficient method to write my own mover for the files in question? Basically \"git annex find [...] --json\" gives me all the files in question, so I know what to move. But after copying them to the remote, how do I tell git annex that they are there? Does it make sense to use git annex reinject?
"""]]