mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

updates

Browse source
This commit is contained in:
Joey Hess 2018-03-09 13:55:25 -04:00
parent d7f54671bf
commit f74c970c7e
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
2 changed files with 18 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol.mdwn
View file

@ -34,7 +34,8 @@ good to unify with it as much as possible.
----
Implementation todos:
Mostly implemented now, but need to test and think about these
implementation todos:
* git-annex-shell p2pstdio currently always verifies content it receives.
git-annex-shell recvkey has a speed optimisation, when it's told the file
@ -63,3 +64,6 @@ are both running?)
Transferring a 30 mb file over ssh to localhost, speed increased from
3.288s to 3.031s. Due to rsync's several levels of checksumming?
Dropping 1000 files from local, with each being locked on a ssh localhost
remote, speed increased from 30s to 7s.

13
doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol/comment_2_660c9ece3dbfb2eb20b42b71826a4fbc._comment Normal file
View file

@ -0,0 +1,13 @@
[[!comment format=mdwn
username="joey"
subject="""comment 2"""
date="2018-03-09T17:50:24Z"
content="""
That's the same problem as bundling multiple files with rsync, just a
different remote with a different program.
If wget/curl invocation speed is actually a bottleneck, it might help to
have git-annex use native haskell http-conduit for http downloads. That
would allow for http connection pipelining. Please open a separate todo
though, this one is only about git-annex-shell speed.
"""]]