diff --git a/doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol.mdwn b/doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol.mdwn index 39efa3b77a..f7b1908262 100644 --- a/doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol.mdwn +++ b/doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol.mdwn @@ -34,7 +34,8 @@ good to unify with it as much as possible. ---- -Implementation todos: +Mostly implemented now, but need to test and think about these +implementation todos: * git-annex-shell p2pstdio currently always verifies content it receives. git-annex-shell recvkey has a speed optimisation, when it's told the file @@ -63,3 +64,6 @@ are both running?) Transferring a 30 mb file over ssh to localhost, speed increased from 3.288s to 3.031s. Due to rsync's several levels of checksumming? + +Dropping 1000 files from local, with each being locked on a ssh localhost +remote, speed increased from 30s to 7s. diff --git a/doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol/comment_2_660c9ece3dbfb2eb20b42b71826a4fbc._comment b/doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol/comment_2_660c9ece3dbfb2eb20b42b71826a4fbc._comment new file mode 100644 index 0000000000..7adf5f3a96 --- /dev/null +++ b/doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol/comment_2_660c9ece3dbfb2eb20b42b71826a4fbc._comment @@ -0,0 +1,13 @@ +[[!comment format=mdwn + username="joey" + subject="""comment 2""" + date="2018-03-09T17:50:24Z" + content=""" +That's the same problem as bundling multiple files with rsync, just a +different remote with a different program. + +If wget/curl invocation speed is actually a bottleneck, it might help to +have git-annex use native haskell http-conduit for http downloads. That +would allow for http connection pipelining. Please open a separate todo +though, this one is only about git-annex-shell speed. +"""]]