mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

updates

Browse source
This commit is contained in:
Joey Hess 2018-03-09 13:55:25 -04:00
parent d7f54671bf
commit f74c970c7e
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
2 changed files with 18 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

6
doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol.mdwn
View file

@ -34,7 +34,8 @@ good to unify with it as much as possible.
---- ----
Implementation todos: Mostly implemented now, but need to test and think about these
implementation todos:
* git-annex-shell p2pstdio currently always verifies content it receives. * git-annex-shell p2pstdio currently always verifies content it receives.
git-annex-shell recvkey has a speed optimisation, when it's told the file git-annex-shell recvkey has a speed optimisation, when it's told the file
@ -63,3 +64,6 @@ are both running?)
Transferring a 30 mb file over ssh to localhost, speed increased from Transferring a 30 mb file over ssh to localhost, speed increased from
3.288s to 3.031s. Due to rsync's several levels of checksumming? 3.288s to 3.031s. Due to rsync's several levels of checksumming?
Dropping 1000 files from local, with each being locked on a ssh localhost
remote, speed increased from 30s to 7s.

13
doc/todo/accellerate_ssh_remotes_with_git-annex-shell_mass_protocol/comment_2_660c9ece3dbfb2eb20b42b71826a4fbc._comment Normal file
View file

@ -0,0 +1,13 @@
[[!comment format=mdwn
username="joey"
subject="""comment 2"""
date="2018-03-09T17:50:24Z"
content="""
That's the same problem as bundling multiple files with rsync, just a
different remote with a different program.
If wget/curl invocation speed is actually a bottleneck, it might help to
have git-annex use native haskell http-conduit for http downloads. That
would allow for http connection pipelining. Please open a separate todo
though, this one is only about git-annex-shell speed.
"""]]