mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

devblog

Browse source
This commit is contained in:
Joey Hess 2019-06-05 20:18:59 -04:00
parent 4932972487
commit 4088ce49ce
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
1 changed files with 17 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

17
doc/devblog/day_591__superscalar_pipelining.mdwn Normal file
View file

@ -0,0 +1,17 @@
A long day spent making CommandCleanup actions run in a separate job pool
than CommandPerform actions. I don't think this will speed anything up much
yet, but it's useful groundwork. Now expensive things that are not
the main action of a command can be moved into CommandCleanup and won't
delay git-annex moving on to the next file. The main thing I want to move
is checksum verification after a transfer. But there are probably other
things I have not thought of.
CommandCleanup was always not well distinguised from CommandPerform,
and so there was little incentive to put things in it. Now that's changed.
I also noticed that with -J, git-annex takes significantly longer than
without to get started, when the first file it needs to process is quite a
way down the ls-tree. This must be concurrency overhead. But, when
CommandStart is skipping over a file that it doesn't need to process,
there is no need to do that bookkeeping. Planning to take some time
tomorrow to see if I can refactor CommandStart to avoid that overhead.