git-annex/doc/todo/parallel_possibilities.mdwn
Joey Hess 7fe4bfa20f split commands into 3 phases
I feel like I just leveled up in Haskell.
2010-10-25 15:44:27 -04:00

12 lines
660 B
Markdown

One of my reasons for using haskell was that it provides the possibility of
some parallell processing. Although since git-annex hits the filesystem
heavily and mostly runs other git commands, maybe not a whole lot.
Anyway, each git-annex command is broken down into a series of independant
actions, which has some potential for parallelism.
Each action has 3 distinct phases, basically "check", "perform", and
"cleanup". The perform actions are not parellizable; the cleanup may be,
and the check should be easily parallelizable, although they may access the
disk or run minor git query commands, so would probably not want to run
too many of them at once.