mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

add tips

Browse source
This commit is contained in:
Joey Hess 2012-02-15 14:34:40 -04:00
parent f0f07db01d
commit 4645f83678
1 changed files with 13 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
doc/scalability.mdwn
View file

@ -29,3 +29,16 @@ git-annex is designed for scalability. The key points are:
* It can use as much, or as little bandwidth as is available. In * It can use as much, or as little bandwidth as is available. In
particular, any interrupted file transfer can be resumed by git-annex. particular, any interrupted file transfer can be resumed by git-annex.
## scalability tips
* If the files are so big that checksumming becomes a bottleneck, consider
using the [[WORM_backend|backends]]. You can always `git annex migrate`
files to a checksumming backend later on.
* If you're adding a huge number of files at once (hundreds of thousands),
you'll soon notice that git-annex periodically stops and say
"Recording state in git" while it runs a `git add` command that
becomes increasingly expensive. Consider adjusting the `annex.queuesize`
to a higher value, at the expense of it using more memory.