mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

thundering herd

Browse source
This commit is contained in:
Joey Hess 2015-03-03 22:01:08 -04:00
parent d5c8c56bce
commit b380701776
1 changed files with 9 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

9
doc/design/iabackup.mdwn
View file

@ -221,3 +221,12 @@ A client could add other files to its local repo, and git-annex branch
pushes would include junk data about those files. It should probably be pushes would include junk data about those files. It should probably be
filtered out by the git update hook (rejecting the whole push because of filtered out by the git update hook (rejecting the whole push because of
this seems excessive). this seems excessive).
There may be a thundering herd problem, where many clients end up
downloading the same Item at the same time, and more copies than neecessary
result. The next `git annex sync --content` in some of the
redundant clients will notice this and drop that item, and presumably
download some other item. However, it might be good to rate limit the
number of concurrent downloads of a given item, to prevent this and perhaps
other issues. This could be done by a wrapper around git-annex shell or
perhaps a git-annex modification.