mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

Added a comment: Probably confirming this bug

Browse source
This commit is contained in:
stp 2014-01-16 19:59:56 +00:00 • committed by admin
parent 343246d6b7
commit b7dd9f583d
1 changed files with 28 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

28
doc/bugs/assistant_eats_all_CPU/comment_15_b7f9a8e214eefc3a6976065782157e81._comment Normal file
View file

@ -0,0 +1,28 @@
[[!comment format=mdwn
username="stp"
ip="188.193.209.7"
subject="Probably confirming this bug"
date="2014-01-16T19:59:56Z"
content="""
I am trying around with the assistant and webapp for a few months now.
I have rather large git annex repos and even switched from direct ones to indirect repos to increase performance.
The issue I'm seeing is that when using the assistant or webapp it does the initial startupscan, but only consumes 99-100% of one of my cores and doesn't use significant io. It's stuck in this state for hours (12+) or even days. The only thing standing out in the logs is that it puts a lot of files into the queue. (I suspected a not yet synced backup remote to be the issue) I stopped syncing with it, but that didn't speed up the startupScan at all.
[2014-01-16 19:34:26 CET] TransferScanner: queued Upload NoUUID db/2012-07/1406469990005618750.meta Nothing : expensive scan found missing object
[2014-01-16 19:34:27 CET] TransferScanner: queued Upload NoUUID db/2012-07/1406471293790598760.eml.gz Nothing : expensive scan found missing object
Some additional information:
Total file count: ~100000
Total size: ~500mb
SSD + i7 Quadcore running Ubuntu 13.10
Latest build from 2014-01-16 as standalone built.
Running git annex add && git annex sync from the cli returns within seconds 0.1s (no new files) and 10s (500-1000 new files).
Not understanding the main difference git annex add and git annex assistant (startupScan function) really have.
Thanks for your help.
"""]]