mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

blog for the day

Browse source
This commit is contained in:
Joey Hess 2013-04-24 18:57:52 -04:00
parent ebee93a837
commit affb89a699
1 changed files with 16 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
doc/design/assistant/blog/day_247__performance_tuning.mdwn Normal file
View file

@ -0,0 +1,16 @@
Working on assistant's performance when it has to add a whole lot of files
(10k to 100k).
Improved behavior in several ways, including fixing display
of the alert in the webapp when the default inotify limit of 8192
directories is exceeded.
Created a new TList data type, a transactional DList. Much nicer
implementation than the TChan based thing it was using to keep track of the
changes, although it only improved runtime and memory usage a little bit.
The way that this is internally storing a function in STM and modifying
that function to add items to the list is way cool.
Other tuning seems to have decreased the time it would take to import 100k
files from somewhere in the range of a full day (too long to wait to see),
to around 3.5 hours. I don't know if that's good, but it's certianly better.