mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

comment

Browse source
This commit is contained in:
Joey Hess 2022-07-12 17:00:36 -04:00
parent e74e51c761
commit aaccada8fd
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
1 changed files with 17 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

17
doc/bugs/performance_regression__63___init_takes_times_more/comment_3_d92bd84ab3f218eb6ad38fcc7f54c223._comment Normal file
View file

@ -0,0 +1,17 @@
[[!comment format=mdwn
username="joey"
subject="""comment 3"""
date="2022-07-12T20:51:05Z"
content="""
The last time I worked on optimising this,
in [[todo/speed_up_keys_db_update_with_git_streaming]],
it looked like writing to sqlite was probably a large part of the remaining
time. Processing 100k new files took 41 seconds, and processing 100k
removed files took only 17 seconds. And the only difference as far as what
git-annex is doing in those cases is adding to sqlite vs removing from
sqlite.
[This comment](https://git-annex.branchable.com/todo/Avoid_lengthy___34__Scanning_for_unlocked_files_...__34__/#comment-5d4037307a3e66304cc0e8ce137e1693)
suggests using multi-value sqlite inserts as perhaps a way to speed it up.
Perhaps.
"""]]