mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

update

Browse source
This commit is contained in:
Joey Hess 2021-10-05 13:24:31 -04:00
parent 368ceb93fe
commit 8b4f331b09
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
1 changed files with 10 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
doc/bugs/borg_special_remote_memory_usage_high_for_large_borg_repo/comment_2_3af1b1dd4c1dea54639baac90c60452d._comment
View file

@ -5,6 +5,14 @@
content="""
I tried making a borg repo with 100 archives of a 1000 object git-annex
repo. The length of each item was 142 bytes, so all the items should
need about 15 mb of memory. git-annex sync used half a gigabyte of memory.
So that's a test case for this bug.
need about 15 mb of memory. git-annex sync used more than 2 gb
of memory. So that's a test case for this bug.
Looks like around 500 mb is used listing the repo contents, and
then after all the borg list is complete, it uses much more memory
building the git tree.
I was not including building the git tree in my estimates. I see
that Annex.Import uses recordTree, which does have to buffer the whole
tree in memory, but this seems much more memory than that.
"""]]