From 8b4f331b0946ec103d4d3edf7894fc99b9ed3df3 Mon Sep 17 00:00:00 2001 From: Joey Hess Date: Tue, 5 Oct 2021 13:24:31 -0400 Subject: [PATCH] update --- ...mment_2_3af1b1dd4c1dea54639baac90c60452d._comment | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/doc/bugs/borg_special_remote_memory_usage_high_for_large_borg_repo/comment_2_3af1b1dd4c1dea54639baac90c60452d._comment b/doc/bugs/borg_special_remote_memory_usage_high_for_large_borg_repo/comment_2_3af1b1dd4c1dea54639baac90c60452d._comment index 8135ec6f87..7535766460 100644 --- a/doc/bugs/borg_special_remote_memory_usage_high_for_large_borg_repo/comment_2_3af1b1dd4c1dea54639baac90c60452d._comment +++ b/doc/bugs/borg_special_remote_memory_usage_high_for_large_borg_repo/comment_2_3af1b1dd4c1dea54639baac90c60452d._comment @@ -5,6 +5,14 @@ content=""" I tried making a borg repo with 100 archives of a 1000 object git-annex repo. The length of each item was 142 bytes, so all the items should -need about 15 mb of memory. git-annex sync used half a gigabyte of memory. -So that's a test case for this bug. +need about 15 mb of memory. git-annex sync used more than 2 gb +of memory. So that's a test case for this bug. + +Looks like around 500 mb is used listing the repo contents, and +then after all the borg list is complete, it uses much more memory +building the git tree. + +I was not including building the git tree in my estimates. I see +that Annex.Import uses recordTree, which does have to buffer the whole +tree in memory, but this seems much more memory than that. """]]