mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

followup

Browse source
This commit is contained in:
Joey Hess 2023-09-26 13:04:42 -04:00
parent 0d86e58e4c
commit 3ca7812310
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
1 changed files with 18 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

18
doc/bugs/git_annex_copy_to_s3_out_of_memory/comment_1_5c0b73214c8f0ecb197cf0e109ff2729._comment Normal file
View file

@ -0,0 +1,18 @@
[[!comment format=mdwn
username="joey"
subject="""comment 1"""
date="2023-09-26T16:56:06Z"
content="""
Is chunking or partsize configured on the S3 special remote?
The output of `git-annex info fcp-indi` will tell us that.
How large are the files you're sending? Are any particularly large, eg
larger than available ram?
Am I understanding correctly that you're sending 4 million files to S3?
And do these failures happen after a significant number of those files have
been sent, or more randomly?
Does git-annex's memory use show a trend of increasing the more files are
sent?
"""]]