mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

few more details

Browse source
This commit is contained in:
Joey Hess 2020-09-14 20:00:54 -04:00
parent ad9bb120f0
commit a5d5935c0e
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
1 changed files with 9 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment
View file

@ -3,7 +3,7 @@
subject="""comment 5""" subject="""comment 5"""
date="2020-09-14T23:43:03Z" date="2020-09-14T23:43:03Z"
content=""" content="""
git-annex copy --to S3 -J40 hangs reproductibly for phibs (on irc). git-annex copy -A --to S3 -J40 hangs reproductibly for phibs (on irc).
When it hangs, at least one job is stuck at 100%, and often several, When it hangs, at least one job is stuck at 100%, and often several,
though some other jobs are hung at smaller percent. though some other jobs are hung at smaller percent.
@ -11,14 +11,16 @@ though some other jobs are hung at smaller percent.
Without -J, it did not seem to hang. It also may have not been hung with Without -J, it did not seem to hang. It also may have not been hung with
-J2 (was interrupted before finishing). -J2 (was interrupted before finishing).
One attempt (with --json) had two other interesting messages: One attempt (with --json) had this message:
magicFile: got error code but no error message magicFile: got error code but no error message
Two attempts had this:
Missing root element Missing root element
The latter just before the hang, one file transferred successfully after One time just before the hang, the other time 20+ files before the hang.
that and then it hung. That message coes from Text.XML apparently, That message coes from Text.XML apparently,
which I think points to this being the same bug. which I think points to this being the same bug.
phibs tried a similar copy to a directory special remote, did not hang. phibs tried a similar copy to a directory special remote, did not hang.
@ -28,4 +30,7 @@ I think that pretty much rules out any problem in git-annex's code,
the problem is probably in the aws library or the http stack. the problem is probably in the aws library or the http stack.
The S3 remote has chunking (10 mb) and no encryption, and is on AWS. The S3 remote has chunking (10 mb) and no encryption, and is on AWS.
Some file sizes of files that hung at 100%: 64083380, 7668, 72792, 6952,
9584456, 21050948.
"""]] """]]