mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 2

Added a comment: corruption using git-annex-remote-rclone

Browse source
This commit is contained in:
mike@2d6d71f56ce2a992244350475251df87c26fe351 2024-09-27 07:39:06 +00:00 committed by admin
parent b0546e8bde
commit 82538a9cd3
1 changed files with 24 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

24
doc/special_remotes/rclone/comment_5_414559099884a972943586cf03d613a4._comment Normal file
View file

@ -0,0 +1,24 @@
[[!comment format=mdwn
username="mike@2d6d71f56ce2a992244350475251df87c26fe351"
nickname="mike"
avatar="http://cdn.libravatar.org/avatar/183fa439752e2f0c6f39ede658d81050"
subject="corruption using git-annex-remote-rclone"
date="2024-09-27T07:39:06Z"
content="""
Perhaps Joey can help me out here a bit with some background knowledge:
I've been seeing sporadic corruption with this setup:
- chunking
- encryption
- old helper program git-annex-remote-rclone
- rclone's pcloud backend
At it seems, rclone keeps partial files under the name of the full file when a transfer is interrupted, for the pcloud backend. (This is for rclone <= 1.67.0; 1.68.0 has changes for pcloud, which may fix this.) My theory how the corruption might have happened:
- First interrupted run of git-annex uploads chunks A and a partial(!) chunk B
- Second run skips chunks A and B(!) and, say, the rest of the chunks (C and D)
- At the end we have uploaded A, C and D and a corrupted/partial chunk B
Joey: Is this a possible error scenario?
"""]]