git-annex/Remote
Joey Hess d154e7022e
incremental verification for web special remote
Except when configuration makes curl be used. It did not seem worth
trying to tail the file when curl is downloading.

But when an interrupted download is resumed, it does not read the whole
existing file to hash it. Same reason discussed in
commit 7eb3742e4b76d1d7a487c2c53bf25cda4ee5df43; that could take a long
time with no progress being displayed. And also there's an open http
request, which needs to be consumed; taking a long time to hash the file
might cause it to time out.

Also in passing implemented it for git and external special remotes when
downloading from the web. Several others like S3 are within striking
distance now as well.

Sponsored-by: Dartmouth College's DANDI project
2021-08-18 15:02:22 -04:00
..
Directory incremental hashing for fileRetriever 2021-08-13 15:43:29 -04:00
External Added GETGITREMOTENAME to extenal special remote protocol 2021-01-26 12:42:47 -04:00
Helper distinguish between incremental verification failing and not being done 2021-08-18 14:38:02 -04:00
List auto-init autoenable=yes 2020-05-27 12:40:35 -04:00
Rsync add newtypes for QuickCheck to avoid LANG=C issues 2020-11-09 20:21:18 -04:00
WebDAV fix exporting when the file is in the top of the repo 2021-03-16 14:17:29 -04:00
Adb.hs incremental verify for directory special remote 2021-08-16 16:51:33 -04:00
BitTorrent.hs incremental verification for web special remote 2021-08-18 15:02:22 -04:00
Borg.hs simplify and speed up Utility.FileSystemEncoding 2021-08-11 12:13:31 -04:00
Bup.hs incremental verify for byteRetriever special remotes 2021-08-11 14:20:38 -04:00
Ddar.hs incremental verify for byteRetriever special remotes 2021-08-11 14:20:38 -04:00
Directory.hs incremental verify for directory special remote 2021-08-16 16:51:33 -04:00
External.hs incremental verification for web special remote 2021-08-18 15:02:22 -04:00
GCrypt.hs incremental verify for directory special remote 2021-08-16 16:51:33 -04:00
Git.hs incremental verification for web special remote 2021-08-18 15:02:22 -04:00
GitLFS.hs incremental verification for web special remote 2021-08-18 15:02:22 -04:00
Glacier.hs incremental verify for byteRetriever special remotes 2021-08-11 14:20:38 -04:00
Hook.hs incremental verify for directory special remote 2021-08-16 16:51:33 -04:00
HttpAlso.hs incremental verification for web special remote 2021-08-18 15:02:22 -04:00
List.hs start borg special remote 2020-12-18 16:03:51 -04:00
P2P.hs plumb VerifyConfig into retrieveKeyFile 2021-08-17 12:43:13 -04:00
Rsync.hs incremental verify for directory special remote 2021-08-16 16:51:33 -04:00
S3.hs incremental verification for web special remote 2021-08-18 15:02:22 -04:00
Tahoe.hs plumb VerifyConfig into retrieveKeyFile 2021-08-17 12:43:13 -04:00
Web.hs incremental verification for web special remote 2021-08-18 15:02:22 -04:00
WebDAV.hs distinguish between incremental verification failing and not being done 2021-08-18 14:38:02 -04:00