get, move, copy, mirror: Added --failed switch which retries failed copies/moves

Note that get --from foo --failed will get things that a previous get --from bar
tried and failed to get, etc. I considered making --failed only retry
transfers from the same remote, but it was easier, and seems more useful,
to not have the same remote requirement.

Noisy due to some refactoring into Types/
This commit is contained in:
Joey Hess 2016-08-03 12:37:12 -04:00
parent 0fc85c45b5
commit 1a0e2c9901
Failed to extract signature
53 changed files with 254 additions and 127 deletions

View file

@ -59,6 +59,10 @@ Copies the content of files from or to another remote.
Operate on files found by last run of git-annex unused.
* `--failed`
Operate on files that have recently failed to be transferred.
* `--key=keyname`
Use this option to move a specified key.

View file

@ -32,6 +32,11 @@ or transferring them from some kind of key-value store.
Enables parallel download with up to the specified number of jobs
running at once. For example: `-J10`
* file matching options
The [[git-annex-matching-options]](1)
can be used to specify files to get.
* `--incomplete`
Resume any incomplete downloads of files that were started and
@ -45,11 +50,6 @@ or transferring them from some kind of key-value store.
as git-annex does not know the associated file, and the associated file
may not even be in the current git working directory.
* file matching options
The [[git-annex-matching-options]](1)
can be used to specify files to get.
* `--all`
Rather than specifying a filename or path to get, this option can be
@ -65,6 +65,10 @@ or transferring them from some kind of key-value store.
Operate on files found by last run of git-annex unused.
* `--failed`
Operate on files that have recently failed to be transferred.
* `--key=keyname`
Use this option to get a specified key.

View file

@ -53,6 +53,14 @@ contents. Use [[git-annex-sync]](1) for that.
Like --all, this bypasses checking the .gitattributes annex.numcopies
setting when dropping files.
* `--unused`
Operate on files found by last run of git-annex unused.
* `--failed`
Operate on files that have recently failed to be transferred.
* file matching options
The [[git-annex-matching-options]](1)

View file

@ -42,6 +42,10 @@ Moves the content of files from or to another remote.
Operate on files found by last run of git-annex unused.
* `--failed`
Operate on files that have recently failed to be transferred.
* `--key=keyname`
Use this option to move a specified key.

View file

@ -3,3 +3,5 @@ I often "copy --to remote" many files at once, and inevitably the transfer fails
Related: <https://git-annex.branchable.com/todo/make_copy_--fast__faster/>
git-annex is awesome btw. Thanks!
> [[done]] --[[Joey]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="joey"
subject="""comment 1"""
date="2016-08-03T15:07:43Z"
content="""
Nice idea, and there's already a log of recent failed transfers that
could be used.
"""]]

View file

@ -0,0 +1,11 @@
[[!comment format=mdwn
username="joey"
subject="""comment 4"""
date="2016-08-03T16:02:46Z"
content="""
--failed can now be used to retry only failed transfers. So that will be a
lot faster in that specific case.
Leaving this bug open for the general wishlist that copy --fast be somehow
a lot faster than it is at finding things that need to be copied.
"""]]