mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

initial whining about 2 ssh prompts

Browse source
This commit is contained in:
yarikoptic 2018-03-19 20:50:40 +00:00 committed by admin
parent ae462950a9
commit 66cb09b47e
1 changed files with 27 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

27
doc/bugs/Add_explicit_retries_for_curl__47__wget_on___34__transient__34___errors__63__.mdwn Normal file
View file

@ -0,0 +1,27 @@
### Please describe the problem.
While download content from dropbox (via regular urls associated with the files, so "web" remote), some fail some time with error code returned 500 (internal server failure without explicit reason), which causes git-annex get also to fail if that was the only source for the file to try.
### What steps will reproduce the problem?
This is all happening with http://datasets.datalad.org/workshops/nih-2017/ds000114/derivatives/freesurfer/ repository (on eg https://dl.dropboxusercontent.com/s/sn4et1e3d2run9g/rh.aparc.dktatlas.annot?dl=0 url ), but for testing wget/curl I just created http://www.onerussian.com/tmp/errors/500 which would always return 500.
### What version of git-annex are you using? On what operating system?
6.20180316+gitg308f3ecf6
### Please provide any additional information below.
here are options for wget and curl which could help us out here:
[[!format sh """
# to make wget retry
> wget --retry-on-http-error=500 http://www.onerussian.com/tmp/errors/500
# to make curl retry, just needs --retry 10 which then considers 5xx errors intermittent
> curl --retry 10 http://www.onerussian.com/tmp/errors/500
"""]]
Could git-annex add those options to curl/wget invocations for more robust access to the web remote?