From 0783352faebc5722fef73088b1393d5cc376e7e1 Mon Sep 17 00:00:00 2001 From: Joey Hess Date: Wed, 4 Apr 2018 14:32:32 -0400 Subject: [PATCH] todo --- doc/todo/stop_using_curl_and_wget.mdwn | 29 ++++++++++++++++++++++++++ 1 file changed, 29 insertions(+) create mode 100644 doc/todo/stop_using_curl_and_wget.mdwn diff --git a/doc/todo/stop_using_curl_and_wget.mdwn b/doc/todo/stop_using_curl_and_wget.mdwn new file mode 100644 index 0000000000..2362d2d875 --- /dev/null +++ b/doc/todo/stop_using_curl_and_wget.mdwn @@ -0,0 +1,29 @@ +Currently git-annex uses wget and curl for downloading urls. +Which is used depends on the situation, since both have their limitations +and quirks. + +This often confuses users, who expect annex.web-options to only apply +to whichever program git-annex was running, and put in an option that +breaks the other program. Or, configure a netrc file, which wget uses by +default, but curl does not. + +Also, using these external programs avoids keeping a http connection open +and pipelining requests, so it makes mass url downloads a lot slower than +if git-annex used http-conduit to do url downloads itself. [[users/yoh]] +has requested http pipelining. + +For file: ftp: and more unusual urls, http-conduit can't support them. +git-annex does support those urls, and people rely on that, so it would +still need to use wget or curl for those. + +wget is also not shipped with git-annex on Windows or OSX, only curl is, +and it would be good to only use one of the programs, not both, when +handing those unusual urls. + +See also, [[support_.netrc_for_fsck_--from_web]]. That some users rely on +git-annex using wget and a netrc file is kind of problimatic if switching +to http-conduit which does not support it. Maybe require users to set +`annex.web-download-command` if they want to make it use something that +supports netrc? + +--[[Joey]]