devblog
This commit is contained in:
parent
c34152777b
commit
388eb4135f
1 changed files with 25 additions and 0 deletions
25
doc/devblog/day_494__url_download_changes.mdwn
Normal file
25
doc/devblog/day_494__url_download_changes.mdwn
Normal file
|
@ -0,0 +1,25 @@
|
||||||
|
To make git-annex faster when it's dealing with a lot of urls,
|
||||||
|
I decided to make it use the http-conduit library for all url access by
|
||||||
|
default. That way, http pipelining will speed up repeated requests to the
|
||||||
|
same web servers. This is kind of a follow-up to the recent elimination of
|
||||||
|
rsync.
|
||||||
|
|
||||||
|
Some users rely on some annex.web-options or a .netrc file to configure
|
||||||
|
how git-annex downloads urls. To keep that supported, when
|
||||||
|
annex.web-options is set, git-annex will use curl.
|
||||||
|
To use a .netrc file, curl needs an option, so you would configure:
|
||||||
|
|
||||||
|
git config annex.web-options --netrc
|
||||||
|
|
||||||
|
I get the feeling that nobody has implemented resuming interrupted
|
||||||
|
downloads of files using http-conduit before, because it was unexpectedly
|
||||||
|
kind of hard and http-types lacks support for some of the necessary
|
||||||
|
range-related HTTP stuff.
|
||||||
|
|
||||||
|
Today's work was supported by the NSF-funded DataLad project.
|
||||||
|
|
||||||
|
----
|
||||||
|
|
||||||
|
Stewart V. Wright [announced recastex](http://git-annex.branchable.com/tips/Announcing_recastex_-___40__re__41__podcast__from_your_annex/),
|
||||||
|
a program that publishes podcasts and other files from by git-annex to your
|
||||||
|
phone.
|
Loading…
Add table
Reference in a new issue