Commit graph

31159 commits

Author SHA1 Message Date
Joey Hess
c6e4bc0a22
fix regression in addurl --file caused by youtube-dl support
Now youtubeDlCheck downloads the beginning of the url's content and
checks if it's html, only when it is does it pass it off the youtube-dl
to check if it supports it.

This means more work is done for urls that youtube-dl does support,
but is probably more efficient for other urls, since it only downloads
the first chunk of content, while youtube-dl probably downloads more.

As well as the reported bug, this also fixes behavior when an url
was added with youtube-dl, but the url content has now changed from
a html page to something else. Remote.Web.checkKey used to wrongly
succeed in that situation, since youtube-dl said sure it can download
that something else.

This commit was supported by the NSF-funded DataLad project.
2017-12-06 13:22:31 -04:00
Joey Hess
6b5e55a154
reproduction recipe 2017-12-06 12:02:19 -04:00
Joey Hess
01ae816af7
Merge branch 'master' of ssh://git-annex.branchable.com 2017-12-06 11:50:19 -04:00
Joey Hess
7c98f14391
avoid build warning when built w/o dbus 2017-12-06 10:54:48 -04:00
Horus
1dba744342 Added a comment 2017-12-06 11:45:33 +00:00
http://xgm.de/oid/
deef1e1a26 Added a comment 2017-12-06 08:39:10 +00:00
http://xgm.de/oid/
bb019c87c1 removed 2017-12-06 08:36:45 +00:00
http://xgm.de/oid/
a774e6f53e Added a comment 2017-12-06 08:33:41 +00:00
yarikoptic
91264858e9 2017-12-06 00:50:17 +00:00
yarikoptic
c589562131 initial whining about yt: prefix 2017-12-06 00:46:33 +00:00
Joey Hess
fc845e6530
more lambda-case conversion 2017-12-05 15:00:50 -04:00
yarikoptic
cf05ebbeba Added a comment 2017-12-05 18:51:49 +00:00
Joey Hess
936d50310d
Merge branch 'master' of ssh://git-annex.branchable.com 2017-12-05 14:28:15 -04:00
yarikoptic
6c3fa431d9 Added a comment 2017-12-05 18:26:43 +00:00
Joey Hess
429132f496
try again to avoid directory removal issues on NFS
af6068525a seems to not have worked;
though the keys database should not have any files open after closeDb,
NFS seems to be creating some files where while the directory is being
removed, which causes the removal to fail.

So instead, try renaming the directory out of the way.

This commit was supported by the NSF-funded DataLad project.
2017-12-05 14:25:51 -04:00
yarikoptic
7187d454d3 Added a comment 2017-12-05 18:20:41 +00:00
Joey Hess
ed701667aa
fix gpg subkey support typo
initremote, enableremote: Really support gpg subkeys suffixed with an
exclamation mark, which forces gpg to use a specific subkey. (Previous try
had a bug.)

This commit was sponsored by Jake Vosloo on Patreon.
2017-12-05 13:58:53 -04:00
Joey Hess
4e38c4f57f
Allow exporttree remotes to be marked as dead.
Union with max so that DeadTrusted wins over UnTrusted.

This commit was sponsored by Trenton Cronholm on Patreon.
2017-12-05 13:46:55 -04:00
Joey Hess
1f937ee840
comment 2017-12-05 13:40:04 -04:00
Joey Hess
e5c610b298
response 2017-12-05 13:35:15 -04:00
Joey Hess
bb456fdccd
response 2017-12-05 13:32:31 -04:00
Joey Hess
f6d0c6de30
yet another instance of git smudge/clean interface suck 2017-12-05 13:28:07 -04:00
Joey Hess
f00770d736
Removed no longer needed dependency on yesod-default.
This commit was sponsored by Nick Daly on Patreon.
2017-12-05 13:18:25 -04:00
Joey Hess
639a6df58a
fix windows build 2017-12-05 13:11:03 -04:00
Joey Hess
fd24034e56
fix format of comment 2017-12-05 13:01:26 -04:00
Joey Hess
c93e124a28
response 2017-12-05 12:45:21 -04:00
Joey Hess
bb1299a5f1
Merge branch 'master' of ssh://git-annex.branchable.com 2017-12-05 12:44:11 -04:00
Joey Hess
42368af8f4
comment 2017-12-05 12:43:57 -04:00
andrew
1807fb2a8a Added a comment: gcrypt, git-annex and rsync requires absolute path 2017-12-05 13:49:42 +00:00
http://xgm.de/oid/
98dc4b9a0a 2017-12-04 20:04:56 +00:00
Joey Hess
ae945d3810
update 2017-12-04 12:25:21 -04:00
anarcat
adaad9e449 note when the command was introduced 2017-12-02 00:26:29 +00:00
Joey Hess
afd8aa0b11
Merge branch 'master' of ssh://git-annex.branchable.com 2017-11-30 17:08:44 -04:00
Joey Hess
15d5d0fafb
devblog 2017-11-30 17:08:18 -04:00
Joey Hess
5e95d54604
make --raw avoid ever running youtube-dl
added DownloadOptions type to avoid needing two different Bool params
for some functions.

This commit was sponsored by Thom May on Patreon.
2017-11-30 17:06:15 -04:00
Joey Hess
640cb36a5c
Merge branch 'master' into youtube-dl 2017-11-30 16:16:58 -04:00
Joey Hess
1228fe8c86
honor annex.diskreserve when running youtube-dl
This commit was sponsored by André Pereira on Patreon.
2017-11-30 16:14:36 -04:00
Joey Hess
67ab567bc7
display filename when file already has url
Otherwise it's confusing what happened..
2017-11-30 15:06:21 -04:00
Joey Hess
7c88633121
improve error message
checkCanAdd can be called on annexed files too, when youtube-dl is in
use.
2017-11-30 15:00:53 -04:00
Joey Hess
bbedc1c265
check youtube-dl for --fast and --relaxed when adding new file
The filename comes from youtube-dl also.

This commit was sponsored by Denis Dzyubenko on Patreon.
2017-11-30 14:57:20 -04:00
Joey Hess
2528e3ddb0
rethought --relaxed change
Better to make it not be surprising and slow, than surprising and fast.
--raw can be used when it needs to be really fast.

Implemented adding a youtube-dl supported url to an existing file.

This commit was sponsored by andrea rota.
2017-11-30 14:13:20 -04:00
Joey Hess
8a0038ec23
avoid warning when youtube-dl is not installed
If a user does not have it installed, don't warn on every imported item
about it.
2017-11-30 13:43:55 -04:00
Joey Hess
a7b4358c05
honor --file when downloading with youtube-dl
This used to be done with quvi, and got broken in the transition.
2017-11-30 13:24:52 -04:00
Joey Hess
22a9389bc7
fix build 2017-11-30 13:21:19 -04:00
pietroastolfi92@8933106257e5e108af6f46b584f3f10acb198f1d
34346dd563 2017-11-30 16:31:29 +00:00
http://xgm.de/oid/
09ddd34b76 2017-11-30 12:32:53 +00:00
Joey Hess
31b4d7c6d0
pass git config options to youtube-dl --simulate
Decided not to --ignore-config by default. It the user has something in
their youtube-dl config files that breaks git-annex they can configure
it to use that option.
2017-11-29 20:07:03 -04:00
Joey Hess
47c3760238
files pushed now 2017-11-29 17:44:53 -04:00
Joey Hess
43cbbfe4f7
turn on lambdacase for distributionupdate 2017-11-29 17:39:57 -04:00
Joey Hess
52607bafe8
Merge branch 'master' of ssh://git-annex.branchable.com 2017-11-29 17:37:14 -04:00