Commit graph

44331 commits

Author SHA1 Message Date
Joey Hess
792106abc3
improve special remote docs
Sponsored-by: Dartmouth College's DANDI project
2024-02-05 15:48:15 -04:00
Joey Hess
083c471ee9
really close 2024-02-05 15:20:40 -04:00
Joey Hess
6b38d0c427
addurl, importfeed: Added --raw-except option
--raw-except=web allows using yt-dlp but not any other special remotes.

Currently this option can only be used once, trying to use it repeatedly
will make option parsing fail. Perhaps it ought to support being used more
than once, but it seemed like an unlikely use case to need that.

Note that getParsed is called repeatedly when the option is used with
several urls. While implementing DeferredParseClass would avoid that
innefficiency, it didn't seem worth the added boilerplate since
getParsed only calls byNameWithUUID which does minimal work.

Sponsored-by: Dartmouth College's DANDI project
2024-02-05 15:16:25 -04:00
Joey Hess
c0c85a7de4
comment and close 2024-02-05 14:11:47 -04:00
Joey Hess
d7419d6e65
comment 2024-02-05 14:06:03 -04:00
Joey Hess
e9ffa95fab
comment 2024-02-05 13:48:29 -04:00
Joey Hess
649363f3e8
comment 2024-02-05 13:29:10 -04:00
felix@996ab1030f55d480e424a17116e03a48bd984549
8f33c0a3af Added a comment: Same issue after kernel oops 2024-02-05 14:58:33 +00:00
cokoryu@4ae909755ee8e71bb5870a54f9be316b11c1cf0a
6177049c22 2024-02-04 10:56:30 +00:00
cokoryu@4ae909755ee8e71bb5870a54f9be316b11c1cf0a
d6ede848af 2024-02-04 10:54:17 +00:00
cokoryu@4ae909755ee8e71bb5870a54f9be316b11c1cf0a
f93030d653 2024-02-04 10:51:11 +00:00
cokoryu@4ae909755ee8e71bb5870a54f9be316b11c1cf0a
4f36641ac3 update for rename of forum/assistant.mdwn to forum/__96__git_annex_assistant__96___command_replace_all_files_with_pointer_file..mdwn 2024-02-04 10:50:28 +00:00
cokoryu@4ae909755ee8e71bb5870a54f9be316b11c1cf0a
e13331d497 update for rename of forum/assistant.mdwn to forum/__96__git_annex_assistant__96___command_replace_all_files_with_pointer_file..mdwn 2024-02-04 10:50:26 +00:00
cokoryu@4ae909755ee8e71bb5870a54f9be316b11c1cf0a
aaf328f8a4 rename forum/assistant.mdwn to forum/__96__git_annex_assistant__96___command_replace_all_files_with_pointer_file..mdwn 2024-02-04 10:50:24 +00:00
cokoryu@4ae909755ee8e71bb5870a54f9be316b11c1cf0a
19dcba63dc 2024-02-04 10:48:01 +00:00
jstritch
593186d461 2024-02-03 18:48:36 +00:00
jstritch
2e626ac659 2024-02-03 18:46:58 +00:00
yarikoptic
8a546d1b31 Added a comment 2024-02-03 01:17:39 +00:00
Joey Hess
2f3fe4d904
fix importfeed --force skip behavior reversion
importfeed --force: Don't treat it as a failure when an already downloaded
file exists. (Fixes a behavior change introduced in 10.20230626.)

04ee6c4c6b caused the reversion. Inside a CommandPerform, stop causes it
to fail. Before that commit, it was inside a CommandStart, where stop
causes it to skip.
2024-02-02 15:57:07 -04:00
Joey Hess
0c64cd30c2
compare urls irrespective of downloader
importfeed --force: Avoid creating duplicates of existing already
downloaded files when yt-dlp or a special remote was used.
2024-02-02 15:50:56 -04:00
Joey Hess
f1296e260e
Merge branch 'master' of ssh://git-annex.branchable.com 2024-02-02 15:26:27 -04:00
Joey Hess
b5c6c3b290
comment 2024-02-02 15:25:27 -04:00
yarikoptic
809bd149eb Added a comment 2024-02-02 19:08:38 +00:00
Joey Hess
ccfa7300f7
oddly groundhog's day thematic response 2024-02-02 14:43:19 -04:00
Joey Hess
fc32632774
followup 2024-02-02 14:32:12 -04:00
yarikoptic
5621922e08 the plea to respect prepare-commit-msg hook 2024-02-02 17:07:52 +00:00
yarikoptic
f36ba992ea todo for support of pushinsteadof 2024-02-02 16:27:20 +00:00
jstritch
05b43b0dfd Added a comment 2024-02-01 20:49:12 +00:00
jstritch
ee31d57f0b 2024-02-01 17:40:27 +00:00
windfish@91c7bac51a452080189a071094cb6f914fe3435b
211486472b Added a comment: combine worm with partial hash 2024-02-01 11:53:54 +00:00
jstritch
8f4cf44d91 Added a comment 2024-01-31 22:12:47 +00:00
yarikoptic
614d438217 question about migrating URLs between remotes 2024-01-31 20:40:44 +00:00
yarikoptic
0fd17ceeb5 Initial desire for addurl --raw-except 2024-01-31 20:35:03 +00:00
yarikoptic
93f9996595 Added a comment 2024-01-31 19:23:23 +00:00
yarikoptic
b775de5ee1 question about importfeed. 2024-01-31 19:19:31 +00:00
Joey Hess
e0266a8d80
update docs for --scrape 2024-01-30 16:12:33 -04:00
Joey Hess
3b22e61007
followup and close 2024-01-30 15:51:33 -04:00
Joey Hess
98c4a39dd2
Merge branch 'master' of ssh://git-annex.branchable.com 2024-01-30 15:41:28 -04:00
Joey Hess
90db97d9a2
importfeed: Added --scrape option
Which uses yt-dlp to screen scrape the equivilant of an RSS feed.

Note that youtubedlscraped is a speed optimisation. Since yt-dlp found
the urls, we know it can download them. That avoids calling
youtubeDlSupported on each url, which makes --fast a lot faster.

Almost all the same metadata fields and file formatting fields are
populated, when yt-dlp is able to get the data. Note that yt-dlp has some
additional useful metadata that could be exposed. But, much of it is
specific to particular websites, and it would be hard to document on the
git-annex importfeed man page.

Sponsored-by: unqueued on Patreon
2024-01-30 15:37:29 -04:00
Joey Hess
d7949f8202
move Feed and Item out of ToDownload
This is groundwork for producing ToDownload in other ways, that may not
be entirely isomorphic with feeds. Eg by using yt-dlp.
2024-01-30 14:11:26 -04:00
jstritch
4b3e38792c 2024-01-30 16:41:57 +00:00
yarikoptic
0621711c6f ask for better documentation. 2024-01-30 16:20:45 +00:00
yarikoptic
58b57ab999 error out if yt-dlp sees that video is/was there but not available 2024-01-29 22:03:47 +00:00
Joey Hess
b7f02e4f89
add news item for git-annex 10.20240129 2024-01-29 14:12:20 -04:00
Joey Hess
d61633e183
releasing package git-annex version 10.20240129 2024-01-29 14:12:12 -04:00
Joey Hess
0b8ba37d12
improve changelog 2024-01-25 14:28:19 -04:00
Joey Hess
5540f42e21
comment 2024-01-25 14:11:20 -04:00
Joey Hess
8e9ee31621
webapp: Added --port option, and annex.port config
The getSocket comment that mentioned using ":port"
in the hostname seems to have been incorrect or be out of date.
After all, the bug report came when the user first tried doing that,
and it didn't work.

Sponsored-by: the NIH-funded NICEMAN (ReproNim TR&D3) project
2024-01-25 14:08:36 -04:00
Joey Hess
d54f2ccae1
close 2024-01-25 13:28:23 -04:00
Joey Hess
3a20208ce1
confirm this todo 2024-01-25 13:25:15 -04:00