git-annex/doc/todo/addurl_--raw-except_REMOTEs__63__.mdwn

In [backups2datalad](https://github.com/dandi/backups2datalad/pull/21#issuecomment-1917911205) we ran into a behavior that `addurl --raw` does not only not considers all the fancy handling for youtube and .torrents, but also disregards our (`git-annex-remote-datalad`) external special remote (although still CLAIMURLs it first).
I think generally we would still prefer to use `--raw` as to avoid possible side-effects when someone manages to add some `.torrent` file which we want to add as a file, not to download it. But we would like to explicitly allow interactions with our special remote. That is why I think the most viable solution would be to provide `--raw-except` which would be like `--raw` but allowing explicitly listed special remotes (or hardcoded keywords like `:torrents:`, `:youtube:`) to be handled if encountered.

[[!meta author=yoh]]
[[!tag projects/dandi]]

> [[done]] --[[Joey]]
Initial desire for `addurl --raw-except` 2024-01-31 20:35:03 +00:00			In [backups2datalad](https://github.com/dandi/backups2datalad/pull/21#issuecomment-1917911205) we ran into a behavior that `addurl --raw` does not only not considers all the fancy handling for youtube and .torrents, but also disregards our (`git-annex-remote-datalad`) external special remote (although still CLAIMURLs it first).
			I think generally we would still prefer to use `--raw` as to avoid possible side-effects when someone manages to add some `.torrent` file which we want to add as a file, not to download it. But we would like to explicitly allow interactions with our special remote. That is why I think the most viable solution would be to provide `--raw-except` which would be like `--raw` but allowing explicitly listed special remotes (or hardcoded keywords like `:torrents:`, `:youtube:`) to be handled if encountered.

			`[[!meta author=yoh]]`
			`[[!tag projects/dandi]]`
addurl, importfeed: Added --raw-except option --raw-except=web allows using yt-dlp but not any other special remotes. Currently this option can only be used once, trying to use it repeatedly will make option parsing fail. Perhaps it ought to support being used more than once, but it seemed like an unlikely use case to need that. Note that getParsed is called repeatedly when the option is used with several urls. While implementing DeferredParseClass would avoid that innefficiency, it didn't seem worth the added boilerplate since getParsed only calls byNameWithUUID which does minimal work. Sponsored-by: Dartmouth College's DANDI project 2024-02-05 19:16:25 +00:00
			`> [[done]] --[[Joey]]`