mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

improve docs around uri claiming

Browse source
This commit is contained in:
Joey Hess 2020-05-21 11:58:57 -04:00
parent d7c7245438
commit 2de40ba4da
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
2 changed files with 38 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

5
Types/Remote.hs
View file

@ -149,7 +149,10 @@ data RemoteA a = Remote
, mkUnavailable :: a (Maybe (RemoteA a)) , mkUnavailable :: a (Maybe (RemoteA a))
-- Information about the remote, for git annex info to display. -- Information about the remote, for git annex info to display.
, getInfo :: a [(String, String)] , getInfo :: a [(String, String)]
-- Some remotes can download from an url (or uri). -- Some remotes can download from an url (or uri). This asks the
-- remote if it can handle a particular url. The actual download
-- will be done using retrieveKeyFile, and the remote can look up
-- up the url to download for a key using Logs.Web.getUrls.
, claimUrl :: Maybe (URLString -> a Bool) , claimUrl :: Maybe (URLString -> a Bool)
-- Checks that the url is accessible, and gets information about -- Checks that the url is accessible, and gets information about
-- its contents, without downloading the full content. -- its contents, without downloading the full content.

38
doc/design/external_special_remote_protocol.mdwn
View file

@ -365,9 +365,8 @@ handling a request.
URL. URL.
(git-annex does not send a reply to this message.) (git-annex does not send a reply to this message.)
* `SETURIPRESENT Key Uri` * `SETURIPRESENT Key Uri`
Records an URI where the Key can be downloaded from. Records an URI where the Key can be downloaded from. Use with uris
For example, "ipfs:ADDRESS" is used for the ipfs special remote; that cannot be downloaded with http.
its CLAIMURL handler checks for such URIS and claims them.
(git-annex does not send a reply to this message.) (git-annex does not send a reply to this message.)
* `SETURIMISSING Key Uri` * `SETURIMISSING Key Uri`
Records that the key can no longer be downloaded from the specified Records that the key can no longer be downloaded from the specified
@ -420,7 +419,38 @@ quite a long time, especially when the git-annex assistant is using it.
The assistant will detect when the system connects to a network, and will The assistant will detect when the system connects to a network, and will
start a new process the next time it needs to use a remote. start a new process the next time it needs to use a remote.
## readonly mode ## claiming custom uri schemes for use with git-annex addurl
If a special remote has its own uri scheme, or some other way to identify a
particular url as being content that is stored in the special remote,
and can be downloaded by it, it can implement CLAIMURL and CHECKURL.
This lets git-annex addurl be used with such urls.
For example, the ipfs special remote implements CLAIMURL and CHECKURL
for "ipfs:ADDRESS" uris. And the bittorrent special remote implements them
for http urls ending in ".torrent".
When a special remote has claimed an url, commands like git-annex addurl
will use TRANSFER RETRIEVE to request it download the content of a key.
To find out what url to download, the special remote can use GETURLS
to find out what urls are recorded for the key.
For example, the ipfs special remote sends "GETURLS $KEY ipfs:",
in order to get only the "ipfs:" uris.
The special remote can also use SETURIPRESENT or SETURLPRESENT,
eg after transferring content to the remote it might know the uri or url
that can be used to download it. And SETURIMISSING or SETURLMISSING
can be used after removing content from the remote. This information can
then be looked up using GETURLS. But it's not necessary to do this in order
to simply claim an url, because git-annex addurl takes care of it.
For example, the ipfs special remote sends "SETURIPRESENT $KEY ipfs:ADDRESS"
after storing each key in ipfs. It can later look up that uri when
downloading the key, and the ipfs uri is also displayed by git-annex
whereis.
## readonly mode for http downloads
Some storage services allow downloading the content of a file using a Some storage services allow downloading the content of a file using a
regular http connection, with no authentication. An external special remote regular http connection, with no authentication. An external special remote