This is a summary todo covering several subprojects, which would extend
git-annex to be able to use proxies which sit in front of a cluster of
repositories.

1. [[design/passthrough_proxy]]
2. [[design/p2p_protocol_over_http]]
3. [[design/balanced_preferred_content]]
4. [[todo/track_free_space_in_repos_via_git-annex_branch]]
5. [[todo/proving_preferred_content_behavior]]

Joey has received funding to work on this.
Planned schedule of work:

* June: git-annex proxy
* July, part 1: git-annex proxy support for exporttree
* July, part 2: p2p protocol over http
* August: balanced preferred content
* September: streaming through proxy to special remotes (especially S3)
* October: proving behavior of balanced preferred content with proxies

[[!tag projects/openneuro]]

# work notes

In development on the `proxy` branch.

For June's work on [[design/passthrough_proxy]], implementation plan:

1. UUID discovery via git-annex branch. Add a log file listing UUIDs
   accessible via proxy UUIDs. It also will contain the names
   of the remotes that the proxy is a proxy for, 
   from the perspective of the proxy. (done)

1. Add `git-annex updateproxy` command and remote.name.annex-proxy
   configuration. (done)

1. getProxies should be cached to avoid repeatedly reading the log and
   parsing.

1. Remote names coming from the git-annex branch need to be
   limited to what's legal in git remote names. If a remote name is not
   legal, munge it until it is.
   This will also prevent remote names being a security hazard
   via eg escape characters.

2. Remote instantiation for proxies. When a remote "foo" is a proxy,
   and has a remote "bar", instantiate a remote "foo-bar" that has the UUID
   of bar but is of the same type and configuration of remote "foo".

3. Implement proxying in git-annex-shell so connections with the UUID
   of one of the proxy's 

4. Let `storeKey` return a list of UUIDs where content was stored,
   and make proxies accept uploads directed at them, rather than a specific
   instantiated remote, and fan out the upload to whatever nodes behind
   the proxy want it. This will need P2P protocol extensions.

5. Make `git-annex copy --from $proxy` pick a node that contains each
   file, and use the instantiated remote for getting the file. Same for
   similar commands.

6. Make `git-annex drop --from $proxy` drop, when possible, from every
   remote accessible by the proxy. Communicate partial drops somehow.

7. Make commands like `git-annex push` not iterate over instantiate
   remotes, and instead just send content to the proxy for fanout.

8. Optimise proxy speed. See design for idea.

9. Encryption and chunking. See design for issues.

10. Cycle prevention. See design.

11. indirect uploads (to be considered). See design.