design for distributed clusters

This commit is contained in:
Joey Hess 2024-06-25 17:20:49 -04:00
parent b9889917a3
commit 9a8dcb58cd
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
2 changed files with 52 additions and 15 deletions

View file

@ -33,14 +33,15 @@ For June's work on [[design/passthrough_proxy]], remaining todos:
* Basic proxying to special remote support (non-streaming).
* Make sure that cluster-in-cluster cycles are prevented.
(Actually supporting cluster-in-cluster is optional, and it might
be added later.)
* Support distributed clusters: Make a proxy for a cluster repeat
protocol messages on to any remotes that have the same UUID as
the cluster. Needs VIA extension to P2P protocol to avoid cycles.
* Optimise proxy speed. See design for ideas.
* Use `sendfile()` to avoid data copying overhead when
`receiveBytes` is being fed right into `sendBytes`.
<https://github.com/Happstack/sendfile/issues/4>
* Encryption and chunking. See design for issues.