git-annex/doc
Joey Hess 5ede109ae5
gave up on upload fanout to cluster's proxy
The problem with that idea is that the cluster's proxy is necessarily a
remote, and necessarily one that we'll want to sync with, since the git
repository is stored there. So when its preferred content wants a file,
and the cluster does too, the file will get uploaded to it as well as to
the cluster. With fanout, the upload to the cluster will populate the
proxy as well, avoiding a second upload. But only if the file is sent to
the cluster first. If it's sent to the proxy first, there will be two
uploads.

Another, lesser problem is that a repository can proxy for more than one
cluster. So when does it make sense to drop content from the repository?
It could be done when dropping from one cluster, but what of the other
one?

This complication was not necessary anyway. Instead, if it's desirable
to have some content accessed from close to the proxy, one of the
cluster nodes can just be put on the same filesystem as it. That will be
just as fast as storing the content on the proxy.
2024-06-25 13:35:12 -04:00
..
Android
android
assistant
automatic_conflict_resolution
backends Added a comment: combine worm with partial hash 2024-02-01 11:53:54 +00:00
bare_repositories
bugs original report / question 2024-06-18 13:57:23 +00:00
chunking
coding_style
contribute
copies
design don't sync with cluster nodes by default 2024-06-25 10:24:38 -04:00
devblog devblog 2024-05-16 13:23:36 -04:00
direct_mode
download
encryption
footer
forum 2024-06-19 15:46:26 +00:00
future_proofing
git-annex-add
git-annex-addurl
git-annex-adjust
git-annex-benchmark
git-annex-checkpresentkey
git-annex-config
git-annex-copy
git-annex-diffdriver Added a comment: Minimum required version 2023-10-24 14:27:25 +00:00
git-annex-direct
git-annex-drop
git-annex-enableremote
git-annex-find
git-annex-get lookupkey: Added --ref option 2023-09-12 12:49:11 -04:00
git-annex-import
git-annex-importfeed
git-annex-lookupkey
git-annex-matching-options fix a typo 2023-12-18 13:40:23 -04:00
git-annex-metadata
git-annex-move
git-annex-p2p
git-annex-preferred-content
git-annex-reinject
git-annex-repair
git-annex-rmurl
git-annex-setpresentkey
git-annex-sync
git-annex-test
git-annex-unannex
git-annex-undo
git-annex-uninit move a comment that is a bug report 2023-11-21 15:57:10 -04:00
git-annex-unlock
git-annex-unused
git-annex-webapp Added a comment: Thanks Yann! 2023-11-19 18:20:03 +00:00
git-annex-whereis promote comment to todo 2024-04-30 15:13:59 -04:00
git-annex-whereused
how_it_works
install Added a comment 2024-01-11 14:15:58 +00:00
internals update 2024-05-28 13:36:27 -04:00
license
links clusters documentation 2024-06-20 10:57:43 -04:00
metadata
news add news item for git-annex 10.20240531 2024-05-31 12:32:42 -04:00
not
polls
preferred_content
profiling remove an out of date comment 2023-10-25 13:08:01 -04:00
projects Fix compatable typo (yet to add to codespell) 2024-05-01 15:46:25 -04:00
required_content
scalability
security
special_remotes Fix compatable typo (yet to add to codespell) 2024-05-01 15:46:25 -04:00
stickers
submodules Added a comment 2024-03-05 05:21:59 +00:00
sync
templates
testimonials
thanks update 2024-06-13 19:08:04 -04:00
tips tweak 2024-05-30 13:31:49 -04:00
todo gave up on upload fanout to cluster's proxy 2024-06-25 13:35:12 -04:00
trust
tuning Added a comment 2024-06-15 07:37:07 +00:00
upgrades
use_case
users Add link to Yann's distribits talk 2024-04-09 20:34:51 +00:00
videos add my distribits talk 2024-06-20 11:03:19 -04:00
walkthrough
workflow
Android.mdwn
assistant.mdwn
automatic_conflict_resolution.mdwn
backends.mdwn add Backend.GitRemoteAnnex 2024-05-07 13:54:08 -04:00
bare_repositories.mdwn
bugs.mdwn
builds.mdwn
chunking.mdwn
clusters.mdwn gave up on upload fanout to cluster's proxy 2024-06-25 13:35:12 -04:00
coding_style.mdwn
comments.mdwn
contact.mdwn
contribute.mdwn policy on AI generated content 2024-03-18 16:57:54 -04:00
copies.mdwn
design.mdwn
devblog.mdwn
direct_mode.mdwn
distributed_version_control.mdwn
download.mdwn
encryption.mdwn Fix compatable typo (yet to add to codespell) 2024-05-01 15:46:25 -04:00
favicon.ico
forum.mdwn
future_proofing.mdwn preparing to merge git-remote-annex 2024-05-10 15:06:15 -04:00
git-annex-add.mdwn
git-annex-addunused.mdwn
git-annex-addurl.mdwn implement URL to VURL migration 2024-03-01 16:42:02 -04:00
git-annex-adjust.mdwn
git-annex-assist.mdwn multiple -m second try 2024-04-09 12:56:47 -04:00
git-annex-assistant.mdwn
git-annex-backends.mdwn
git-annex-benchmark.mdwn
git-annex-calckey.mdwn
git-annex-checkpresentkey.mdwn
git-annex-common-options.mdwn improve match explanations 2023-07-26 15:37:03 -04:00
git-annex-config.mdwn
git-annex-configremote.mdwn
git-annex-contentlocation.mdwn
git-annex-copy.mdwn copy/move --from-anywhere --to remote 2023-11-30 16:34:30 -04:00
git-annex-dead.mdwn info: Added --dead-repositories option 2023-08-09 12:43:48 -04:00
git-annex-describe.mdwn
git-annex-diffdriver.mdwn diffdriver: Added --get option 2023-08-22 11:58:53 -04:00
git-annex-direct.mdwn
git-annex-drop.mdwn
git-annex-dropkey.mdwn
git-annex-dropunused.mdwn dropunused: Support --jobs 2023-07-21 14:03:34 -04:00
git-annex-edit.mdwn
git-annex-enable-tor.mdwn
git-annex-enableremote.mdwn initremote, enableremote: Added --with-url to enable using git-remote-annex 2024-05-24 14:29:36 -04:00
git-annex-examinekey.mdwn fix typo in example 2024-03-01 15:44:46 -04:00
git-annex-expire.mdwn
git-annex-export.mdwn
git-annex-filter-branch.mdwn
git-annex-filter-process.mdwn
git-annex-find.mdwn
git-annex-findkeys.mdwn
git-annex-findref.mdwn
git-annex-fix.mdwn
git-annex-forget.mdwn
git-annex-fromkey.mdwn
git-annex-fsck.mdwn
git-annex-fuzztest.mdwn
git-annex-get.mdwn
git-annex-group.mdwn group: Added --list option 2024-05-29 13:37:35 -04:00
git-annex-groupwanted.mdwn
git-annex-import.mdwn multiple -m second try 2024-04-09 12:56:47 -04:00
git-annex-importfeed.mdwn support VURL backend 2024-02-29 13:48:51 -04:00
git-annex-indirect.mdwn
git-annex-info.mdwn info: Added "annex sizes of repositories" table to the overall display 2023-12-29 12:09:30 -04:00
git-annex-init.mdwn
git-annex-initcluster.mdwn clusters documentation 2024-06-20 10:57:43 -04:00
git-annex-initremote.mdwn initremote, enableremote: Added --with-url to enable using git-remote-annex 2024-05-24 14:29:36 -04:00
git-annex-inprogress.mdwn
git-annex-list.mdwn
git-annex-lock.mdwn
git-annex-log.mdwn git-annex log --gnuplot 2023-11-14 14:56:58 -04:00
git-annex-lookupkey.mdwn lookupkey: Added --ref option 2023-09-12 12:49:11 -04:00
git-annex-map.mdwn
git-annex-matchexpression.mdwn --explain for preferred/required content matching 2023-07-26 14:50:04 -04:00
git-annex-matching-expression.mdwn
git-annex-matching-options.mdwn Added --expected-present file matching option 2024-01-25 12:56:41 -04:00
git-annex-merge.mdwn
git-annex-metadata.mdwn
git-annex-migrate.mdwn clarification 2024-03-01 17:03:40 -04:00
git-annex-mincopies.mdwn
git-annex-mirror.mdwn add a warning about --json not being self describing 2023-06-29 15:38:37 -04:00
git-annex-move.mdwn copy/move --from-anywhere --to remote 2023-11-30 16:34:30 -04:00
git-annex-multicast.mdwn
git-annex-numcopies.mdwn
git-annex-oldkeys.mdwn oldkeys: check associated files by default and add --unchecked 2023-08-23 13:46:41 -04:00
git-annex-p2p.mdwn
git-annex-post-receive.mdwn
git-annex-pre-commit.mdwn
git-annex-preferred-content.mdwn add git configs for clusters 2024-06-14 12:20:17 -04:00
git-annex-proxy.mdwn
git-annex-pull.mdwn 2024-05-02 14:32:26 +00:00
git-annex-push.mdwn fix option desc pasted from pull 2024-04-18 10:05:11 -04:00
git-annex-readpresentkey.mdwn
git-annex-registerurl.mdwn add reregisterurl command 2024-03-05 15:06:14 -04:00
git-annex-reinit.mdwn
git-annex-reinject.mdwn reinject: Added --guesskeys option 2023-06-26 14:05:31 -04:00
git-annex-rekey.mdwn
git-annex-remotedaemon.mdwn
git-annex-renameremote.mdwn
git-annex-repair.mdwn
git-annex-required.mdwn wording 2024-06-20 10:15:24 -04:00
git-annex-reregisterurl.mdwn add reregisterurl command 2024-03-05 15:06:14 -04:00
git-annex-resolvemerge.mdwn
git-annex-restage.mdwn
git-annex-rmurl.mdwn
git-annex-satisfy.mdwn dial back addition, but keep it 2023-11-28 12:03:55 -04:00
git-annex-schedule.mdwn
git-annex-semitrust.mdwn
git-annex-setkey.mdwn
git-annex-setpresentkey.mdwn
git-annex-shell.mdwn git-annex-shell: accept uuid of remote that proxying is enabled for 2024-06-10 12:44:35 -04:00
git-annex-smudge.mdwn
git-annex-status.mdwn
git-annex-sync.mdwn multiple -m second try 2024-04-09 12:56:47 -04:00
git-annex-test.mdwn test annex.shared-sop-command 2024-01-10 16:30:38 -04:00
git-annex-testremote.mdwn improve special remote docs 2024-02-05 15:48:15 -04:00
git-annex-transferkey.mdwn
git-annex-transferkeys.mdwn
git-annex-transferrer.mdwn
git-annex-trust.mdwn
git-annex-unannex.mdwn
git-annex-undo.mdwn
git-annex-ungroup.mdwn
git-annex-uninit.mdwn
git-annex-unlock.mdwn
git-annex-unregisterurl.mdwn add reregisterurl command 2024-03-05 15:06:14 -04:00
git-annex-untrust.mdwn
git-annex-unused.mdwn oldkeys: New command that lists the keys used by old versions of a file 2023-08-22 14:51:06 -04:00
git-annex-updatecluster.mdwn clusters documentation 2024-06-20 10:57:43 -04:00
git-annex-updateproxy.mdwn add git-annex updatecluster command 2024-06-14 15:02:01 -04:00
git-annex-upgrade.mdwn
git-annex-vadd.mdwn
git-annex-vcycle.mdwn
git-annex-version.mdwn
git-annex-vfilter.mdwn
git-annex-vicfg.mdwn
git-annex-view.mdwn
git-annex-vpop.mdwn
git-annex-wanted.mdwn wording 2024-06-20 10:15:24 -04:00
git-annex-watch.mdwn
git-annex-webapp.mdwn webapp: Added --port option, and annex.port config 2024-01-25 14:08:36 -04:00
git-annex-whereis.mdwn
git-annex-whereused.mdwn
git-annex.mdwn add annex-proxied 2024-06-24 10:16:59 -04:00
git-remote-annex.mdwn tip 2024-05-30 13:26:34 -04:00
git-remote-tor-annex.mdwn fix name of gitremote-helpers 2024-05-06 12:07:05 -04:00
git-union-merge.mdwn
how_it_works.mdwn
index.mdwn
install.mdwn
internals.mdwn implement cluster.log 2024-06-13 16:00:58 -04:00
license.mdwn
location_tracking.mdwn
logo-old-bw.svg
logo-old.png
logo-old.svg
logo-old_small.png
logo-with-cli.png Add logo version with '> git annex' text below 2024-02-22 11:17:08 -04:00
logo-with-cli.svg Add logo version with '> git annex' text below 2024-02-22 11:17:08 -04:00
logo.mdwn Add link to hellotux.com git-annex shirts 2024-03-25 06:18:36 +00:00
logo.svg
logo_16x16.png
logo_32x32.png
logo_small.png
meta.mdwn
metadata.mdwn
news.mdwn
not.mdwn
polls.mdwn
preferred_content.mdwn
privacy.mdwn
profiling.mdwn
projects.mdwn
publicrepos.mdwn
related_software.mdwn
repomap.png
required_content.mdwn
scalability.mdwn
security.mdwn
shortcuts.mdwn
sidebar.mdwn
sitemap.mdwn
special_remotes.mdwn update docs for git-remote-annex 2024-05-14 15:31:16 -04:00
stickers.mdwn
submodules.mdwn
summary.mdwn
sync.mdwn
testimonials.mdwn
thanks.mdwn update thanks and separate out 2023 name list 2024-02-15 13:24:32 -04:00
tips.mdwn
todo.mdwn
transferring_data.mdwn
trust.mdwn
tuning.mdwn
upgrades.mdwn
users.mdwn
videos.mdwn move new video into feed 2023-07-05 14:54:21 -04:00
walkthrough.mdwn
workflow.mdwn