git-annex/doc
Joey Hess f04d9574d6
fix transfer lock file for Download to not include uuid
While redundant concurrent transfers were already prevented in most
cases, it failed to prevent the case where two different repositories were
sending the same content to the same repository. By removing the uuid
from the transfer lock file for Download transfers, one repository
sending content will block the other one from also sending the same
content.

In order to interoperate with old git-annex, the old lock file is still
locked, as well as locking the new one. That added a lot of extra code
and work, and the plan is to eventually stop locking the old lock file,
at some point in time when an old git-annex process is unlikely to be
running at the same time.

Note that in the case of 2 repositories both doing eg
`git-annex copy foo --to origin`
the output is not that great:

copy b (to origin...)
  transfer already in progress, or unable to take transfer lock
git-annex: transfer already in progress, or unable to take transfer lock
97%   966.81 MiB      534 GiB/s 0sp2pstdio: 1 failed

  Lost connection (fd:14: hPutBuf: resource vanished (Broken pipe))

  Transfer failed

Perhaps that output could be cleaned up? Anyway, it's a lot better than letting
the redundant transfer happen and then failing with an obscure error about
a temp file, which is what it did before. And it seems users don't often
try to do this, since nobody ever reported this bug to me before.
(The "97%" there is actually how far along the *other* transfer is.)

Sponsored-by: Joshua Antonishen on Patreon
2024-03-25 14:47:46 -04:00
..
Android
android
assistant
automatic_conflict_resolution
backends Added a comment: combine worm with partial hash 2024-02-01 11:53:54 +00:00
bare_repositories
bugs fix transfer lock file for Download to not include uuid 2024-03-25 14:47:46 -04:00
chunking
coding_style
contribute
copies
design update 2024-03-15 10:21:21 -04:00
devblog
direct_mode
download
encryption
footer
forum Added a comment 2024-03-06 17:03:51 +00:00
future_proofing
git-annex-add
git-annex-addurl
git-annex-adjust
git-annex-benchmark
git-annex-checkpresentkey
git-annex-config
git-annex-copy
git-annex-diffdriver Added a comment: Minimum required version 2023-10-24 14:27:25 +00:00
git-annex-direct
git-annex-drop
git-annex-enableremote
git-annex-find
git-annex-get
git-annex-import
git-annex-importfeed
git-annex-lookupkey
git-annex-matching-options fix a typo 2023-12-18 13:40:23 -04:00
git-annex-metadata
git-annex-move
git-annex-p2p
git-annex-preferred-content
git-annex-reinject
git-annex-repair
git-annex-rmurl
git-annex-setpresentkey
git-annex-sync
git-annex-test
git-annex-unannex
git-annex-undo
git-annex-uninit move a comment that is a bug report 2023-11-21 15:57:10 -04:00
git-annex-unlock
git-annex-unused
git-annex-webapp Added a comment: Thanks Yann! 2023-11-19 18:20:03 +00:00
git-annex-whereis
git-annex-whereused
how_it_works
install Added a comment 2024-01-11 14:15:58 +00:00
internals
license
links
metadata
news add news item for git-annex 10.20240227 2024-02-27 13:02:23 -04:00
not
polls
preferred_content
profiling remove an out of date comment 2023-10-25 13:08:01 -04:00
projects add potential list 2024-03-01 16:54:43 -04:00
required_content
scalability
security
special_remotes comment 2024-03-22 11:07:00 -04:00
stickers
submodules Added a comment 2024-03-05 05:21:59 +00:00
sync
templates
testimonials
thanks update 2024-03-05 13:16:06 -04:00
tips Added a comment: Colocating git-annex and git-lfs 2024-02-22 02:55:26 +00:00
todo fix transfer lock file for Download to not include uuid 2024-03-25 14:47:46 -04:00
trust
tuning Added a comment: Still experimental? 2024-03-06 12:26:56 +00:00
upgrades
use_case
users Mention annextimelog 2024-01-16 23:54:27 +00:00
videos Add link to English re-recording of Yann's git-annex workshop kickoff talk @Tübix2023 2023-12-05 17:18:50 +00:00
walkthrough
workflow
Android.mdwn
assistant.mdwn
automatic_conflict_resolution.mdwn
backends.mdwn support VURL backend 2024-02-29 13:48:51 -04:00
bare_repositories.mdwn
bugs.mdwn
builds.mdwn
chunking.mdwn
coding_style.mdwn
comments.mdwn
contact.mdwn
contribute.mdwn policy on AI generated content 2024-03-18 16:57:54 -04:00
copies.mdwn
design.mdwn
devblog.mdwn
direct_mode.mdwn
distributed_version_control.mdwn
download.mdwn
encryption.mdwn test annex.shared-sop-command 2024-01-10 16:30:38 -04:00
favicon.ico
forum.mdwn
future_proofing.mdwn
git-annex-add.mdwn
git-annex-addunused.mdwn
git-annex-addurl.mdwn implement URL to VURL migration 2024-03-01 16:42:02 -04:00
git-annex-adjust.mdwn
git-annex-assist.mdwn
git-annex-assistant.mdwn
git-annex-backends.mdwn
git-annex-benchmark.mdwn
git-annex-calckey.mdwn
git-annex-checkpresentkey.mdwn
git-annex-common-options.mdwn
git-annex-config.mdwn
git-annex-configremote.mdwn
git-annex-contentlocation.mdwn
git-annex-copy.mdwn copy/move --from-anywhere --to remote 2023-11-30 16:34:30 -04:00
git-annex-dead.mdwn
git-annex-describe.mdwn
git-annex-diffdriver.mdwn
git-annex-direct.mdwn
git-annex-drop.mdwn
git-annex-dropkey.mdwn
git-annex-dropunused.mdwn
git-annex-edit.mdwn
git-annex-enable-tor.mdwn
git-annex-enableremote.mdwn
git-annex-examinekey.mdwn fix typo in example 2024-03-01 15:44:46 -04:00
git-annex-expire.mdwn
git-annex-export.mdwn
git-annex-filter-branch.mdwn
git-annex-filter-process.mdwn
git-annex-find.mdwn
git-annex-findkeys.mdwn
git-annex-findref.mdwn
git-annex-fix.mdwn
git-annex-forget.mdwn
git-annex-fromkey.mdwn
git-annex-fsck.mdwn
git-annex-fuzztest.mdwn
git-annex-get.mdwn
git-annex-group.mdwn
git-annex-groupwanted.mdwn
git-annex-import.mdwn import: --message/-m option 2024-01-18 12:41:44 -04:00
git-annex-importfeed.mdwn support VURL backend 2024-02-29 13:48:51 -04:00
git-annex-indirect.mdwn
git-annex-info.mdwn info: Added "annex sizes of repositories" table to the overall display 2023-12-29 12:09:30 -04:00
git-annex-init.mdwn
git-annex-initremote.mdwn
git-annex-inprogress.mdwn
git-annex-list.mdwn
git-annex-lock.mdwn
git-annex-log.mdwn git-annex log --gnuplot 2023-11-14 14:56:58 -04:00
git-annex-lookupkey.mdwn
git-annex-map.mdwn
git-annex-matchexpression.mdwn
git-annex-matching-expression.mdwn
git-annex-matching-options.mdwn Added --expected-present file matching option 2024-01-25 12:56:41 -04:00
git-annex-merge.mdwn
git-annex-metadata.mdwn
git-annex-migrate.mdwn clarification 2024-03-01 17:03:40 -04:00
git-annex-mincopies.mdwn
git-annex-mirror.mdwn
git-annex-move.mdwn copy/move --from-anywhere --to remote 2023-11-30 16:34:30 -04:00
git-annex-multicast.mdwn
git-annex-numcopies.mdwn
git-annex-oldkeys.mdwn
git-annex-p2p.mdwn
git-annex-post-receive.mdwn
git-annex-pre-commit.mdwn
git-annex-preferred-content.mdwn
git-annex-proxy.mdwn
git-annex-pull.mdwn distributed migration for pull and sync --content 2023-12-08 14:18:18 -04:00
git-annex-push.mdwn
git-annex-readpresentkey.mdwn
git-annex-registerurl.mdwn add reregisterurl command 2024-03-05 15:06:14 -04:00
git-annex-reinit.mdwn
git-annex-reinject.mdwn
git-annex-rekey.mdwn
git-annex-remotedaemon.mdwn
git-annex-renameremote.mdwn
git-annex-repair.mdwn
git-annex-required.mdwn
git-annex-reregisterurl.mdwn add reregisterurl command 2024-03-05 15:06:14 -04:00
git-annex-resolvemerge.mdwn
git-annex-restage.mdwn
git-annex-rmurl.mdwn
git-annex-satisfy.mdwn dial back addition, but keep it 2023-11-28 12:03:55 -04:00
git-annex-schedule.mdwn
git-annex-semitrust.mdwn
git-annex-setkey.mdwn
git-annex-setpresentkey.mdwn
git-annex-shell.mdwn
git-annex-smudge.mdwn
git-annex-status.mdwn
git-annex-sync.mdwn
git-annex-test.mdwn test annex.shared-sop-command 2024-01-10 16:30:38 -04:00
git-annex-testremote.mdwn improve special remote docs 2024-02-05 15:48:15 -04:00
git-annex-transferkey.mdwn
git-annex-transferkeys.mdwn
git-annex-transferrer.mdwn
git-annex-trust.mdwn
git-annex-unannex.mdwn
git-annex-undo.mdwn
git-annex-ungroup.mdwn
git-annex-uninit.mdwn
git-annex-unlock.mdwn
git-annex-unregisterurl.mdwn add reregisterurl command 2024-03-05 15:06:14 -04:00
git-annex-untrust.mdwn
git-annex-unused.mdwn
git-annex-upgrade.mdwn
git-annex-vadd.mdwn
git-annex-vcycle.mdwn
git-annex-version.mdwn
git-annex-vfilter.mdwn
git-annex-vicfg.mdwn
git-annex-view.mdwn
git-annex-vpop.mdwn
git-annex-wanted.mdwn
git-annex-watch.mdwn
git-annex-webapp.mdwn webapp: Added --port option, and annex.port config 2024-01-25 14:08:36 -04:00
git-annex-whereis.mdwn
git-annex-whereused.mdwn
git-annex.mdwn add reregisterurl command 2024-03-05 15:06:14 -04:00
git-remote-tor-annex.mdwn
git-union-merge.mdwn
how_it_works.mdwn
index.mdwn
install.mdwn
internals.mdwn add equivilant key log for VURL keys 2024-02-29 16:01:49 -04:00
license.mdwn
location_tracking.mdwn
logo-old-bw.svg
logo-old.png
logo-old.svg
logo-old_small.png
logo-with-cli.png Add logo version with '> git annex' text below 2024-02-22 11:17:08 -04:00
logo-with-cli.svg Add logo version with '> git annex' text below 2024-02-22 11:17:08 -04:00
logo.mdwn Add logo version with '> git annex' text below 2024-02-22 11:17:08 -04:00
logo.svg
logo_16x16.png
logo_32x32.png
logo_small.png
meta.mdwn
metadata.mdwn
news.mdwn
not.mdwn
polls.mdwn
preferred_content.mdwn
privacy.mdwn
profiling.mdwn
projects.mdwn
publicrepos.mdwn
related_software.mdwn
repomap.png
required_content.mdwn
scalability.mdwn
security.mdwn
shortcuts.mdwn
sidebar.mdwn
sitemap.mdwn
special_remotes.mdwn wording 2024-02-05 15:50:41 -04:00
stickers.mdwn
submodules.mdwn
summary.mdwn
sync.mdwn
testimonials.mdwn
thanks.mdwn update thanks and separate out 2023 name list 2024-02-15 13:24:32 -04:00
tips.mdwn
todo.mdwn
transferring_data.mdwn
trust.mdwn
tuning.mdwn
upgrades.mdwn
users.mdwn
videos.mdwn
walkthrough.mdwn
workflow.mdwn