CI to automate build of cargo lockfiles on different Alpine releases for git-annex aports https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/git-annex
Find a file
Joey Hess db89e39df6
partially fix concurrency issue in updating the rollingtotal
It's possible for two processes or threads to both be doing the same
operation at the same time. Eg, both dropping the same key. If one
finishes and updates the rollingtotal, then the other one needs to be
prevented from later updating the rollingtotal as well. And they could
finish at the same time, or with some time in between.

Addressed this by making updateRepoSize be called with the journal
locked, and only once it's been determined that there is an actual
location change to record in the log. updateRepoSize waits for the
database to be updated.

When there is a redundant operation, updateRepoSize won't be called,
and the redundant LiveUpdate will be removed from the database on
garbage collection.

But: There will be a window where the redundant LiveUpdate is still
visible in the db, and processes can see it, combine it with the
rollingtotal, and arrive at the wrong size. This is a small window, but
it still ought to be addressed. Unsure if it would always be safe to
remove the redundant LiveUpdate? Consider the case where two drops and a
get are all running concurrently somehow, and the order they finish is
[drop, get, drop]. The second drop seems redundant to the first, but
it would not be safe to remove it. While this seems unlikely, it's hard
to rule out that a get and drop at different stages can both be running
at the same time.
2024-08-26 09:43:32 -04:00
Annex partially fix concurrency issue in updating the rollingtotal 2024-08-26 09:43:32 -04:00
Assistant punt on LiveUpdate plumbing through assistant for now 2024-08-24 09:37:24 -04:00
Backend avoid using dropWhileEnd 2024-05-28 10:27:36 -04:00
Build Merge branch 'master' into git-remote-annex 2024-05-10 14:20:36 -04:00
CmdLine consistently omit clusters when calculating RepoSizes 2024-08-17 11:24:14 -04:00
Command more LiveUpdate plumbing 2024-08-24 09:28:41 -04:00
Config use status --ignore-submodules in configureSmudgeFilter 2022-12-20 16:02:42 -04:00
Database rolling total of size changes in RepoSize database 2024-08-25 10:34:47 -04:00
debian Refresh standlone patch to avoid fuzz and offsets 2024-08-06 16:39:48 -04:00
doc partially fix concurrency issue in updating the rollingtotal 2024-08-26 09:43:32 -04:00
Git improve haddocks 2024-08-13 15:05:49 -04:00
Limit plumb in LiveUpdate (WIP) 2024-08-23 16:35:12 -04:00
Logs partially fix concurrency issue in updating the rollingtotal 2024-08-26 09:43:32 -04:00
Messages RawFilePath conversion 2024-01-19 14:26:21 -04:00
P2P LiveUpdate for clusters 2024-08-24 10:20:12 -04:00
Remote plumb in LiveUpdate (WIP) 2024-08-23 16:35:12 -04:00
RemoteDaemon support a P2PConnection that uses TMVars rather than Handles 2024-06-28 11:22:29 -04:00
standalone disable servant build flag for i386ancient 2024-07-30 10:01:56 -04:00
static Revert "remove newlines from static js and css" 2014-06-13 02:20:39 -04:00
templates assistant: When generating a gpg secret key, avoid hardcoding the key algorithm and size 2024-01-09 15:31:53 -04:00
Test remove support for directory < 1.2.7 2024-02-06 10:53:13 -04:00
Types rolling total of size changes in RepoSize database 2024-08-25 10:34:47 -04:00
Upgrade plumb in LiveUpdate (WIP) 2024-08-23 16:35:12 -04:00
Utility add preciseSize 2024-08-11 15:40:21 -04:00
.appveyor.yml update stack.yaml to nightly-2024-07-29 and remove stack-lts-18.13.yaml 2024-07-29 20:09:37 -04:00
.codespellrc A few more of typo fixes/skip as detected with bleeding edge codespell 2024-05-01 20:06:08 -04:00
.ghci turn of PackageImports in cabal file 2022-02-25 13:16:36 -04:00
.gitattributes update changelog location 2016-08-22 23:54:11 -04:00
.gitignore ignore git-remote-annex 2024-05-06 13:13:39 -04:00
.mailmap ENH: add one more mailmap for yarikoptic 2024-06-03 13:00:45 -04:00
Annex.hs plumb in LiveUpdate (WIP) 2024-08-23 16:35:12 -04:00
Assistant.hs webapp: Added --port option, and annex.port config 2024-01-25 14:08:36 -04:00
Author.hs improve attribution armoring 2023-11-21 11:34:21 -04:00
Backend.hs implement URL to VURL migration 2024-03-01 16:42:02 -04:00
bash-completion.bash bash completion fix 2018-11-12 13:23:05 -04:00
Benchmark.hs --size-limit exit 101 2021-06-04 16:43:47 -04:00
BuildFlags.hs update servant build flag 2024-07-23 08:53:56 -04:00
BuildInfo.hs update licenses from GPL to AGPL 2019-03-13 15:48:14 -04:00
CHANGELOG Added the annex.fullybalancedthreshhold git config. 2024-08-22 07:15:55 -04:00
CmdLine.hs LiveUpdate db updates working 2024-08-24 11:49:58 -04:00
Command.hs plumb in LiveUpdate (WIP) 2024-08-23 16:35:12 -04:00
Common.hs Windows: Support long filenames in more (possibly all) of the code 2023-03-01 15:55:58 -04:00
Config.hs proxying to exporttree=yes annexobjects=yes basically working 2024-08-06 14:21:23 -04:00
COPYRIGHT Added dependency on unbounded-delays 2024-02-27 13:11:59 -04:00
Creds.hs simplify base64 to only use ByteString 2023-10-26 13:10:05 -04:00
Crypto.hs use hmac in balanced preferred content 2024-08-10 16:32:54 -04:00
git-annex.cabal plumb in LiveUpdate (WIP) 2024-08-23 16:35:12 -04:00
git-annex.hs add git-remote-annex stub and build machinery 2024-05-06 13:05:58 -04:00
git-union-merge.hs update licenses from GPL to AGPL 2019-03-13 15:48:14 -04:00
Git.hs run codespell throughout fixing typos automagically 2024-05-01 15:46:21 -04:00
Key.hs convert Key to ShortByteString 2021-10-05 20:20:08 -04:00
Limit.hs improve live update starting 2024-08-24 13:07:05 -04:00
Logs.hs update RepoSize database from git-annex branch incrementally 2024-08-17 13:35:00 -04:00
Makefile use cabal list-bin 2024-05-31 10:28:56 -04:00
Messages.hs maxsize overview display and --json support 2024-08-18 12:08:13 -04:00
NEWS prep release 2023-06-26 10:41:36 -04:00
README improve description 2022-01-06 12:24:27 -04:00
Remote.hs plumb in LiveUpdate (WIP) 2024-08-23 16:35:12 -04:00
Setup.hs Setup.hs: Stop installing man pages, desktop files, and the git-annex-shell and git-remote-tor-annex symlinks 2023-08-01 15:08:56 -04:00
stack-lts-18.13.yaml very temporarily copy stack.yaml to stack-lts-18.13.yaml 2024-07-31 10:09:47 -04:00
stack.yaml deindent 2024-07-30 10:34:18 -04:00
Test.hs use hmac in balanced preferred content 2024-08-10 16:32:54 -04:00
Types.hs plumb VerifyConfig into retrieveKeyFile 2021-08-17 12:43:13 -04:00
Upgrade.hs don't say a supported version is unsupported 2023-10-09 14:26:24 -04:00

git-annex allows managing large files with git, without storing the file
contents in git. It can sync, backup, and archive your data, offline
and online. Checksums and encryption keep your data safe and secure. Bring
the power and distributed nature of git to bear on your large files with
git-annex.

For documentation, see doc/ or <https://git-annex.branchable.com/>