CI to automate build of cargo lockfiles on different Alpine releases for git-annex aports https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/git-annex
Find a file
Joey Hess ae52efc673 scan multiple remotes in one pass
The expensive transfer scan now scans a whole set of remotes in one pass.
So at startup, or when network comes up, it will run only once.

Note that this can result in transfers from/to higher cost remotes being
queued before other transfers of other content from/to lower cost remotes.
Before, low cost remotes were scanned first and all their transfers came
first. When multiple transfers are queued for a key, the lower cost ones
are still queued first. However, this could result in transfers from slow
remotes running for a long time while transfers of other data from faster
remotes waits.

I expect to make the transfer queue smarter about ordering
and/or make it allow multiple transfers at a time, which should eliminate
this annoyance. (Also, it was already possible to get into that situation,
for example if the network was up, lots of transfers from slow remotes
might be queued, and then a disk is mounted and its faster transfers have
to wait.)

Also note that this means I don't need to improve the code in
Assistant.Sync that currently checks if any of the reconnected remotes
have diverged, and if so, queues scans of all of them. That had been very
innefficient, but now doesn't matter.
2012-08-26 14:09:02 -04:00
Annex thread safe git-annex index file use 2012-08-24 20:50:39 -04:00
Assistant scan multiple remotes in one pass 2012-08-26 14:09:02 -04:00
Backend Bugfix: Fix fsck in SHA*E backends, when the key contains composite extensions, as added in 3.20120721. 2012-08-24 12:16:17 -04:00
Build Fix imports and casing in Build.InstallDesktopFile 2012-08-02 20:11:41 +02:00
Command add transferkey command 2012-08-24 17:23:58 -04:00
Common lint 2011-11-11 01:52:58 -04:00
debian Bugfix: Fix fsck in SHA*E backends, when the key contains composite extensions, as added in 3.20120721. 2012-08-24 12:16:17 -04:00
doc add transferkey command 2012-08-24 17:23:58 -04:00
Git thread safe git-annex index file use 2012-08-24 20:50:39 -04:00
Locations full autostart support 2012-08-02 00:42:33 -04:00
Logs keep track of which remotes have been scanned in process state 2012-08-24 15:52:23 -04:00
Messages find --json 2011-12-23 01:08:19 -04:00
Remote fix build warning 2012-08-16 16:48:27 -07:00
static add icons 2012-07-31 03:10:16 -04:00
templates fix button display for paused transfer 2012-08-10 18:50:21 -04:00
Types add routes to pause/start/cancel transfers 2012-08-08 16:20:24 -04:00
Upgrade add routes to pause/start/cancel transfers 2012-08-08 16:20:24 -04:00
Utility thread safe git-annex index file use 2012-08-24 20:50:39 -04:00
.ghci autoload Common too in ghci 2012-03-24 17:25:47 -04:00
.gitattributes decruft 2011-06-22 18:56:08 -04:00
.gitignore Merge branch 'master' into assistant 2012-08-20 16:04:56 -04:00
Annex.hs pointlessness 2012-06-29 10:00:05 -04:00
Assistant.hs add NetWatcher thread 2012-08-21 19:58:53 -04:00
Backend.hs maintain set of files pendingAdd 2012-06-20 16:31:46 -04:00
CHANGELOG symlinks 2010-10-27 15:14:59 -04:00
Checks.hs layout 2012-01-06 21:53:47 -04:00
CmdLine.hs add fields to git-annex-shell 2012-07-02 00:53:00 -04:00
Command.hs copy, drop: Avoid checking numcopies attribute unnecessarily 2012-07-10 11:53:45 -06:00
Common.hs switch from System.Cmd.Utils to System.Process 2012-07-18 18:00:24 -04:00
Config.hs better readProcess 2012-07-19 00:57:40 -04:00
configure.hs Rewrote free disk space checking code 2012-03-22 17:32:47 -04:00
CONTRIBUTING Remove .dir-locals.el and add doc/contributing.mdwn. 2012-06-12 00:43:42 -07:00
COPYRIGHT Add link COPYRIGHT -> debian/copyright; add COPYRIGHT to sdist. 2012-06-11 23:27:00 -07:00
Crypto.hs add routes to pause/start/cancel transfers 2012-08-08 16:20:24 -04:00
Fields.hs keep logs of failed transfers, and requeue them when doing a non-full scan 2012-08-23 15:24:15 -04:00
git-annex.cabal Merge branch 'master' into assistant 2012-08-09 14:03:40 -04:00
git-annex.hs shave some 12 mb from the installed size 2012-03-15 12:00:19 -04:00
git-union-merge.hs factor out nukeFile 2012-06-06 13:13:13 -04:00
Git.hs Avoid ugly failure mode when moving content from a local repository that is not available. 2012-06-26 17:22:44 -04:00
GitAnnex.hs add transferkey command 2012-08-24 17:23:58 -04:00
GitAnnexShell.hs fix associatedfile sanity check 2012-07-02 11:10:17 -04:00
GPL symlinks 2010-10-27 15:14:59 -04:00
Init.hs adding removable drive repos now basically works 2012-08-05 14:49:47 -04:00
INSTALL symlinks 2010-10-27 15:14:59 -04:00
Limit.hs rename readMaybe to readish 2012-01-23 17:00:10 -04:00
Locations.hs add transfer scanned flag files 2012-08-23 13:42:26 -04:00
make-sdist.sh not bash specific 2012-06-15 14:22:00 -04:00
Makefile Merge branch 'master' into assistant 2012-08-20 16:04:56 -04:00
mdwn2man mwdn2man: Fix a bug in newline supression. Closes: #606578 2010-12-10 17:27:02 -04:00
Messages.hs hlint 2012-06-12 11:32:06 -04:00
NEWS update NEWS 2012-01-19 15:27:39 -04:00
Option.hs debugging improvements 2012-07-20 19:29:59 -04:00
README add README 2011-05-13 19:20:54 -04:00
Remote.hs tweak intro 2012-07-29 22:11:01 -04:00
Seek.hs add routes to pause/start/cancel transfers 2012-08-08 16:20:24 -04:00
Setup.hs install autostart file too 2012-08-01 23:31:53 -04:00
test.hs add routes to pause/start/cancel transfers 2012-08-08 16:20:24 -04:00
Types.hs tweak 2012-01-06 10:57:57 -04:00
Upgrade.hs tweaks 2012-01-11 00:06:54 -04:00
Usage.hs addunused: New command, the opposite of dropunused, it relinks unused content into the git repository. 2012-05-02 14:59:05 -04:00

git-annex allows managing files with git, without checking the file
contents into git. While that may seem paradoxical, it is useful when
dealing with files larger than git can currently easily handle, whether due
to limitations in memory, checksumming time, or disk space.

For documentation, see doc/ or <http://git-annex.branchable.com/>