Commit graph

42068 commits

Author SHA1 Message Date
Joey Hess
d07a1dbdee
comment about annex.dbdir on relevant bugs 2022-08-12 13:31:27 -04:00
Joey Hess
4cfe17a9e8
use a subdirectory of annex.dbdir
This allows annex.dbdir to be set globally or always set to the same
value when needed. Each repository uses a subdirectory of it.

Sponsored-by: Dartmouth College's Datalad project
2022-08-12 13:18:15 -04:00
Joey Hess
16e82f6cf9
comment 2022-08-12 13:10:54 -04:00
Joey Hess
428af29281
Merge branch 'dbdir' 2022-08-12 13:07:12 -04:00
Joey Hess
a335c1e46e
annex.dbdir fully working
Completes work started in e60766543f

I've verified that all the sqlite databases get stored in annex.dbdir
and are created successfully. If annex.dbdir does not exist, it will be
created; its parent directory must already exist though.

Sponsored-by: Dartmouth College's Datalad project
2022-08-12 13:06:58 -04:00
Joey Hess
23c6e350cb
improve createDirectoryUnder to allow alternate top directories
This should not change the behavior of it, unless there are multiple top
directories, and then it should behave the same as if there was a single
top directory that was actually above the directory to be created.

Sponsored-by: Dartmouth College's Datalad project
2022-08-12 12:52:37 -04:00
Joey Hess
b80ad3a2ad
comment 2022-08-11 17:16:35 -04:00
Joey Hess
e60766543f
add annex.dbdir (WIP)
WIP: This is mostly complete, but there is a problem: createDirectoryUnder
throws an error when annex.dbdir is set to outside the git repo.

annex.dbdir is a workaround for filesystems where sqlite does not work,
due to eg, the filesystem not properly supporting locking.

It's intended to be set before initializing the repository. Changing it
in an existing repository can be done, but would be the same as making a
new repository and moving all the annexed objects into it. While the
databases get recreated from the git-annex branch in that situation, any
information that is in the databases but not stored in the branch gets
lost. It may be that no information ever gets stored in the databases
that cannot be reconstructed from the branch, but I have not verified
that.

Sponsored-by: Dartmouth College's Datalad project
2022-08-11 16:58:53 -04:00
Joey Hess
425deaf615
comment 2022-08-11 13:59:37 -04:00
Joey Hess
0059cb17f6
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-11 13:54:02 -04:00
atrent
e3b6d203c1 2022-08-11 12:45:59 +00:00
Joey Hess
2530012fa3
fix wording 2022-08-10 12:32:49 -04:00
Joey Hess
e9ffffbb8f
close 2022-08-10 12:29:29 -04:00
Atemu
434a1423c0 Added a comment 2022-08-10 12:35:28 +00:00
yarikoptic
bd3c68a57a Added a comment 2022-08-09 19:12:40 +00:00
yarikoptic
7cfab36e10 Added a comment 2022-08-09 18:02:32 +00:00
yarikoptic
dc10e9fdc2 Added a comment 2022-08-09 18:02:08 +00:00
Joey Hess
21cfd0ea98
fix reversion
3a513cfe73 caused a reversion in addurl.
The type of addSmall changed, but the void prevented the type checker
from helping notice this. Since it now returns a CommandPerform, the
cleanup action has to be run.

Sponsored-by: Dartmouth College's Datalad project
2022-08-09 13:49:30 -04:00
Joey Hess
eb2acf5fd7
comment 2022-08-09 13:26:47 -04:00
Joey Hess
4a68abace1
comment 2022-08-09 13:21:58 -04:00
Joey Hess
607c57d66b
comment 2022-08-09 13:06:48 -04:00
Joey Hess
4a5b50fae8
comment 2022-08-09 12:33:24 -04:00
Joey Hess
1d079c33df
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-09 12:27:38 -04:00
Joey Hess
11ca07fe6f
don't force debuglocks flag on in Makefile
Reverts a change accidentially committed in 09edb07ac5

debuglocks is minimal cost, but there is some and this was an accidental
change
2022-08-09 10:43:07 -04:00
Joey Hess
2c1288334d
Avoid running bup join concurrently with bup split
On the bup mailing list, this was hypothesized as also being a
concurrency problem.

Sponsored-by: Svenne Krap on Patreon
2022-08-09 10:40:45 -04:00
yarikoptic
5595d0ef96 initial report on possible regression due to --dry-run 2022-08-09 13:37:39 +00:00
Atemu
50c4632740 Added a comment 2022-08-09 06:22:50 +00:00
Atemu
007d89f3e9 Added a comment 2022-08-09 06:14:05 +00:00
rinomizu5@5ead4c82685c65d7717dbd5591b80425036ae9e3
8adb37a98c Added a comment 2022-08-09 00:33:56 +00:00
Joey Hess
abd417d4fe
Avoid running multiple bup split processes concurrently
Since bup split is not concurrency safe.

Used a lock file so that 2 git-annex processes only run one bup split
between them (per bup repo).

(Concurrent writes from different git-annex repository clones to the same
bup repo could still have concurrency problems.)

Sponsored-by: Noam Kremen on Patreon
2022-08-08 18:54:06 -04:00
Joey Hess
04247fb4d0
avoid surprising "not found" error when copying to a http remote
git-annex copy --to a http remote will of course fail, as that's not
supported. But git-annex copy first checks if the content is already
present in the remote, and that threw a "not found".

Looks to me like other remotes that use Url.checkBoth in their checkPresent
do just return false when it fails. And Url.checkBoth does display
errors when unusual errors occur. So I'm pretty sure removing this error
message is ok.

Sponsored-by: Jarkko Kniivilä on Patreon
2022-08-08 11:57:24 -04:00
Joey Hess
645a66a084
comment 2022-08-08 11:26:25 -04:00
Joey Hess
7a235469e7
comment 2022-08-08 11:23:54 -04:00
Joey Hess
8d3a6ae527
comment 2022-08-08 11:15:04 -04:00
rinomizu5@5ead4c82685c65d7717dbd5591b80425036ae9e3
d4b29293b8 Added a comment: Additional Questions: git annex copy failed 2022-08-08 10:31:26 +00:00
rinomizu5@5ead4c82685c65d7717dbd5591b80425036ae9e3
96794dbd0a Added a comment: Additional Questions: git annex copy failed 2022-08-08 10:31:04 +00:00
aurelia@b44312a63326710de6cea9c43290e5debbd55607
a24ae08142 Added a comment 2022-08-07 10:28:09 +00:00
Atemu
dec58c032c Added a comment 2022-08-07 08:05:24 +00:00
Joey Hess
6d762fafae
idea 2022-08-05 14:54:10 -04:00
Joey Hess
ee73bc7a3c
tag datalad since they have an issue about this 2022-08-05 14:48:21 -04:00
Joey Hess
7ac161395b
comment 2022-08-05 14:10:47 -04:00
Joey Hess
9e66a332b4
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-05 13:57:32 -04:00
Joey Hess
5bc70e2da5
When bup split fails, display its stderr
It seems worth noting here that I emailed bup's author about bup split
being noisy on stderr even with -q in approximately 2011. That never got
fixed. Its current repo on github only accepts pull requests, not bug
reports. Needing to add such complexity to deal with such a longstanding
unfixed issue is not fun.

Sponsored-by: Kevin Mueller on Patreon
2022-08-05 13:57:20 -04:00
Joey Hess
f94908f2a6
improve output when storing to bup
bup split outputs to stderr even with -q. This was discarded when using -J,
but it was still outputting when not using -J, and so was git-annex.

Sponsored-by: Nicholas Golder-Manning on Patreon
2022-08-05 12:29:33 -04:00
yarikoptic
e884d2ed4c Added a comment 2022-08-05 16:17:09 +00:00
Joey Hess
a23fd7349f
work around git segfault
Work around bug in git 2.37 that causes a segfault when when
core.untrackedCache is set, and broke git-annex init.

Depending on when git gets fixed and how widely the buggy versions are
used, this could be reverted quite soon, or need to linger for a long time.
It only makes git-annex init a tiny bit slower in a new repo.

Sponsored-by: Max Thoursie on Patreon
2022-08-04 14:20:57 -04:00
Joey Hess
008204b2f3
explain why this happens and close 2022-08-04 12:39:07 -04:00
Joey Hess
6950e01e2a
Revert "fix link"
This reverts commit 2f671f1d1b.

Didn't work
2022-08-04 12:20:02 -04:00
Joey Hess
2f671f1d1b
fix link 2022-08-04 12:18:49 -04:00
Joey Hess
cd9fd6e28c
fix case of Win32 2022-08-04 12:17:27 -04:00