Commit graph

32065 commits

Author SHA1 Message Date
jgoerzen
3723922e49 2022-09-03 17:29:06 +00:00
Joey Hess
be2c8113b9
add NNCP special remote! 2022-09-02 16:55:36 -04:00
jkniiv
15e9feb1e9 Added a comment: I don't think there is one 2022-09-02 02:04:29 +00:00
yarikoptic
4241c64a8d question about external drive filesystem 2022-09-01 20:50:21 +00:00
yarikoptic
84eda42abe Added a comment: howto importfeed youtube playlists (not entire channels) 2022-09-01 19:26:20 +00:00
yarikoptic
4fd4865493 FTBFS report 2022-08-31 14:47:35 +00:00
yarikoptic
55252d1d4f Added a comment 2022-08-30 19:38:49 +00:00
Joey Hess
b7ff67d176
update 2022-08-30 15:22:06 -04:00
Joey Hess
e1dd689630
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-30 15:20:46 -04:00
Joey Hess
a93163d6f7
optimise linker in linux standalone tarballs
Trick the linker into not doing unncessary work searching for optimised
libraries that are not present, by symlinking the directories where
optimised libs would be to the main lib dir.

This reduces the ENOENT of git-annex init by about 1/2. The linker always
finds the files where it looks first time now. I have not looked at what
the wall clock speedup might be, it's probably rather small.

If a x86-64-v5 comes to be, the list will need to be extended. And there
may be other directories used on some machines that I have missed. Not done
for arm64 yet, or any uncommon architectures.

Sponsored-by: Dartmouth College's Datalad project
2022-08-30 15:20:04 -04:00
Joey Hess
345e60a623
comment 2022-08-30 13:36:53 -04:00
Joey Hess
22f492bea8
comment 2022-08-30 12:50:42 -04:00
DavidD
98e20eb579 Added a comment 2022-08-29 21:19:56 +00:00
yarikoptic
04689aa74d Added a comment 2022-08-29 20:46:12 +00:00
Joey Hess
78440ca37d
move assistant and webapp build-depends into main build-depends
For some reason, cabal 3.4.1.0 builds w/o the assistant and webapp,
even when the flag is explicitly turned on. Moving the build-depends from
inside the if flag section to the main build-depends somehow fixes this.

Since the webapp build deps are thus always available, there is no reason
not to build the webapp when building the assistant. So, got rid of the
webapp build flag. Kept the assistant build flag for now, since building
without it does at least still speed up the build.

Sponsored-by: Brock Spratlen on Patreon
2022-08-29 15:23:49 -04:00
Joey Hess
b99b1c530d
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-29 14:50:04 -04:00
Joey Hess
faefab5e65
add bug and update comment 2022-08-29 14:49:44 -04:00
Ilya_Shlyakhter
8df2e2dbd8 added suggestion for git-annex-import to import symlinks 2022-08-29 18:45:35 +00:00
Joey Hess
248cf6b151
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-29 14:25:39 -04:00
Joey Hess
4c080a20ac
comment 2022-08-29 14:25:30 -04:00
Ilya_Shlyakhter
a1efed2a9c Added a comment: testremote cleanup 2022-08-29 18:09:24 +00:00
Joey Hess
d4fd966396
avoid dup check of guardSafeToUseRepo
Speeds up init slightly, and reduces the number of syscalls by the
dynamic linker.

Sponsored-by: Dartmouth College's Datalad project
2022-08-29 13:52:58 -04:00
Joey Hess
f184dca7de
comment 2022-08-29 13:38:42 -04:00
Joey Hess
f8524d6ecb
comment 2022-08-29 12:45:58 -04:00
Ilya_Shlyakhter
86e0e8fce1 Added a comment: testremote cleanup 2022-08-28 20:15:39 +00:00
Atemu
3cd2a075b9 Added a comment 2022-08-28 17:56:20 +00:00
hoegiflo@befdf51af27be5af346451fe32863dadb1d37ad5
a2ee27851b Added a comment 2022-08-27 21:00:49 +00:00
yarikoptic
ab8ffb406c initial report on libpcre lookups 2022-08-27 00:53:22 +00:00
Ilya_Shlyakhter
609a82c653 Added a comment: copying to S3: partsize/chunking 2022-08-25 17:45:49 +00:00
Atemu
090489832c Added a comment 2022-08-25 16:18:39 +00:00
yarikoptic
3ff0d9ac66 Added a comment 2022-08-24 19:27:00 +00:00
Joey Hess
5e45befa1b
comment 2022-08-24 15:17:43 -04:00
hoegiflo@befdf51af27be5af346451fe32863dadb1d37ad5
b47ea090ca 2022-08-24 18:43:15 +00:00
hoegiflo@befdf51af27be5af346451fe32863dadb1d37ad5
7c4b37a7b1 2022-08-24 18:41:37 +00:00
yarikoptic
9750dd5e21 Added a comment 2022-08-24 18:40:10 +00:00
yarikoptic
8e5b22af2f Added a comment 2022-08-24 18:35:25 +00:00
yarikoptic
26c152bae1 Added a comment 2022-08-24 18:32:53 +00:00
Joey Hess
33083a952a
comment 2022-08-24 13:28:43 -04:00
Joey Hess
ef037b9028
comment 2022-08-24 13:26:42 -04:00
Joey Hess
a124a53fa2
comment 2022-08-24 13:17:56 -04:00
Joey Hess
ea445260ba
comment 2022-08-24 13:13:45 -04:00
Joey Hess
55bf1c6896
comment 2022-08-24 13:05:15 -04:00
yarikoptic
cc64741410 Added a comment 2022-08-24 15:42:10 +00:00
yarikoptic
4344943d64 added "reproducer" 2022-08-24 15:25:33 +00:00
yarikoptic
749593af7d request add --batch to be able to handle directories 2022-08-24 15:12:19 +00:00
Ilya_Shlyakhter
ba5c8cba44 added suggestion to add clean-up after a testremote failure 2022-08-24 14:52:36 +00:00
Ilya_Shlyakhter
cfad39ccb4 added bug report about a cryptic error message when copying to S3 2022-08-24 14:47:16 +00:00
Ilya_Shlyakhter
274ef9db2a Added a comment: imports and symlinks 2022-08-22 20:40:42 +00:00
DavidD
cbc26acd45 Added a comment 2022-08-22 17:54:19 +00:00
Joey Hess
28921af543
remove old closed bugs and todo items to speed up wiki updates and reduce size
Remove closed bugs and todos that were last edited or commented before 2021.

Except for ones tagged projects/* since projects like datalad want to keep
around records of old deleted bugs longer.

Command line used:

    for f in $(grep -l '|done\]\]' -- ./*.mdwn); do if ! grep -q "projects/" "$f"; then d="$(echo "$f" | sed 's/.mdwn$//')"; if [ -z "$(git log --since=01-01-2021 --pretty=oneline -- "$f")" -a -z "$(git log --since=01-01-2021 --pretty=oneline -- "$d")" ]; then git rm -- "./$f" ; git rm -rf "./$d"; fi; fi; done
    for f in $(grep -l '\[\[done\]\]' -- ./*.mdwn); do if ! grep -q "projects/" "$f"; then d="$(echo "$f" | sed 's/.mdwn$//')"; if [ -z "$(git log --since=01-01-2021 --pretty=oneline -- "$f")" -a -z "$(git log --since=01-01-2021 --pretty=oneline -- "$d")" ]; then git rm -- "./$f" ; git rm -rf "./$d"; fi; fi; done
2022-08-22 12:27:10 -04:00
Joey Hess
a9db0a5055
add news item for git-annex 10.20220822 2022-08-22 12:08:24 -04:00
Joey Hess
c13b3aba98
add comment (and other old comment I forgot to add earlier) 2022-08-22 12:01:29 -04:00
Joey Hess
39cdf72bc7
commet 2022-08-22 11:53:18 -04:00
Joey Hess
3ce71cad8c
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-22 11:50:21 -04:00
Ilya_Shlyakhter
9ac72bff2e Added a comment: adding checksums to WORM keys 2022-08-21 21:20:03 +00:00
Ilya_Shlyakhter
fc334a036d Added a comment: addurl and authentication 2022-08-21 21:13:57 +00:00
Yaroslav Halchenko
0151976676
Typo fix unncessary -> unnecessary.
Detected while reading recent CHANGELOG entry but then decided to apply
to entire codebase and docs since why not?
2022-08-20 09:40:19 -04:00
Ilya_Shlyakhter
c25ade4d97 Added a comment: imports and symlinks 2022-08-19 20:19:50 +00:00
DavidD
3150addca6 Added a comment 2022-08-19 20:07:49 +00:00
DavidD
a6cec4c1f9 Added a comment 2022-08-19 19:42:55 +00:00
Joey Hess
f091eff476
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-19 13:45:19 -04:00
Joey Hess
ed39979ac8
import: Avoid following symbolic links inside directories being imported
Too big a footgun.

This does not prevent attackers who can write to the directory being
imported from racing the check. But they can cause anything to be imported
anyway, so would be limited to getting the legacy import to follow into a
directory they do not write to, and move files out of it into the annex.
(The directory special remote does not have that problem since it does not
move files.)

Sponsored-by: Jack Hill on Patreon
2022-08-19 13:31:16 -04:00
Ilya_Shlyakhter
39763ddee7 Added a comment: git-annex-import and symlinks 2022-08-19 17:18:37 +00:00
Joey Hess
4ca8e95773
comment 2022-08-19 13:06:38 -04:00
Joey Hess
bfe75f0517
comment 2022-08-19 12:58:29 -04:00
Joey Hess
e3250bcd78
comment 2022-08-19 12:56:51 -04:00
Joey Hess
94029995fa
fix git-annex add regression on deleted file
Fix a regression in 10.20220624 that caused git-annex add to crash when
there was an unstaged deletion.

Sponsored-by: Dartmouth College's Datalad project
2022-08-19 12:55:49 -04:00
Atemu
15c0cff2da Added a comment 2022-08-19 14:23:27 +00:00
skcin
fb57fd9b96 Added a comment: Option to not follow symlinks? 2022-08-18 15:32:43 +00:00
Atemu
d8eaa91f05 Added a comment 2022-08-18 11:27:12 +00:00
yarikoptic
c80ea222da added datalad project tag to the issue 2022-08-17 19:56:25 +00:00
yarikoptic
3368172a10 Added a comment 2022-08-17 19:55:45 +00:00
DavidD
b5fa75fcf6 Added a comment 2022-08-17 19:03:19 +00:00
yarikoptic
702f6fcb00 initial report on getSymbolicLinkStatus crashing upon file removal 2022-08-17 18:46:27 +00:00
Joey Hess
0d33a7a029
Merge branch 'master' of ssh://git-annex.branchable.com 2022-08-17 13:16:06 -04:00
Joey Hess
b801812660
init: probe if sqlite works
Help the user get annex.dbdir configured when their filesystem is not
one that sqlite works on.

The change in Database.Handle makes an error from sqlite not be ignored
besides being displayed, which it was before. I can't see any reason
git-annex would want to ignore these errors.

I chose to use the fsck database rather than the keys database because
opening the keys database populates it, and see commit
b3c4579c79.

The placement of the call to checkSqliteWorks inside checkInitializeAllowed
avoids annex.uuid getting set before it's called.

Sponsored-by: Dartmouth College's Datalad project
2022-08-17 13:12:26 -04:00
account+annex@806a7c5f67b75d530bced4ea294c77681ebdf766
ec3863e8d4 Added a comment 2022-08-17 16:59:17 +00:00
Joey Hess
fc2d10d2cd
fixed in v10 2022-08-17 12:40:43 -04:00
account+annex@806a7c5f67b75d530bced4ea294c77681ebdf766
c382375d49 2022-08-17 14:28:27 +00:00
Joey Hess
29d7741947
comment 2022-08-16 12:09:12 -04:00
oliv5
3414507cf3 Added a comment 2022-08-16 14:55:44 +00:00
Joey Hess
7286f408fa
close 2022-08-15 14:33:40 -04:00
Joey Hess
7fba5dee61
correct documentation, keyid= only works once
keyid+= can be used to add additional key ids later.

I wonder if this broke with changes to remote configs? But I think it's
always been a map, and so only one keyid can be stored and later ones
overwrite earlier ones.

Sponsored-by: Brett Eisenberg on Patreon
2022-08-15 14:25:13 -04:00
Joey Hess
195f870265
comment 2022-08-15 14:05:05 -04:00
Joey Hess
2fba8ded77
comment 2022-08-15 12:39:19 -04:00
Joey Hess
840bd50390
make it easier to use curl for unusual url schemes
Use curl when annex.security.allowed-url-schemes includes an url scheme not
supported by git-annex internally, as long as
annex.security.allowed-ip-addresses is configured to allow using curl.

Sponsored-by: Luke Shumaker on Patreon
2022-08-15 12:22:13 -04:00
Atemu
2fc9a0096f 2022-08-15 10:50:59 +00:00
DavidD
af60cd2050 2022-08-12 18:33:35 +00:00
Joey Hess
d07a1dbdee
comment about annex.dbdir on relevant bugs 2022-08-12 13:31:27 -04:00
Joey Hess
4cfe17a9e8
use a subdirectory of annex.dbdir
This allows annex.dbdir to be set globally or always set to the same
value when needed. Each repository uses a subdirectory of it.

Sponsored-by: Dartmouth College's Datalad project
2022-08-12 13:18:15 -04:00
Joey Hess
16e82f6cf9
comment 2022-08-12 13:10:54 -04:00
Joey Hess
428af29281
Merge branch 'dbdir' 2022-08-12 13:07:12 -04:00
Joey Hess
a335c1e46e
annex.dbdir fully working
Completes work started in e60766543f

I've verified that all the sqlite databases get stored in annex.dbdir
and are created successfully. If annex.dbdir does not exist, it will be
created; its parent directory must already exist though.

Sponsored-by: Dartmouth College's Datalad project
2022-08-12 13:06:58 -04:00
Joey Hess
b80ad3a2ad
comment 2022-08-11 17:16:35 -04:00
Joey Hess
e60766543f
add annex.dbdir (WIP)
WIP: This is mostly complete, but there is a problem: createDirectoryUnder
throws an error when annex.dbdir is set to outside the git repo.

annex.dbdir is a workaround for filesystems where sqlite does not work,
due to eg, the filesystem not properly supporting locking.

It's intended to be set before initializing the repository. Changing it
in an existing repository can be done, but would be the same as making a
new repository and moving all the annexed objects into it. While the
databases get recreated from the git-annex branch in that situation, any
information that is in the databases but not stored in the branch gets
lost. It may be that no information ever gets stored in the databases
that cannot be reconstructed from the branch, but I have not verified
that.

Sponsored-by: Dartmouth College's Datalad project
2022-08-11 16:58:53 -04:00
Joey Hess
425deaf615
comment 2022-08-11 13:59:37 -04:00
atrent
e3b6d203c1 2022-08-11 12:45:59 +00:00
Joey Hess
e9ffffbb8f
close 2022-08-10 12:29:29 -04:00
Atemu
434a1423c0 Added a comment 2022-08-10 12:35:28 +00:00
yarikoptic
bd3c68a57a Added a comment 2022-08-09 19:12:40 +00:00