Commit graph

10677 commits

Author SHA1 Message Date
Joey Hess
da24034331
comment 2021-06-07 11:53:25 -04:00
Joey Hess
3aabaa1a2b
Merge branch 'master' of ssh://git-annex.branchable.com 2021-06-07 11:47:13 -04:00
Joey Hess
254199edc9
comment 2021-06-07 11:46:47 -04:00
jwodder
8822bf0803 2021-06-07 14:32:25 +00:00
Atemu
234d235a03 rename bugs/delayadd_doesn__39__t_work.mdwn to bugs/delayadd_doesn__39__t_work_with_smallfiles.mdwn 2021-06-06 16:50:40 +00:00
falsifian
f58d686ccf Add bug report 2021-06-05 20:31:39 +00:00
yarikoptic
717000f4f8 Added a comment 2021-06-05 13:50:43 +00:00
yarikoptic
c5e62c1968 Initial report on performance regression 2021-06-05 13:23:13 +00:00
Joey Hess
5b7429e73a
avoid removing old associated file when there is a merge conflict
It makes sense to keep the key used by the old version of an
associated file, until the merge conflict is resolved.

Note that, since in this case git diff is being run with --index, it's
not possible to use -1 or -3, which would let the keys
associated with the new versions of the file also be added. That would
be better, because it's possible that the local modification to the file
that caused the merge conflict has not yet gotten its new key recorded
in the db.

Opened a bug about a case this is thus not able to address.

Sponsored-by: Boyd Stephen Smith Jr. on Patreon
2021-06-01 11:43:00 -04:00
Joey Hess
f00e365f41
comments 2021-05-31 17:54:17 -04:00
Atemu
1b6715b4ca Added a comment 2021-05-31 19:07:31 +00:00
Ilya_Shlyakhter
9dbf93b9c5 Added a comment: clarifying preferred content expressions 2021-05-30 19:40:51 +00:00
Joey Hess
cd73fcc92c
Merge branch 'master' of ssh://git-annex.branchable.com 2021-05-25 11:45:02 -04:00
Joey Hess
483fc4dc6b
Merge branch 'trackassociated' 2021-05-25 11:43:52 -04:00
Joey Hess
01331f0b8f
required content update 2021-05-25 10:04:29 -04:00
Joey Hess
45c0fb29f0
update 2021-05-25 09:58:46 -04:00
Atemu
82ee0f053b Added a comment 2021-05-25 11:00:39 +00:00
Joey Hess
9a5981a153
comment 2021-05-24 16:43:06 -04:00
Joey Hess
125a28c58e
Merge branch 'master' of ssh://git-annex.branchable.com 2021-05-24 16:31:58 -04:00
Joey Hess
07c98a4ce2
update 2021-05-24 16:31:14 -04:00
Joey Hess
63de81b52a
Merge branch 'master' into trackassociated 2021-05-24 16:27:24 -04:00
Joey Hess
2de49c186f
update 2021-05-24 16:27:07 -04:00
Joey Hess
44a0d21e57
Merge branch 'master' into trackassociated 2021-05-24 16:24:53 -04:00
Joey Hess
a56b151f90
fix longstanding indeterminite preferred content for duplicated file problem
* drop: When two files have the same content, and a preferred content
  expression matches one but not the other, do not drop the file.
* sync --content, assistant: Fix an edge case where a file that is not
  preferred content did not get dropped.

The sync --content edge case is that handleDropsFrom loaded associated files
and used them without verifying that the information from the database was
not stale.

It seemed best to avoid changing --want-drop's behavior, this way when
debugging a preferred content expression with it, the files matched will
still reflect the expression. So added a note to the --want-drop documentation,
to make clear it may not behave identically to git-annex drop --auto.

While it would be possible to introspect the preferred content
expression to see if it matches on filenames, and only look up the
associated files when it does, it's generally fairly rare for 2 files to
have the same content, and the database lookup is already avoided when
there's only 1 file, so I did not implement that further optimisation.

Note that there are still some situations where the associated files
database does not get locked files recorded in it, which will prevent
this fix from working.

Sponsored-by: Dartmouth College's Datalad project
2021-05-24 14:07:05 -04:00
Joey Hess
c1b5028211
update 2021-05-24 11:59:01 -04:00
Ilya_Shlyakhter
bcedcef97f Added a comment: defining preferred content state 2021-05-23 20:39:23 +00:00
Atemu
3eb6a3b05f Added a comment 2021-05-22 17:31:01 +00:00
Lukey
be6bf5ba35 Added a comment 2021-05-22 17:19:19 +00:00
Atemu
8daca82623 Added a comment 2021-05-22 17:02:07 +00:00
Atemu
21fba1cdb8 Added a comment 2021-05-22 10:20:35 +00:00
Atemu
0b89436b47 Added a comment 2021-05-22 09:55:31 +00:00
Joey Hess
b81f5532c6
comment 2021-05-21 16:44:44 -04:00
Joey Hess
df0b75cdc4
complications 2021-05-21 14:18:38 -04:00
Joey Hess
1d9bad51d2
plan for these 2021-05-21 13:50:26 -04:00
Joey Hess
f39b7c3663
comment 2021-05-21 12:39:35 -04:00
Joey Hess
414dc39a12
comment 2021-05-21 11:31:38 -04:00
Joey Hess
9dbbecc8f4
Merge branch 'master' of ssh://git-annex.branchable.com 2021-05-21 11:28:17 -04:00
Joey Hess
5393c0ae58
reopen per comment 2021-05-21 11:27:13 -04:00
Atemu
e9e3cc015e Added a comment 2021-05-19 16:54:19 +00:00
Joey Hess
84366fa2d0
fix by improving docs 2021-05-19 11:13:53 -04:00
Atemu
48314f625f Added a comment 2021-05-18 16:23:09 +00:00
Atemu
4a76ba8761 Forgot the assistant needed for repro 2021-05-18 16:16:56 +00:00
Atemu
828a5922df Added a comment 2021-05-18 09:13:32 +00:00
Atemu
b4b6977cab Added a comment 2021-05-16 11:37:25 +00:00
Atemu
944b132103 2021-05-16 11:05:15 +00:00
Atemu
54db5df937 Added a comment 2021-05-16 10:27:47 +00:00
Joey Hess
947d2a10bc
assistant: Fix a crash on startup by avoiding using forkProcess
ghc 8.8.4 seems to have changed something that broke code that has been
successfully using forkProcess since 2012. Likely a change to GC internals.

Since forkProcess has never had clear documentation about how to
use it safely, avoid using it at all. Instead, when git-annex needs to
daemonize itself, re-run the git-annex command, in a new process group
and session.

This commit was sponsored by Luke Shumaker on Patreon.
2021-05-12 15:08:03 -04:00
Joey Hess
ba7598dbab
comment 2021-05-12 13:39:15 -04:00
Joey Hess
7e2fda5307
comment 2021-05-12 11:37:36 -04:00
Joey Hess
afdc201d1c
comment 2021-05-12 11:24:55 -04:00
Atemu
9e8e747654 Added a comment 2021-05-12 14:17:06 +00:00
Lukey
20af8b311a 2021-05-11 11:22:31 +00:00
Lukey
27b98f6f0d Added a comment 2021-05-11 10:28:12 +00:00
Lukey
add38774d1 Added a comment 2021-05-11 09:21:38 +00:00
Lukey
61a3a7e0c3 Added a comment 2021-05-11 08:50:36 +00:00
Lukey
810fe88d5a Added a comment 2021-05-11 08:41:42 +00:00
Lukey
06e167291d Added a comment 2021-05-11 07:37:08 +00:00
Joey Hess
72a8bbce12
Revert "smudge: check for known annexed inodes before checking annex.largefiles"
This reverts commit 424bef6b6f.

This commit caused other buggy behavior unfortunately.
2021-05-10 12:20:13 -04:00
Joey Hess
c88fdd91f9
comment and close 2021-05-10 11:04:50 -04:00
Joey Hess
0ab9d0dfad
comment 2021-05-10 10:37:28 -04:00
Atemu
f0b553a25a 2021-05-10 10:53:12 +00:00
Atemu
3dc9833d53 2021-05-10 10:26:45 +00:00
Joey Hess
e53bd0c6c0
user error, not a bug 2021-05-09 20:58:35 -04:00
Joey Hess
a8e8ad95a2
bug report 2021-05-09 20:55:07 -04:00
kyle
5a5ef1c869 Added a comment: thanks 2021-05-07 18:07:24 +00:00
Joey Hess
921753ac44
reinject: Error out when run on a file that is not annexed
rather than silently skipping it
2021-05-07 13:31:03 -04:00
Joey Hess
6b980c1514
comment 2021-05-07 13:13:48 -04:00
Joey Hess
eaea173bc2
applied patch 2021-05-07 11:11:10 -04:00
kyle
cc36fd261e reinject: silent failure with absolute path to pointer file 2021-05-06 19:26:52 +00:00
kyle
06e996efad patch: fromkey: create directory for pointer files too 2021-05-06 15:23:07 +00:00
pat
da5598da21 2021-05-05 19:06:19 +00:00
pat
5bb85d76d8 2021-05-05 02:51:47 +00:00
kyle
8f0ddf0925 git-commit pathspec change due to 424bef6b6 2021-05-04 21:43:41 +00:00
Joey Hess
f2876804ca
close 2021-05-03 12:24:06 -04:00
Joey Hess
1be7be6976
Merge branch 'master' of ssh://git-annex.branchable.com 2021-05-03 12:12:07 -04:00
ijc@c69abafeb65fa2e784811fc549e9976a5cf4b903
d9da6d6505 Added a comment 2021-05-03 15:45:14 +00:00
Joey Hess
4588668a12
fromkey unlocked files support
fromkey: Create an unlocked file when used in an adjusted branch where the
file should be unlocked, or when configured by annex.addunlocked.

There is some overlap with code in Annex.Ingest, however it's not quite the
same because ingesting has a temp file with the content, where here the
content, if any, is in the annex object file. So it eg, makes sense for
Annex.Ingest to copy the execute mode of the content file, but it does not make
sense for fromkey to do that.

Also changed in passing to stage the file in git directly, rather than
using git add. One consequence of that is that if the file is gitignored,
it will still get added, rather than the old behavior:

The following paths are ignored by one of your .gitignore files:
ignored
hint: Use -f if you really want to add them.
hint: Turn this message off by running
hint: "git config advice.addIgnoredFile false"
git-annex: user error (xargs ["-0","git","--git-dir=.git","--work-tree=.","--literal-pathspecs","add","--"] exited 123)

That old behavior was a surprise to me, and so I consider it a bug, and doubt
anyone would have relied on it.

Note that, when on an --hide-missing branch, it is possible to fromkey a key
that is not present (needs --force). The annex link or pointer file still gets
written in this case. It doesn't seem to make any sense not to write it,
because then fromkey would not do anything useful in this case, and this way
the file can be committed and synced to master, and the branch re-adjusted to
hide the new missing file.

This commit was sponsored by Noam Kremen on Patreon.
2021-05-03 11:26:18 -04:00
Lukey
c9db4b2a47 2021-05-03 13:01:54 +00:00
Lukey
046f872ab1 Added a comment 2021-05-03 12:12:18 +00:00
Lukey
0e4f453b90 Added a comment 2021-05-03 10:26:35 +00:00
Lukey
dc6dd1e401 Added a comment 2021-05-02 18:46:34 +00:00
ijc@c69abafeb65fa2e784811fc549e9976a5cf4b903
b2c706634e Added a comment 2021-05-02 17:54:56 +00:00
datamanager
1fb59a63a3 Added a comment: I think I am having the same issue 2021-04-28 01:19:46 +00:00
Joey Hess
63af1bae8d
Merge branch 'master' of ssh://git-annex.branchable.com 2021-04-27 18:12:19 -04:00
Joey Hess
4ea03c7b82
close
test case ran for over an hour successfully
2021-04-27 18:11:29 -04:00
Joey Hess
0f73b6d03a
Avoid more than 1 gpg password prompt at the same time
Which could happen occasionally before when concurrency is enabled.
While not much of a problem when it did happen, better to avoid it. Also,
since it seems likely the gpg-agent sometimes fails in such a situation,
this makes it not happen when running a single git-annex command with
concurrency enabled.

This commit was sponsored by Jake Vosloo on Patreon.
2021-04-27 16:36:44 -04:00
Joey Hess
42cacb4099
reproduced, some analysis of a gpg bug
This commit was sponsored by Graham Spencer on Patreon.
2021-04-27 16:31:37 -04:00
pat
46bcb29b3c Added a comment 2021-04-27 18:34:30 +00:00
Joey Hess
a166d2520b
check mincopies is satisfied even when numcopies is known to be satisfied
I had been assuming that numcopies would be a larger or at most equal to
mincopies, so no need to check both. But users get confused and use configs
that don't really make sense, so make sure to handle mincopies being larger
than numcopies.

Also add something to the mincopies man page to discourage this
misconfiguration.

This commit was sponsored by Denis Dzyubenko on Patreon.
2021-04-27 13:37:18 -04:00
Joey Hess
f58fb5a610
comment 2021-04-27 12:24:36 -04:00
Joey Hess
d3e49b210a
git-annex-config: Allow setting annex.securehashesonly
Which has otherwise been supported since 2019, but was missing from the
list of allowed repo-global configs.

Reordered the list to match the order in the git-annex-config man page, to
make them easy to cross-compare.

This commit was sponsored by Boyd Stephen Smith Jr. on Patreon.
2021-04-26 13:50:37 -04:00
Joey Hess
28f5f7515c
response and close 2021-04-26 13:34:00 -04:00
ntraut9@6c7c5e5bfddb591c28ab8222f1de9cb56840a69e
5f13b26e63 Added a comment 2021-04-26 16:40:15 +00:00
ntraut9@6c7c5e5bfddb591c28ab8222f1de9cb56840a69e
75bd8462c5 Added a comment 2021-04-26 16:01:02 +00:00
https://launchpad.net/~r0lf
5738756254 Added a comment 2021-04-26 13:05:15 +00:00
https://launchpad.net/~r0lf
369de4d20e removed 2021-04-26 13:03:46 +00:00
https://launchpad.net/~r0lf
4f24df2150 Added a comment 2021-04-26 13:03:20 +00:00
https://launchpad.net/~r0lf
08a8dc25d6 Added a comment 2021-04-26 12:22:43 +00:00
https://launchpad.net/~r0lf
becf1dcfe6 2021-04-26 11:58:13 +00:00
felix.hagemann@b76e9ea0928cf33dacffc37ec3dbecf33171a8a5
df77e3d56b Added a comment: Still happening 2021-04-25 16:20:05 +00:00
Lukey
ac3e1c5972 Added a comment 2021-04-25 11:53:29 +00:00
ijc@c69abafeb65fa2e784811fc549e9976a5cf4b903
414d3325ea 2021-04-25 10:15:28 +00:00
Ilya_Shlyakhter
4688c7bc18 Added a comment: sparse checkouts to hide non-present files 2021-04-24 22:00:14 +00:00
https://launchpad.net/~r0lf
1b19140488 Added a comment: try to find a better solution 2021-04-24 11:03:28 +00:00
https://launchpad.net/~r0lf
facc70580d removed 2021-04-24 10:41:15 +00:00
https://launchpad.net/~r0lf
cd053a2d47 Added a comment: try to find a better solution 2021-04-24 10:40:18 +00:00
https://launchpad.net/~r0lf
41a42c5f0e removed 2021-04-24 10:39:21 +00:00
https://launchpad.net/~r0lf
4f8ae886d2 Added a comment 2021-04-24 10:38:37 +00:00
https://launchpad.net/~r0lf
43177539e7 2021-04-24 10:17:46 +00:00
Joey Hess
da0a696c96
Revert "reorder another test"
This reverts commit 3e63f00f63.
2021-04-23 01:01:29 -04:00
Joey Hess
bb4f2af602
windows needs to die 2021-04-23 00:38:18 -04:00
Joey Hess
e623b0fd87
close old bug 2021-04-23 00:25:22 -04:00
Joey Hess
3e63f00f63
reorder another test
continuing to try to narrow down cause of failure on windows
2021-04-22 10:03:35 -04:00
Joey Hess
653b719472
fix --all to include not yet committed files from the journal
Fix bug caused by recent optimisations that could make git-annex not see
recently recorded status information when configured with
annex.alwayscommit=false.

This does mean that --all can end up processing the same key more than once,
but before the optimisations that introduced this bug, it used to also behave
that way. So I didn't try to fix that; it's an edge case and anyway git-annex
behaves well when run on the same key repeatedly.

I am not too happy with the use of a MVar to buffer the list of files in the
journal. I guess it doesn't defeat lazy streaming of the list, if that
list is actually generated lazily, and anyway the size of the journal is
normally capped and small, so if configs are changed to make it huge and
this code path fire, git-annex using enough memory to buffer it all is not a
large problem.
2021-04-21 15:40:32 -04:00
Joey Hess
b470673e50
wip 2021-04-21 13:46:39 -04:00
Joey Hess
56478e99ac
bug report 2021-04-21 13:24:32 -04:00
Joey Hess
39d94919cd
reorder tests debugging windows failure
This order will work just as well, so no need to revert this change
later.
2021-04-21 13:01:41 -04:00
Joey Hess
430c5a15f5
update 2021-04-21 12:18:04 -04:00
Joey Hess
85d75b8a18
comment 2021-04-21 12:15:42 -04:00
Joey Hess
752c389849
comment 2021-04-20 11:57:10 -04:00
Joey Hess
fee6504388
fix reversion in recent CoW changes
File handle accidentially left open is both a FD leak and causes the
haskell RTS to reject opening it again with "file is locked".
2021-04-20 11:41:43 -04:00
https://launchpad.net/~r0lf
fa738b8757 2021-04-20 13:49:58 +00:00
https://launchpad.net/~r0lf
617c574c17 2021-04-20 13:46:07 +00:00
Ilya_Shlyakhter
38b9cf7747 Added a comment 2021-04-19 15:38:38 +00:00
yarikoptic
b92a7b1a2f initial report for test fails on windows 2021-04-19 13:43:18 +00:00
pat
e3de27dcc0 2021-04-19 00:09:16 +00:00
Ilya_Shlyakhter
a9bf898e2c removed 2021-04-18 22:03:26 +00:00
Ilya_Shlyakhter
a9eac5c91a Added a comment: semantics of preferred content expressions 2021-04-18 22:03:02 +00:00
pat
081fb751b9 2021-04-18 01:12:07 +00:00
pat
4ae46a6cc7 removed 2021-04-18 00:40:44 +00:00
pat
6bd49887e6 rename forum/Drop_doesn__39__t_respect_mincopies.mdwn to bugs/Drop_doesn__39__t_respect_mincopies.mdwn 2021-04-18 00:39:11 +00:00
Ilya_Shlyakhter
5c15deab0e Added a comment 2021-04-17 22:54:45 +00:00
Ilya_Shlyakhter
a4ebd33074 Added a comment 2021-04-17 22:54:34 +00:00
Ilya_Shlyakhter
0a4614b653 Added a comment: updating the keys database incrementally 2021-04-17 22:23:45 +00:00
Joey Hess
f6933c95cf
comment 2021-04-16 13:54:50 -04:00
yarikoptic
75bd75def2 reporting fresh test fails 2021-04-15 13:04:18 +00:00
Joey Hess
e1a9b79fa6
fix hardcoded origin name in checkAdjustedClone
init: Fix a crash when the repo's was cloned from a repo that had an
adjusted branch checked out, and the origin remote is not named "origin".

The only other hardcoding of the name of origin is in:

- Upgrade.V2, which can be ignored probably
- Annex.Branch, which doesn't fail if it has some other name, but just
  doesn't set up the git-annex branch with quite as linear a history in
  that case.
2021-04-14 18:53:27 -04:00
kyle
4c3d8241ae crippledfilesystem override not needed 2021-04-14 21:26:32 +00:00
kyle
c489b471d5 bug: init crash with remote name other than "origin" 2021-04-14 20:44:23 +00:00
Joey Hess
8e7dc958d2
forget: Preserve currently exported trees
Avoiding problems with exporttree remotes in some unusual circumstances.

This commit was sponsored by Brett Eisenberg on Patreon.
2021-04-13 15:00:23 -04:00
Joey Hess
a58e955293
bug report 2021-04-13 13:31:51 -04:00
Joey Hess
805d325a8d
diffdriver: Support unlocked files 2021-04-08 14:32:09 -04:00
yarikoptic
e1ffa3e10a note on the order 2021-04-08 17:47:22 +00:00
yarikoptic
8f0a3799d0 initial report on diff driver behavior on unlocked files 2021-04-08 17:44:39 +00:00
https://launchpad.net/~r0lf
10c04ed3b1 Added a comment: still an issue in Ubuntu Focal 2021-04-05 01:28:49 +00:00
https://launchpad.net/~r0lf
507b0fa6ea removed 2021-04-05 01:22:24 +00:00
https://launchpad.net/~r0lf
ed30ba4397 Added a comment: still an issue in focal 2021-04-05 01:20:30 +00:00
Joey Hess
370e71aa73
improve man page wording 2021-04-01 12:58:06 -04:00
Joey Hess
8868a3a4c7
Fix build with persistent-2.12.0.1
persistent stopped using askLogFunc, and the thing to use is askLoggerIO
from monad-logger. Bumped the dep to the first version that contained that.

Note that the i386ancient build uses a newer monad-logger than 0.3.10,
so the new versioned dep should not break it, and presumably nothing else
either.

This commit was sponsored by Noam Kremen on Patreon.
2021-04-01 12:21:02 -04:00
nrg@bd619d1ebf16e6324c546adea8be8fe1cc2b4325
3b1088a865 2021-03-31 14:43:28 +00:00