Commit graph

10111 commits

Author SHA1 Message Date
yarikoptic
a8605422b9 initial report on a failing test 2020-10-26 15:02:49 +00:00
nix.zahlen@1211ac6c964ba2d68b70655f747bef1383032e77
f861ce399e Added a comment: where to trace the Windows build errors? 2020-10-25 15:23:01 +00:00
achilleas.k@14be77d42a1252fab5ec9dbf4e5ea03c5833e8c8
65c1687430 Added a comment 2020-10-24 14:39:39 +00:00
yarikoptic
def62b49f0 Added a comment 2020-10-24 12:26:02 +00:00
yarikoptic
3be4731315 Added a comment 2020-10-24 01:21:09 +00:00
Joey Hess
b2bf099aa3
use removeDirGeneric here too for consistency
And because it might be more robust on windows.
2020-10-23 16:12:47 -04:00
Joey Hess
a108b00b33
testremote: Display exceptions when tests fail, to aid debugging 2020-10-23 15:41:57 -04:00
Joey Hess
681313dfd4
deal with .git pointer file in Git.CurrentRepo
This fixes the bug.

Note, it's only done when GIT_DIR is set. When it's not set,
Git.Construct already handled it. This is why it was only noticed with this
git submodule command.

This commit was sponsored by Brett Eisenberg on Patreon.
2020-10-23 14:56:12 -04:00
Joey Hess
893d7b21e8
comment 2020-10-23 14:21:29 -04:00
Joey Hess
f92b0ef109
analysis 2020-10-23 14:08:06 -04:00
Joey Hess
eece011b00
close 2020-10-23 13:58:40 -04:00
Joey Hess
966dbb518e
Merge remote-tracking branch 'origin/master' 2020-10-23 13:09:41 -04:00
Joey Hess
cb6cf20b9a
analysis 2020-10-23 13:00:55 -04:00
rshalaev@3e2130a1e3cb0aaff7dd80aba7548ad9be0ea2d4
b91845ec5d Added a comment 2020-10-23 16:51:04 +00:00
Joey Hess
0736383e98
Fix bug that prevented linux standalone bundle from working on a fresh install
Bug was introduced in version 8.20201007, lost a necessary mkdir.

This commit was sponsored by Noam Kremen on Patreon.
2020-10-23 12:19:40 -04:00
rshalaev@3e2130a1e3cb0aaff7dd80aba7548ad9be0ea2d4
990ed1055a Added a comment 2020-10-23 02:00:09 +00:00
rshalaev@3e2130a1e3cb0aaff7dd80aba7548ad9be0ea2d4
83a718dff2 2020-10-23 01:53:33 +00:00
yarikoptic
1c242ca5fd initial report on a failing test on windows about storeKey when already present 2020-10-23 01:49:02 +00:00
Joey Hess
4d063f12c6
turns out this was fixed in 2014 2020-10-22 19:54:26 -04:00
Joey Hess
2f96e15eda
Merge branch 'master' of ssh://git-annex.branchable.com 2020-10-22 19:24:38 -04:00
Joey Hess
9ed32ce62b
urk 2020-10-22 19:23:48 -04:00
jwodder
731a982f1b Added a comment 2020-10-22 18:13:40 +00:00
Joey Hess
577af1b679
rename to avoid windows stupididy about legal filenames 2020-10-22 13:58:20 -04:00
Joey Hess
8f3d34da30
add 2020-10-22 13:55:47 -04:00
Joey Hess
5941737074
add 2020-10-22 13:55:41 -04:00
Joey Hess
b62e004c2c
update chunk log after speculated chunks are verified to be present
Only done in checkPresentChunks, although retrieveChunks could also do
it. Does not seem necessary though, because git-annex never retrives
content without first checking if it's present AFAICR. And really this will
only be needed when using fsck. Puttting it here, rather than in fsck
avoids breaking an abstraction boundary, and is nice and inexpensive.
2020-10-22 13:37:09 -04:00
Joey Hess
dad4be97c2
speculatively use remote's configured chunk size as a fallback
When a special remote has chunking enabled, but no chunk sizes are
recorded (or the recorded ones are not found), speculatively try chunks
using the configured chunk size.

This makes eg, git-annex fsck --from remote be able to fix up the
location log of a file that the git-annex branch does not indicate is
stored on the remote.

Note that fsck does *not* fix up the chunk log to indicate the chunk
size. So, changing the chunk config of the remote after that will still
prevent accessing the chunks stored on it. Maybe fsck should, but I
wanted to start with this and see if it's needed.
2020-10-22 13:11:06 -04:00
Joey Hess
b3345eb4ab
close 2020-10-22 12:03:13 -04:00
nix.zahlen@1211ac6c964ba2d68b70655f747bef1383032e77
a9cec7a810 2020-10-21 20:44:23 +00:00
achilleas.k@14be77d42a1252fab5ec9dbf4e5ea03c5833e8c8
9f69a68ed7 removed 2020-10-21 07:51:58 +00:00
achilleas.k@14be77d42a1252fab5ec9dbf4e5ea03c5833e8c8
fd30262fb3 Added a comment 2020-10-21 07:51:37 +00:00
achilleas.k@14be77d42a1252fab5ec9dbf4e5ea03c5833e8c8
bdc7f63c21 Added a comment 2020-10-21 07:51:13 +00:00
yarikoptic
8f261113f3 report/idea on minting chunked keys to try from special remote 2020-10-20 23:31:22 +00:00
yarikoptic
fa686784f1 Added a comment 2020-10-20 16:39:15 +00:00
kyle
7c78321770 Added a comment 2020-10-20 15:59:26 +00:00
achilleas
fb2bd67f76 New bug report 2020-10-20 12:51:55 +00:00
yarikoptic
b6f70c2876 Added a comment 2020-10-20 12:33:29 +00:00
yarikoptic
1a5fc2667f Added a comment 2020-10-20 12:29:19 +00:00
Joey Hess
7036d0a4c1
add, import: Fix a reversion in 7.20191009 that broke handling of --largerthan and --smallerthan
This commit was sponsored by Jochen Bartl on Patreon.
2020-10-19 15:36:18 -04:00
Joey Hess
b390a4012c
bug 2020-10-19 15:24:38 -04:00
Joey Hess
b2c5c99506
comment 2020-10-19 13:12:07 -04:00
Joey Hess
f1398a1a92
comment 2020-10-19 13:04:03 -04:00
Joey Hess
bdb6d8581c
comment 2020-10-19 12:37:40 -04:00
yarikoptic
4f45051a2f Added a comment 2020-10-16 01:50:39 +00:00
yarikoptic
9910b8a513 Added a comment 2020-10-16 01:29:23 +00:00
yarikoptic
361b9d719a initial report 2020-10-15 16:43:06 +00:00
Joey Hess
53fe434498
close as notabug 2020-10-12 14:50:38 -04:00
yarikoptic
9677814e5d Added a comment 2020-10-12 16:00:32 +00:00
Joey Hess
5157dd8370
comment 2020-10-12 11:41:58 -04:00
Joey Hess
842fc46ee2
Merge branch 'master' of ssh://git-annex.branchable.com into master 2020-10-12 11:35:40 -04:00
yarikoptic
89396bb710 Added a comment 2020-10-11 13:51:28 +00:00
Joey Hess
c1bfaf29e4
comment 2020-10-09 20:24:56 -04:00
Joey Hess
1be229c6ae
this was closed a long time ago, but a rename made it re-appear 2020-10-08 14:36:36 -04:00
Joey Hess
d54dd0ef9c
Fix build on Windows with network-3
inet_addr was removed, but all this needs is localhost, so hardcoding it
should work fine.

It may be that this windows ifdef is no longer needed. It was added in 2013
with a note that getAddrInfo didn't work on windows, but it seems likely
such a problem would have been fixed since.
2020-10-08 10:50:39 -04:00
jwodder
d4cb2e044b 2020-10-08 13:02:20 +00:00
jwodder
37f13dfd58 Added a comment 2020-10-08 12:44:52 +00:00
Joey Hess
2d5036e440
renamed some filenames to not end with a period
Windows does not allow such filenames, which prevented cloning git-annex
on windows.
2020-10-07 12:12:53 -04:00
Joey Hess
20f86e43f7
Fix a build failure on Windows. 2020-10-07 12:04:54 -04:00
git-annex.branchable@f45632a8044327f7993eb5b462c37b76ae48cb10
8c6f21c348 2020-10-07 15:01:06 +00:00
git-annex.branchable@f45632a8044327f7993eb5b462c37b76ae48cb10
20c7e6cf94 2020-10-06 19:19:44 +00:00
Joey Hess
995607b6db
response 2020-10-06 10:54:10 -04:00
Joey Hess
a10f2616c4
close 2020-10-06 10:24:09 -04:00
yarikoptic
95d02d6e29 Added a comment 2020-10-06 01:27:01 +00:00
yarikoptic
b98d601bfb Added a comment: FTR 2020-10-06 00:04:38 +00:00
yarikoptic
ed7a0c9956 Added a comment: just comments 2020-10-05 23:11:32 +00:00
Joey Hess
2daa28c05f
comment 2020-10-05 15:19:48 -04:00
Joey Hess
2c68c60961
comment 2020-10-05 14:38:29 -04:00
Joey Hess
36ebcd94aa
fix confirmed 2020-10-05 14:36:36 -04:00
Joey Hess
f0ec725234
include buildid in LOCPATH
This avoids the possibility that the bundle could be updated in place,
leading to LOCPATH existing but containing locales for the old version,
which needed to be tested for with code that was not race-free.

LOCPATH/buildid is still written and checked when cleaning up stale caches.
That is not actually necessary, except old versions of the standalone
bundle expect to see it, and this prevents them cleaning up the locale
cache of a new version. And still checking it prevents the new version
cleaning up the locale cache of the old version while the old version is
still in use.

Added explicit tests before creating LOCPATH and the base and buildid files.

The buildid file no longer needs to be updated every time, because it's
stable for the given LOCPATH directory.

And the base file actually did not need to be updated every time,
because the LOCPATH is derived from base, so if the bundle is moved
elsewhere, a different LOCPATH will be used.

Transitioning to this will mean that two git-annex builds that otherwise
have the same buildid -- the same git-annex md5sum -- will use different
LOCPATH values, but that's handled fine by the cache cleanup code, so at
most it will mean one extra generation of the locale files.
2020-10-05 14:04:49 -04:00
Joey Hess
9e12e4c419
comment 2020-10-05 12:57:16 -04:00
Joey Hess
cd9a60bc7d
runshell: Fix a edge case where rm errors were sent to stdout, which could confuse things parsing git-annex output. 2020-10-05 12:44:40 -04:00
Ilya_Shlyakhter
574d7a7cce Added a comment: standalone build 2020-10-04 15:45:16 +00:00
yarikoptic
77dab95e69 Initial report on hanging batched processes 2020-10-03 04:04:28 +00:00
yarikoptic
3be96e60b0 initial report on rm failing to remove cache/locales 2020-10-03 03:52:33 +00:00
Joey Hess
084b502c7a
httpalso: Support being used with special remotes that do not have encryption= in their config. 2020-09-29 13:56:27 -04:00
Joey Hess
b2cf284d2a
upgrade: Avoid an upgrade failure of a bare repo in unusual circumstances 2020-09-29 13:45:14 -04:00
Joey Hess
aa06c69a6f
close 2020-09-29 13:26:48 -04:00
rto@914936d87a43105f8c5df5ae4787140e7eb5d846
42bd4f1110 2020-09-29 16:51:49 +00:00
mark@6b90344cdab3158eacb94a3944460d138afc9bef
26842956b5 Added a comment 2020-09-28 21:40:23 +00:00
mark@6b90344cdab3158eacb94a3944460d138afc9bef
a8e4539d15 Added a comment 2020-09-28 21:10:58 +00:00
mark@6b90344cdab3158eacb94a3944460d138afc9bef
32cd9a44ca 2020-09-28 21:09:27 +00:00
yarikoptic
67144b1c46 Added a comment 2020-09-28 19:44:08 +00:00
Joey Hess
1aec0fc6b9
close as unreproducible 2020-09-28 10:13:15 -04:00
Joey Hess
933097b327
moreinfo 2020-09-28 10:11:24 -04:00
Joey Hess
f324cfa9e7
close 2020-09-28 10:04:38 -04:00
Joey Hess
c2d1d4e16e
close this
phibs who was seeing hangs confirmed they're gone on irc
2020-09-24 16:51:30 -04:00
Joey Hess
922621301a
Serialize use of C magic library, which is not thread safe.
This fixes failures uploading to S3 when using -J.

This commit was sponsored by Denis Dzyubenko on Patreon.
2020-09-17 17:27:42 -04:00
Joey Hess
59f5d6509c
comment 2020-09-17 17:19:58 -04:00
Joey Hess
d293c0bced
improve this comment 2020-09-17 17:19:45 -04:00
https://christian.amsuess.com/chrysn
b301a64aa2 Added a comment: Re: comment 1 2020-09-17 20:42:12 +00:00
Joey Hess
f2cdacdb68
reproduced, some tcpdump analysis 2020-09-17 16:23:29 -04:00
Joey Hess
16c05c176c
comment 2020-09-17 14:26:16 -04:00
https://christian.amsuess.com/chrysn
7749b2278b Added a comment: update 2020-09-17 14:57:54 +00:00
https://christian.amsuess.com/chrysn
0d8f6e70f5 document bug i ran into early while exploring httpalso 2020-09-17 14:43:49 +00:00
Joey Hess
a5d5935c0e
few more details 2020-09-14 20:00:54 -04:00
Joey Hess
ad9bb120f0
info gathered from irc 2020-09-14 19:52:49 -04:00
Joey Hess
c87f73f638
point to commit that may fix this 2020-09-14 18:30:41 -04:00
Joey Hess
e26960752c
close as dup 2020-09-14 17:19:10 -04:00
Joey Hess
519aba2beb
close as dup 2020-09-14 17:15:54 -04:00
yarikoptic
175fe50a65 initial report on the stuck test on osx 2020-09-11 02:18:21 +00:00
Joey Hess
54404370e5
followup 2020-09-08 12:17:08 -04:00
Joey Hess
62372ee052
resolvemerge: Improve cleanup of cruft left in the working tree by a conflicted merge
This commit was sponsored by Jake Vosloo on Patreon.
2020-09-07 16:50:27 -04:00
Joey Hess
03dee56546
revert change that broke test suite
Opened a new bug about it.

This commit was sponsored by Ethan Aubin.
2020-09-07 15:42:38 -04:00
Joey Hess
d120c73302
sync, assistant: When merge.directoryRenames is not set, default it it to "false"
Works better with automatic merge conflict resolution than git's ususual
default of "conflict".

This is not done when automatic merge conflict resolution is disabled.

This commit was sponsored by Mark Reidenbach on Patreon.
2020-09-07 13:50:58 -04:00
Joey Hess
69053a93a2
resolvemerge: Improve cleanup of files that were deleted by one side of a conflicted merge, and modified by the other side
This case was handled by cleanConflictCruft, but only when the annexed
file's object was present. When not present, it left the annexed file
with the original name, not checked into git, while adding the variant
file. So, add an explicit deletion of the deleted file in this case.

My specific case where this happened actually involves
merge.directoryRenames=conflict. After a merge involving that,
the situation was the file appears as "added by them", because that
caused the file that they added to be moved into a directory we renamed.

That case is the same as them adding a modified version of the file,
while we deleted it. (Except for the history of the file, since it's a
new file, but this doesn't look at history.)

This commit was sponsored by Boyd Stephen Smith Jr. on Patreon.
2020-09-07 12:25:57 -04:00
Joey Hess
13fdba133f
more 2020-09-06 10:51:23 -04:00
Joey Hess
842afa71ab
bug 2020-09-06 10:42:19 -04:00
Joey Hess
6e9a4f50f3
make viaTmp honor umask
Fixed several cases where files were created without file mode bits that
the umask would usually set. This included exports to the directory special
remote, torrent files used by the bittorrent special remote, hooks written
by git-annex init, and some log files in .git/annex/

Audited all calls, looking for ones that didn't want the umask bits to be
set. All such turned out to already set the specific restrictive file mode
they wanted.
2020-09-02 14:54:07 -04:00
Joey Hess
eed20fe3b7
fix some file modes in calls to withTmpFileIn to honor umask
Also audited for other calls to openTempFile, and all are ok,
except for viaTmp which will need further work.

Remote.Directory fixed to set umask mode when writing to an export,
although it has another one using viaTmp that's not fixed.
Will make exports that are published via a http server running as
another user work, for example.

Remote.BitTorrent fixed to set umask mode when downloading the torrent
file. Normally this does not matter as that file does not hang around
after the download, but if a bittorrent download were started by one user,
got interrupted and then another user ran it, this will let them access
the torrent file created by the first user.
2020-09-02 14:36:08 -04:00
Joey Hess
5a9f518a42
Merge branch 'master' of ssh://git-annex.branchable.com into master 2020-09-02 12:25:52 -04:00
Joey Hess
6781be2141
bug report 2020-09-02 12:25:27 -04:00
hans.ekbrand@aabd6f2f1f93eab77ef85618d24892ebafc6e20f
6c2db1415a 2020-09-02 13:11:03 +00:00
hans.ekbrand@aabd6f2f1f93eab77ef85618d24892ebafc6e20f
5384b70bde 2020-09-02 13:10:31 +00:00
hans.ekbrand@aabd6f2f1f93eab77ef85618d24892ebafc6e20f
b16725a377 2020-09-02 13:09:04 +00:00
yarikoptic
03cea49042 Added a comment 2020-09-02 02:53:23 +00:00
Joey Hess
41ebed3941
Support git remotes where .git is a file, not a directory
Eg when --separate-git-dir was used, and core.symlinks=false.

This commit was sponsored by Brock Spratlen on Patreon.
2020-08-28 15:08:14 -04:00
Joey Hess
cde3e5eb0c
test: Stop gpg-agent daemons that are started for the test framework's gpg key
They normally shutdown when the GNUPGHOME directory is deleted, but on
NFS they keep the directory from being deleted. And also, this avoids
a number of them piling up while the test suite is running.
2020-08-28 14:28:42 -04:00
Joey Hess
be42e04aa8
close 2020-08-28 13:55:54 -04:00
Joey Hess
6bdfeea3b1
close 2020-08-28 13:54:42 -04:00
Joey Hess
5eceef899a
close 2020-08-28 13:53:15 -04:00
Joey Hess
02a35c9cee
comment 2020-08-26 13:09:47 -04:00
Joey Hess
5c1b91f8d3
Merge branch 'master' of ssh://git-annex.branchable.com into master 2020-08-26 13:06:14 -04:00
Joey Hess
b68f214312
Display a message when git-annex has to wait for a pid lock file held by another process 2020-08-26 13:05:34 -04:00
yarikoptic
a325beef64 Added a comment: dreaming of everyone using CoW FSs 2020-08-26 01:26:29 +00:00
Joey Hess
6547bfe324
comment 2020-08-25 17:43:50 -04:00
Joey Hess
7bdb0cdc0d
add gitAnnexChildProcess and use instead of incorrect use of runsGitAnnexChildProcess
Fixes reversion in 8.20200617 that made annex.pidlock being enabled result
in some commands stalling, particularly those needing to autoinit.

Renamed runsGitAnnexChildProcess to make clearer where it should be
used.

Arguably, it would be better to have a way to make any process git-annex
runs have the env var set. But then it would need to take the pid lock
when running any and all processes, and that would be a problem when
git-annex runs two processes concurrently. So, I'm left doing it ad-hoc
in places where git-annex really does run a child process, directly
or indirectly via a particular git command.
2020-08-25 14:57:49 -04:00
Joey Hess
348eaf7b6c
Merge branch 'master' of ssh://git-annex.branchable.com into master 2020-08-25 14:31:43 -04:00
Joey Hess
ca3fb4b1d2
analysis 2020-08-25 14:31:15 -04:00
kyle
6363b888af Added a comment 2020-08-25 17:51:43 +00:00
Joey Hess
d3f3e8f587
document that annex.thin beats annex.hardlink 2020-08-25 13:34:37 -04:00
Joey Hess
2ab574a72f
Merge branch 'master' of ssh://git-annex.branchable.com into master 2020-08-25 13:01:03 -04:00
Joey Hess
2ca1ff62dc
addurl --file youtube-dl reversion fix
addurl: Fix reversion in 7.20190322 that made --file not be honored when
youtube-dl was used to download media.

8758f9c561 was on the right track, but missed that | otherwise prevented
the code it added from being used.

Also, refactored out a common function.

This commit was sponsored by Graham Spencer on Patreon.
2020-08-25 12:56:45 -04:00
yarikoptic
4daf4ea06f Added a comment: pidlock to blame! 2020-08-25 16:27:11 +00:00
kyle
d20ab86b41 Added a comment 2020-08-25 15:20:46 +00:00
yarikoptic
9ae3c552ed initial report on hardlink in thin mode 2020-08-25 15:07:21 +00:00
kyle
b60723184d Added a comment: comment: works on my end 2020-08-25 15:02:45 +00:00
yarikoptic
c8e9db9fdc Added a comment 2020-08-25 15:01:19 +00:00
yarikoptic
b04378ea6a initial report on get being stuck 2020-08-25 14:47:38 +00:00
yarikoptic
29402dd78b initial report on gpgtmp .nfs busy files 2020-08-25 03:12:16 +00:00
kyle
aab3a552f9 Added a comment: thanks 2020-08-19 17:54:11 +00:00
Joey Hess
d00ce82418
fix hang if external program is not available
startExternal' throws an exception, which left the externalAsync TMVar
empty, so the next try to use it would hang.
2020-08-19 12:20:07 -04:00
kyle
ce59265a61 2020-08-18 17:44:01 +00:00
git-annex@32dadd8082caa7c4ec9b28cf7dcf78e0d9fe58a8
c68bf6fc90 Bug: addurl --file not working as expected with youtube-dl 2020-08-12 13:09:02 +00:00
raf@4b53f20230978a98fc814b6e5565d9a30567a4f8
7be4eb71f2 removed 2020-08-12 12:54:46 +00:00
raf@4b53f20230978a98fc814b6e5565d9a30567a4f8
928787af63 2020-08-12 12:47:19 +00:00
cardoso-neto
d79bb64ea4 2020-08-11 20:23:25 +00:00
kyle
a186c4a4c4 Added a comment 2020-08-10 21:34:46 +00:00
Joey Hess
c59a51a065
discard any exception thrown while trying to kill worker threads
Since there's a race here, and since Kyle saw an exception leak out,
which I have not been able to reproduce that. See my comment for what
I think might be going on.

Note that, I used tryNonAsync, because it seems a later tryNonAsync
caught the exception. I don't actually understand how it did, as I
understand exception classification, it's the data type, not the way it
was thrown. One possibility is that the async exception may have been wrapped
in some other, non-async exception, and Show displayed it the same way.
2020-08-10 16:24:51 -04:00
Joey Hess
0da4150453
Merge branch 'master' of ssh://git-annex.branchable.com 2020-08-10 16:03:59 -04:00
Joey Hess
d48049bdd8
comment 2020-08-10 16:03:46 -04:00