Commit graph

27938 commits

Author SHA1 Message Date
lykos@d125a37d89b1cfac20829f12911656c40cb70018
a0ffdac56e 2020-06-11 11:03:07 +00:00
branchable@bafd175a4b99afd6ed72501042e364ebd3e0c45e
512f77fe2a Added a comment: I've hacked up a Python script for policy-based automatic commits 2020-06-11 10:10:52 +00:00
branchable@bafd175a4b99afd6ed72501042e364ebd3e0c45e
96f2b501a9 Added a comment: I've hacked an ugly daemon together for this 2020-06-11 09:56:57 +00:00
branchable@bafd175a4b99afd6ed72501042e364ebd3e0c45e
b65e596fb8 Added a comment: I wonder if this is related to the use of tor 2020-06-11 09:56:08 +00:00
kanakkshetri@9ea0e7639162bddc7bf9f3bb94cc32e93c793b89
9102d31721 Added a comment: git-annex-repair and git annex fsck: no errors found 2020-06-10 14:39:44 +00:00
kanakkshetri@9ea0e7639162bddc7bf9f3bb94cc32e93c793b89
c4a9647555 noticed confusing two rsync processes to copy one file. 2020-06-10 10:58:05 +00:00
Joey Hess
266ec93237
ugh 2020-06-09 17:39:03 -04:00
Joey Hess
e0d8ab75dd
Merge branch 'master' of ssh://git-annex.branchable.com 2020-06-09 16:20:45 -04:00
Joey Hess
24766125d9
update 2020-06-09 16:20:08 -04:00
Joey Hess
c1b4e79f50
devblog 2020-06-09 16:19:07 -04:00
Joey Hess
8a824147e4
horrible realization 2020-06-09 16:10:27 -04:00
Joey Hess
a49d300545
async exception safety for external special remote processes
Since an external process can be in the middle of some operation when an
async exception is received, it has to be shut down then. Using
cleanupProcess will close its IO handles and send it a SIGTERM.

If a special remote choses to catch SIGTERM, it's fine for it to do some
cleanup then, but until it finishes, git-annex will be blocked waiting
for it. If a special remote blocked SIGTERM, it would cause a hang.
Mentioned in docs.

Also, in passing, fixed a FD leak, it was not closing the error handle
when shutting down the external. In practice that didn't matter before because
it was only run when git-annex was itself shutting down, but now that it
can run on exception, it would have been a problem.
2020-06-09 12:22:14 -04:00
kanakkshetri@9ea0e7639162bddc7bf9f3bb94cc32e93c793b89
34b088b209 Output of --debug, Formatting 2020-06-08 15:09:20 +00:00
meribold
52412b773b AWS tells me that the Reduced Redundancy storage class is less cost effective than Standard and not recommended 2020-06-08 14:58:48 +00:00
kanakkshetri@9ea0e7639162bddc7bf9f3bb94cc32e93c793b89
634c66ea49 2020-06-08 14:24:37 +00:00
strmd
2d2a735ce7 2020-06-08 07:11:55 +00:00
yarikoptic
02ee2d0e47 2020-06-07 19:38:34 +00:00
Ilya_Shlyakhter
ebdf27f0a3 added question about building from source using stack 2020-06-06 23:03:44 +00:00
yarikoptic
8e3cdfa90e Added a comment 2020-06-05 22:15:09 +00:00
yarikoptic
04aa8360a9 Added a comment: reply to Joey's comments 2020-06-05 22:11:48 +00:00
Joey Hess
0fd72ff8e0
Merge branch 'master' of ssh://git-annex.branchable.com 2020-06-05 15:49:01 -04:00
Joey Hess
0210e81d83
async exception safety for openFd
Audited for openFile and openFd, and this fixes all the ones I found
where an async exception could prevent the file getting closed.

Except for the lock pool, which is a whole other can of worms.
2020-06-05 15:48:00 -04:00
mario
38d98ce550 Added a comment: Get missing files in --hide-missing branch 2020-06-05 19:14:26 +00:00
Joey Hess
dca19099a9
async exception safety
Masking ensures that EndStderrHandler gets written, so the helper
threads shut down.

However, nothing currently guarantees that calls to closeP2PSshConnection
are async exception safe, so made a note about it.

At this point, I've audited all calls to async, and made them all async
exception safe, except for ones in the assistant, and a few in leaf
commands (remotedaemon, enable-tor, multicast, p2p) which don't need to
be.
2020-06-05 14:56:41 -04:00
Joey Hess
9703ef8ae1
update 2020-06-05 12:12:20 -04:00
Joey Hess
42756b972e
few more things 2020-06-05 11:15:29 -04:00
Joey Hess
db270bd6ba
Merge branch 'master' of ssh://git-annex.branchable.com 2020-06-05 11:13:15 -04:00
Joey Hess
2bff3b7c49
init: When annex.pidlock is set, skip lock probing. 2020-06-05 11:12:16 -04:00
Joey Hess
1d41ae5d2a
init warning on stalled lock probe
init: If lock probing stalls for a long time (eg a broken NFS server),
display a message to let the user know what's taking so long.
2020-06-05 11:06:19 -04:00
Ilya_Shlyakhter
1d189cd08e Added a comment 2020-06-05 14:51:08 +00:00
Joey Hess
e998e4a29a
Merge branch 'master' of ssh://git-annex.branchable.com 2020-06-05 10:41:30 -04:00
Ilya_Shlyakhter
5bec5ff8d8 Added a comment: correct standalone tarball for git-annex-8.20200522 2020-06-05 06:21:07 +00:00
yarikoptic
08bc7a6867 reporting on SQLite3 problem rendering pidlocked system unusable 2020-06-05 02:31:21 +00:00
yarikoptic
8d3ffe50a1 initial whining about long pidlock need detection time 2020-06-05 02:18:31 +00:00
git-annex@17927e6dc041ab425c14217a97a685adf3ecf44f
31b8d6b440 Added a comment: Actually they were not standard 2020-06-04 21:05:48 +00:00
git-annex@17927e6dc041ab425c14217a97a685adf3ecf44f
0f4abb039c Added a comment: Actually they were not standard 2020-06-04 21:05:30 +00:00
git-annex@17927e6dc041ab425c14217a97a685adf3ecf44f
369382e8cf Added a comment: content expression is standard 2020-06-04 20:28:01 +00:00
Joey Hess
a3d1f967a8
almost forgot 2020-06-04 16:22:45 -04:00
Joey Hess
67f4ed1f55
Merge branch 'master' of ssh://git-annex.branchable.com 2020-06-04 15:53:10 -04:00
Joey Hess
3bd2bbb54c
devblog 2020-06-04 15:52:53 -04:00
Joey Hess
2670890b17
convert to withCreateProcess for async exception safety
This handles all createProcessSuccess callers, and aside from process
pools, the complete conversion of all process running to async exception
safety should be complete now.

Also, was able to remove from Utility.Process the old API that I now
know was not a good idea. And proof it was bad: The code size went *down*,
despite there being a fair bit of boilerplate for some future API to
reduce.
2020-06-04 15:45:52 -04:00
Joey Hess
12e7d52c8b
another wrinkle 2020-06-04 14:46:28 -04:00
nicolas
3319855083 2020-06-04 13:17:39 +00:00
Joey Hess
e1fc4f7594
make safeCommand stop the process if the thread gets killed
And a comment on a todo item that this commit is perhaps the start of
solving.
2020-06-03 12:52:11 -04:00
Joey Hess
81a811d935
comment 2020-06-03 12:00:44 -04:00
Joey Hess
697ebba78f
Merge branch 'master' of ssh://git-annex.branchable.com 2020-06-03 11:40:24 -04:00
the13thletter
e3b487d41c Added a comment 2020-06-02 14:26:52 +00:00
Ilya_Shlyakhter
fa3a8e73cf removed 2020-06-01 16:36:34 +00:00
superhair123
10dcc6e27e 2020-06-01 13:48:04 +00:00
superhair123
4b0dd1fcb2 2020-06-01 13:47:30 +00:00