Commit graph

3152 commits

Author SHA1 Message Date
https://id.koumbit.net/anarcat
19763df501 import not only doesn't work, it kills 2013-10-07 12:02:56 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnZEanlyzay_QlEAL0CWpyZcRTyN7vay8U
8a19b0e50b Added a comment: Tilde did it for me 2013-10-06 21:59:44 +00:00
Joey Hess
635c9a1549 assistant: Detect stale git lock files at startup time, and remove them.
Extends the index.lock handling to other git lock files. I surveyed
all lock files used by git, and found more than I expected. All are
handled the same in git; it leaves them open while doing the operation,
possibly writing the new file content to the lock file, and then closes
them when done.

The gc.pid file is excluded because it won't affect the normal operation
of the assistant, and waiting for a gc to finish on startup wouldn't be
good.

All threads except the webapp thread wait on the new startup sanity checker
thread to complete, so they won't try to do things with git that fail
due to stale lock files. The webapp thread mostly avoids doing that kind of
thing itself. A few configurators might fail on lock files, but only if the
user is explicitly trying to run them. The webapp needs to start
immediately when the user has opened it, even if there are stale lock
files.

Arranging for the threads to wait on the startup sanity checker was a bit
of a bear. Have to get all the NotificationHandles set up before the
startup sanity checker runs, or they won't see its signal. Perhaps
the NotificationBroadcaster is not the best interface to have used for
this. Oh well, it works.

This commit was sponsored by Michael Jakl
2013-10-05 17:04:21 -04:00
Joey Hess
1be4d281d6 Better sanitization of problem characters when generating URL and WORM keys.
FAT has a lot of characters it does not allow in filenames, like ? and *
It's probably the worst offender, but other filesystems also have
limitiations.

In 2011, I made keyFile escape : to handle FAT, but missed the other
characters. It also turns out that when I did that, I was also living
dangerously; any existing keys that contained a : had their object
location change. Oops.

So, adding new characters to escape to keyFile is out. Well, it would be
possible to make keyFile behave differently on a per-filesystem basis, but
this would be a real nightmare to get right. Consider that a rsync special
remote uses keyFile to determine the filenames to use, and we don't know
the underlying filesystem on the rsync server..

Instead, I have gone for a solution that is backwards compatable and
simple. Its only downside is that already generated URL and WORM keys
might not be able to be stored on FAT or some other filesystem that
dislikes a character used in the key. (In this case, the user can just
migrate the problem keys to a checksumming backend. If this became a big
problem, fsck could be made to detect these and suggest a migration.)

Going forward, new keys that are created will escape all characters that
are likely to cause problems. And if some filesystem comes along that's
even worse than FAT (seems unlikely, but here it is 2013, and people are
still using FAT!), additional characters can be added to the set that are
escaped without difficulty.

(Also, made WORM limit the part of the filename that is embedded in the key,
to deal with filesystem filename length limits. This could have already
been a problem, but is more likely now, since the escaping of the filename
can make it longer.)

This commit was sponsored by Ian Downes
2013-10-05 15:01:49 -04:00
http://cstork.org/
7b7d4b2353 Added a comment 2013-10-04 11:17:42 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnyMzZZLS1xGW1raqc_9Md6Ksdkvx5rUJU
5a330fe6c8 Added a comment 2013-10-04 10:59:30 +00:00
http://olivier.mehani.name/
fe52de18b5 Added a comment 2013-10-04 05:14:16 +00:00
Joey Hess
891242ad26 another lock file 2013-10-03 17:05:53 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmf-gdwX6Nk3DyHyVCh3C_e8VGcAnPbMCI
05db0fef17 2013-10-03 13:02:40 +00:00
volfyd
64b3f4120b 2013-10-02 22:11:57 +00:00
http://joeyh.name/
d6986aef82 Added a comment 2013-10-02 20:37:04 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnyMzZZLS1xGW1raqc_9Md6Ksdkvx5rUJU
899d8959ca 2013-10-02 20:15:33 +00:00
Joey Hess
87c7f5dd62 Merge branch 'master' of ssh://git-annex.branchable.com 2013-09-30 12:49:06 -04:00
Joey Hess
7f7dcd315b fix direct mode switch permissions problem
Similar to how a similar problem with indirect was earlier fixed.
2013-09-30 12:48:40 -04:00
http://joeyh.name/
0a83779df5 Added a comment 2013-09-30 16:47:43 +00:00
http://joeyh.name/
f84073d6fd Added a comment 2013-09-30 16:23:38 +00:00
http://joeyh.name/
2ba975bf3d Added a comment 2013-09-30 16:13:20 +00:00
http://cstork.org/
8fd2717462 Added a comment: News page stopped listing latest releases? 2013-09-30 16:08:18 +00:00
Remy
f010b89f82 Added a comment: Thank you very much 2013-09-30 08:49:33 +00:00
http://olivier.mehani.name/
738b0cd466 Added a comment 2013-09-30 01:31:26 +00:00
http://olivier.mehani.name/
2534af1488 Added a comment 2013-09-30 01:29:50 +00:00
http://olivier.mehani.name/
2a539a9bfc removed 2013-09-30 01:13:32 +00:00
http://olivier.mehani.name/
c6ee93d83d Added a comment 2013-09-30 01:12:43 +00:00
Joey Hess
3f0ea53fc8 finally sorted out the OSX gpg mess 2013-09-29 16:30:49 -04:00
Joey Hess
c7ed2a24d5 dup 2013-09-29 15:16:13 -04:00
http://joeyh.name/
4a806492f3 Added a comment 2013-09-29 19:14:00 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmTlfbCC37CAjhQrS107ZWRVA_sF4s3gLU
b5287ef707 2013-09-29 08:27:17 +00:00
http://joeyh.name/
2d092b9169 Added a comment 2013-09-28 19:34:42 +00:00
Joey Hess
12f6b9693a Send a git-annex user-agent when downloading urls.
Overridable with --user-agent option.

Not yet done for S3 or WebDAV due to limitations of libraries used --
nether allows a user-agent header to be specified.

This commit sponsored by Michael Zehrer.
2013-09-28 14:35:21 -04:00
Joey Hess
55362462ae close 2013-09-28 11:30:01 -04:00
Joey Hess
4eef13f68a Merge branch 'master' of ssh://git-annex.branchable.com 2013-09-28 11:28:46 -04:00
Joey Hess
bd431408b5 analysis 2013-09-28 11:27:52 -04:00
Joey Hess
1ba3165135 fixed upstream 2013-09-28 10:57:15 -04:00
http://cstork.org/
7d3b13487d 2013-09-28 12:59:57 +00:00
Remy
ebc1ff27c7 2013-09-27 22:38:21 +00:00
Remy
135b6e70e5 2013-09-27 22:35:45 +00:00
Joey Hess
d6883dcd7f forwarded 2013-09-27 17:18:28 -04:00
volfyd
55a790635d 2013-09-27 19:18:57 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U
b71adf6ba6 Added a comment 2013-09-26 09:08:11 +00:00
https://www.google.com/accounts/o8/id?id=AItOawknwkXgi8SnK4QT32ANl3GMKvFLyQGeHqo
a227a5db07 Added a comment 2013-09-25 21:19:23 +00:00
Joey Hess
98fc7e8a19 add, import, assistant: Better preserve the mtime of symlinks, when when adding content that gets deduplicated.
Note that this turned out to remove a syscall, not add any expense.
Otherwise, I would not have done it.
2013-09-25 16:07:11 -04:00
Joey Hess
5ff9224b10 Merge branch 'master' of ssh://git-annex.branchable.com 2013-09-25 15:30:45 -04:00
Joey Hess
c45f5fbdb3 indirect: Better behavior when a file in direct mode is not owned by the user running the conversion. 2013-09-25 15:29:56 -04:00
http://joeyh.name/
b10a44b4ca Added a comment 2013-09-25 18:57:25 +00:00
http://joeyh.name/
d39d65594f Added a comment 2013-09-25 18:36:39 +00:00
http://joeyh.name/
3368ded592 Added a comment 2013-09-25 18:27:24 +00:00
http://joeyh.name/
256ac32458 Added a comment 2013-09-25 18:21:25 +00:00
http://joeyh.name/
6871f41e77 Added a comment 2013-09-25 18:18:49 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmegJFSUlkCanL5EButSxQcRGfo9hPbMEg
037fe31f9c 2013-09-24 08:58:18 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U
71fbcd4db1 2013-09-23 23:47:22 +00:00