Commit graph

1962 commits

Author SHA1 Message Date
Joey Hess
3c319cd844 avoid always decrypting cipher
Last change moved cipher decryption to remote setup time.
Fixed this with a bit of a hack.
2011-05-01 15:13:54 -04:00
Joey Hess
2ddade8132 factor out base64 code 2011-05-01 14:27:40 -04:00
Joey Hess
3095e16311 mention that the cipher can also be used to crypt access keys 2011-05-01 14:09:07 -04:00
Joey Hess
1f84c7a964 S3: When encryption is enabled, the Amazon S3 login credentials are stored, encrypted, in .git-annex/remotes.log, so environment variables need not be set after the remote is initialized. 2011-05-01 14:05:10 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
110b1e2b0a Added a comment 2011-04-29 20:11:09 +00:00
http://joey.kitenet.net/
a14368aa87 Added a comment 2011-04-29 18:01:04 +00:00
Joey Hess
cf501d3b9b set ANNEX_HASH_* always 2011-04-29 14:04:20 -04:00
Joey Hess
ecdc08dbe1 Merge remote-tracking branch 'branchable/master' 2011-04-29 13:59:30 -04:00
Joey Hess
43f0a666f0 unused: Now also lists files fsck places in .git/annex/bad/ 2011-04-29 13:59:00 -04:00
Joey Hess
49efc6c399 add -fspec-constr-count workaround
ghc 7 produces these warnings http://hackage.haskell.org/trac/ghc/ticket/4288
The specialization is enabled by -O2, and the default limit of 3 is
there to avoid specialization blowing up binary size. Perhaps that default
is a little low? I needed 4 to avoid a warning on Unused.hs, and 5 to avoid
warnings on test.hs
2011-04-29 13:12:26 -04:00
Joey Hess
5d8e0d5a1c remove unused file 2011-04-29 12:20:59 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
976ed575d5 Added a comment 2011-04-29 16:17:23 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
4a13bdc3df Added a comment 2011-04-29 15:33:54 +00:00
http://joey.kitenet.net/
15711872f7 Added a comment 2011-04-29 15:24:56 +00:00
Joey Hess
a83adb0acd note number of hash buckets 2011-04-29 11:22:55 -04:00
Joey Hess
0ea7f966dc add git annex describe to special remote setup examples 2011-04-29 11:16:54 -04:00
Joey Hess
3d22364bcb Merge remote-tracking branch 'branchable/master' 2011-04-29 11:11:50 -04:00
http://christian.amsuess.com/chrysn
eca0254628 no way the goon would be admitted in the library; he doesn't understand the floor/shelf system anyway 2011-04-29 14:48:08 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
446585351b Added a comment: whereis labels 2011-04-29 13:08:36 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkjvjLHW9Omza7x1VEzIFQ8Z5honhRB90I
9b133a8122 Added a comment: Duplication of the filenames is what I am concerned about 2011-04-29 11:48:23 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
db2786bf0e Added a comment 2011-04-29 10:43:31 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
75f9028446 2011-04-29 10:37:17 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
05fe77c110 2011-04-29 10:36:37 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
66dbf7799f 2011-04-29 10:34:02 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
f581481a75 2011-04-29 10:33:27 +00:00
Joey Hess
6e95521b85 tweak 2011-04-28 20:47:36 -04:00
Joey Hess
8fcac59852 closing bug
my explanation seems to have sufficed
2011-04-28 20:44:08 -04:00
Joey Hess
eef3f634e9 Avoid crashing when an existing key is readded to the annex. 2011-04-28 20:41:40 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkjvjLHW9Omza7x1VEzIFQ8Z5honhRB90I
b8e114bce1 2011-04-28 23:39:28 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkjvjLHW9Omza7x1VEzIFQ8Z5honhRB90I
8b950c5fe8 This demonstrates a git-annex failure when hard links are involved 2011-04-28 23:38:36 +00:00
Joey Hess
ee0238d229 Merge remote-tracking branch 'branchable/master' 2011-04-28 17:31:14 -04:00
Joey Hess
b0efff86b6 wording 2011-04-28 17:28:38 -04:00
http://joey.kitenet.net/
847bbe30b1 Added a comment 2011-04-28 21:22:04 +00:00
Joey Hess
3ab3f41aea hook special remote implemented, and tested 2011-04-28 17:21:45 -04:00
Joey Hess
b5072b7b4c add boolSystemEnv 2011-04-28 16:08:18 -04:00
Joey Hess
56eaf4470a bugfix 2011-04-28 16:08:10 -04:00
Joey Hess
07576f2a2c documentation for hook special remotes
Releasing before I have quite finished the code. Got a little caught
up in Anathem references. Time for a walk and then a tiny bit more coding
and possibly testing.
2011-04-28 15:26:21 -04:00
Joey Hess
d7b330b33b Fix hasKeyCheap setting for bup and rsync special remotes. 2011-04-28 14:39:51 -04:00
Joey Hess
84e1ebfb0e erm, thought I committed this release? 2011-04-28 14:38:01 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
5201c43787 added example fo rusing rsync over ssh 2011-04-28 13:45:32 +00:00
http://christian.amsuess.com/chrysn
d980a55b47 thanks & notes on migration 2011-04-28 11:27:51 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
4e6dd7f319 Added a comment 2011-04-28 07:47:39 +00:00
Joey Hess
7a33803193 Avoid pipeline stall when running git annex drop or fsck on a lot of files.
When it's stalled, there are 3 processes:

git annex
  git ls-files
  git check-attr

git-annex stalls trying to write to git check-attr, which stalls trying to
write to stdout (read by git-annex).

git ls-files does not seem to be involved directly; I've seen the stall when
it was still streaming out the file list, and after it had exited and
zombified.

The read and write are supposed to be handled by two different threads,
which pipeBoth forks off, thus avoiding deadlock. But it does deadlock.
(Certian signals unblock the deadlock for a while, then it stalls again.)

So, this is another case of WTF is the ghc IO manager doing today?
I avoid the issue by converting the writer to a separate process.

Possibly this was caused by some change in ghc 7 -- I'm offline and cannot
verify now, but I'm sure I used to be able to run git annex drop w/o it
hanging! And the code does not seem to have changed, except for commit
c1dc407941, which I tried reverting without
success. In fact, I reverted all the way back to 0.20110316 and still
saw the stall.

Update: Minimal test case:

import System.Cmd.Utils

main = do
	as <- checkAttr "blah" $ map show [1..100000]
	sequence $ map (putStrLn . show) as

checkAttr attr files = do
	(_, s) <- pipeBoth "git" params $ unlines files
	return $ lines s
	where
		params = ["check-attr", attr, "--stdin"]

Bug filed on ghc in debian, #624389
2011-04-27 23:18:35 -04:00
Joey Hess
39966ba4ee filter out --delete rsync option
rsync does not have a --no-delete, so do it this way instead
2011-04-27 20:31:56 -04:00
Joey Hess
e68f128a9b rsync special remote
Fully tested and working, including resuming and encryption. (Though not
resuming when sending *with* encryption; gpg doesn't produce identical
output each time.)

Uses same layout as the directory special remote and the .git/annex/objects/
directory.
2011-04-27 20:23:09 -04:00
Joey Hess
4381ac062f Merge remote-tracking branch 'branchable/master' 2011-04-27 11:18:16 -04:00
Joey Hess
0d6860bb6f drastically simplify instructions for debian stable :) 2011-04-27 11:07:54 -04:00
http://christian.amsuess.com/chrysn
568cb52b6e sftp backend? 2011-04-27 14:27:27 +00:00
Joey Hess
dbdcb67f79 fix test suite when run by root 2011-04-26 20:26:25 -04:00
Joey Hess
948691e893 exit nonzero when there were failure, not just errors
ya, I need a test suite for my test suite
2011-04-26 20:26:19 -04:00