Commit graph

2035 commits

Author SHA1 Message Date
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
6e128936bc 2012-04-11 09:39:34 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
7b8d8daece 2012-04-11 09:38:26 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
e27934c42e 2012-04-11 09:37:52 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
14ec54118b 2012-04-11 09:37:26 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
6b07fb19da 2012-04-11 09:37:06 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
af61a5f986 2012-04-11 09:36:34 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
75ff4f77b2 removed 2012-04-10 16:30:09 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
767ab5fc73 Added a comment 2012-04-10 16:29:35 +00:00
http://joey.kitenet.net/
dce77e9e2b Added a comment 2012-04-10 16:05:40 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlxg9HfyLFn0E87p8Em9P5G9YBUr8JYrkE
83ab75fd48 2012-04-10 15:01:35 +00:00
Joey Hess
182778d664 bugfix: Adding a dotfile also caused all non-dotfiles to be added.
When only a dotfile was specified, the list of non-dotfiles was empty,
triggering the fallback behavior of finding all files.
2012-04-08 12:25:54 -04:00
https://www.google.com/accounts/o8/id?id=AItOawnpdM9F8VbtQ_H5PaPMpGSxPe_d5L1eJ6w
4309f363fb 2012-04-08 15:49:07 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnpdM9F8VbtQ_H5PaPMpGSxPe_d5L1eJ6w
e49f7ea62f 2012-04-08 15:47:29 +00:00
Joey Hess
713ce1e623 add news item for git-annex 3.20120406 2012-04-07 15:59:05 -04:00
Joey Hess
e3150ead42 add news item for git-annex 3.20120405 2012-04-05 16:38:46 -04:00
Joey Hess
62005d294e room for a few more feed items 2012-04-05 14:53:53 -04:00
Joey Hess
9924e44c11 close old bug with no followup 2012-04-03 12:30:41 -04:00
Joey Hess
69d58892e8 update sharebox urls to new project 2012-04-01 20:34:09 -04:00
http://adamspiers.myopenid.com/
e418cc92f4 Added a comment: re-annexing previously annexed files 2012-03-29 21:41:55 +00:00
http://joey.kitenet.net/
ae1734e7e8 2012-03-29 01:05:12 +00:00
http://joey.kitenet.net/
20313b3292 Added a comment: ghc 7.0 2012-03-28 19:18:58 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkEUhIcw37X2Kh-dznSMIb9Vgcq0frfdWs
180a6ef3da Added a comment: GHC 7 2012-03-28 19:06:52 +00:00
Joey Hess
ef74908fe7 expand 2012-03-24 19:46:11 -04:00
Joey Hess
987f9db0da Merge branch 'master' of ssh://git-annex.branchable.com 2012-03-23 12:14:59 -04:00
Joey Hess
e72c2b9be2 close 2012-03-23 12:14:42 -04:00
http://schnouki.net/
688fdc0acb Added a comment 2012-03-23 13:27:13 +00:00
http://joey.kitenet.net/
49e8e29499 Added a comment 2012-03-22 22:26:02 +00:00
Joey Hess
4eb5112681 rationalize getConfig
getConfig got a remote-specific config, and this confusing name caused it
to be used a couple of places that only were interested in global configs.
Rename to getRemoteConfig and make getConfig only get global configs.

There are no behavior changes here, but remote.<name>.annex-web-options
never actually worked (and per-remote web options is a very unlikely to be
useful case so I didn't make it work), so fix the documentation for it.
2012-03-22 17:32:47 -04:00
http://schnouki.net/
d315798609 2012-03-22 18:42:09 +00:00
Joey Hess
d228377722 Merge branch 'master' of ssh://git-annex.branchable.com 2012-03-20 15:31:19 -04:00
https://www.google.com/accounts/o8/id?id=AItOawnhsaESlYphzLTzpJy5IxxGFxxctIhWYfo
3126dfc45e Added a comment 2012-03-19 18:55:03 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnhsaESlYphzLTzpJy5IxxGFxxctIhWYfo
bd3dfbd64b Added a comment 2012-03-19 18:46:14 +00:00
http://joey.kitenet.net/
a90c34bdd7 Added a comment: don't do that 2012-03-19 18:23:13 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnhsaESlYphzLTzpJy5IxxGFxxctIhWYfo
27df491bae 2012-03-19 18:06:30 +00:00
Joey Hess
d6624b6c79 typo 2012-03-16 16:03:04 -04:00
Joey Hess
28698e54af document rsyncurl setting 2012-03-16 16:00:08 -04:00
Joey Hess
ff8b6c1bab add news item for git-annex 3.20120315 2012-03-15 12:25:20 -04:00
Joey Hess
bfa15bd665 no-bloom branch 2012-03-14 12:43:34 -04:00
Joey Hess
342fc28437 Merge branch 'master' into bloom
Conflicts:
	Command/Commit.hs
	debian/changelog
2012-03-14 12:41:48 -04:00
Joey Hess
42a6694ca1 Merge branch 'master' of ssh://git-annex.branchable.com 2012-03-14 12:23:50 -04:00
http://joey.kitenet.net/
c26fbecaf4 Added a comment 2012-03-14 16:23:26 +00:00
Joey Hess
5b869eef91 git-annex-shell: Runs hooks/annex-content after content is received or dropped. 2012-03-14 12:18:10 -04:00
Joey Hess
caf97fcffd git-annex-shell: Runs hooks/annex-content after content is received or dropped. 2012-03-14 12:01:56 -04:00
https://www.google.com/accounts/o8/id?id=AItOawm2MUhwzcOSnZfYnmWu7_2dMrH4064OKyQ
f047e04179 2012-03-14 11:09:32 +00:00
Joey Hess
59e2feeda1 Merge branch 'master' into bloom
Conflicts:
	doc/todo/git-annex_unused_eats_memory.mdwn
2012-03-12 16:33:16 -04:00
Joey Hess
6a95240dff note fixed 2012-03-12 16:32:54 -04:00
Joey Hess
94aff8b878 Merge branch 'master' into bloom
Conflicts:
	debian/changelog
2012-03-12 16:32:29 -04:00
Joey Hess
8540183a02 close 2012-03-12 16:31:41 -04:00
Joey Hess
77fb50e01a bloom branch 2012-03-12 16:20:17 -04:00
Joey Hess
25809ce2e0 finish bloom filters
Add tuning, docs, etc.

Not sure if status is the right place to remote size.. perhaps unused
should report the size and also warn if it sees more keys than the bloom
filter allows?
2012-03-12 16:18:35 -04:00
https://www.google.com/accounts/o8/id?id=AItOawl-J5N9y-JBa_GcOQ4VQXIF8MjAtxgN67w
b6caf8997d Formatting 2012-03-12 11:22:21 +00:00
http://joey.kitenet.net/
a886fe1601 Added a comment 2012-03-12 06:43:03 +00:00
https://www.google.com/accounts/o8/id?id=AItOawne9wwsAaMzo0kGyidj6PW_3_IA8eeDv7Y
98ff74a851 2012-03-12 05:16:28 +00:00
Joey Hess
b086e32c63 unused: Reduce memory usage significantly.
Much of the memory bloat turned out to be due to getKeysReferenced
containing a mapM, which is strict and buffered the whole list
rather than streaming it.

The other half of the bloat was due to building a temporary Set
in order to call S.difference. While that is more cpu efficient,
I switched to successive S.delete, since with it, I can run a whole
git annex unused in less than 8 mb of memory.

The whole Set of keys with content available is still stored in memory,
so running unused in a repo with a whole lot of file content will still
use more memory. In a repo containing 6000 files, it needed 40 mb.

Note that the status command still uses the bloatful getKeysReferenced.
2012-03-11 16:24:07 -04:00
Joey Hess
a13949bf37 fix link 2012-03-11 11:52:26 -04:00
Joey Hess
f2e4187323 fix link 2012-03-11 11:52:02 -04:00
http://joey.kitenet.net/
c90e4fdb66 Added a comment 2012-03-11 15:50:11 +00:00
http://claimid.com/FooBarWidget
43dff01dff 2012-03-11 09:22:58 +00:00
Joey Hess
41c0d9e969 add news item for git-annex 3.20120309 2012-03-09 20:15:29 -04:00
http://joey.kitenet.net/
a78f699190 Added a comment 2012-03-06 17:22:54 +00:00
https://www.google.com/accounts/o8/id?id=AItOawk_LOahrm_Cdg7io-_H0CNKkaxsRRQgRFo
ca936cd2d8 Added a comment: Test suite failure 2012-03-06 11:20:36 +00:00
http://peter-simons.myopenid.com/
b4b36b6ebe Added a comment 2012-03-05 23:29:42 +00:00
http://joey.kitenet.net/
d2835d4304 Added a comment 2012-03-05 21:32:00 +00:00
http://joey.kitenet.net/
614208ad52 removed 2012-03-05 21:30:08 +00:00
http://joey.kitenet.net/
eedc774c8a Added a comment 2012-03-05 21:29:46 +00:00
http://peter-simons.myopenid.com/
6a1e334a78 Added a comment 2012-03-05 21:10:48 +00:00
Joey Hess
ee806c1175 add news item for git-annex 3.20120230 2012-03-05 13:47:35 -04:00
Joey Hess
52e88f3ebf add remote start and stop hooks
Locking is used, so that, if there are multiple git-annex processes
using a remote concurrently, the stop hook is only run by the last
process that uses it.
2012-03-04 19:12:58 -04:00
Joey Hess
fba66c55ed foo 2012-03-04 13:16:35 -04:00
Joey Hess
612ca3cf2e tweak davfs2 settings 2012-03-04 11:12:52 -04:00
Joey Hess
896fce3847 box.com seems to behave better with smaller chunks
Seeing some weird failures in the davfs2 or box.com layer with 100 mb
chunks.
2012-03-04 11:02:41 -04:00
Joey Hess
013c7ea441 clarification 2012-03-04 10:51:25 -04:00
Joey Hess
8fc533643d instructions for using Box.com as a special remote
I was sucked in by the 50 gb free lifetime storage offer.
Happily, it was pretty easy to get it to work with git-annex.
2012-03-04 00:14:42 -04:00
Joey Hess
3436aba6de Directory special remotes now support chunking files written to them
Avoiding writing files larger than a specified size is useful on certian
things. For example, box.com has a file size limit of 100 mb. Could also
be useful on really crappy removable media.
2012-03-03 18:05:55 -04:00
Joey Hess
2841d748a4 Merge branch 'master' of ssh://git-annex.branchable.com 2012-03-01 22:40:24 -04:00
Joey Hess
1098bc37ab "here" can be used to refer to the current repository, which can read better than the old "." (which still works too). 2012-03-01 22:35:10 -04:00
http://joey.kitenet.net/
98747ae86b Added a comment 2012-02-29 22:54:01 +00:00
http://peter-simons.myopenid.com/
432dde9156 Added a comment: How do you build the Crypto library with GHC 7.4.1? 2012-02-29 19:20:21 +00:00
Joey Hess
478fdc8a5d add news item for git-annex 3.20120229 2012-02-29 02:39:56 -04:00
http://joey.kitenet.net/
d56da1b9cb Added a comment 2012-02-29 04:27:47 +00:00
http://peter-simons.myopenid.com/
ea6cb182e0 Added a comment: Test-suite won't compile with GHC 7.4.x 2012-02-28 17:40:00 +00:00
Joey Hess
ed0f5cd2d3 add news item for git-annex 3.20120227 2012-02-27 13:07:09 -04:00
Joey Hess
12b89a3eb8 configure: Check if ssh connection caching is supported by the installed version of ssh and default annex.sshcaching accordingly. 2012-02-25 19:15:29 -04:00
Joey Hess
c3fbe07d7a do a cleanup commit after moving data from or to a git remote
Added Annex.cleanup, which is a general purpose interface for adding
actions to run at the end.

Remotes with the old git-annex-shell will commit every time, and have no
commit command, so hide stderr when running the commit command.
2012-02-25 18:02:49 -04:00
Joey Hess
a3c9d06a26 add git-annex-shell commit
Eventually, git-annex might try running this after making changes to
a remote. I have not yet thought of a good way for it to tell which
remotes it needs to run it on though. It can't just do it when
shutting down a cached ssh connection, because ssh connection caching
is optional, and that would not handle local remotes not accessed over ssh
either.
2012-02-25 16:47:28 -04:00
Joey Hess
b49c0c2633 add annex.alwayscommit option
To avoid commits of data to the git-annex branch after each command
is run, set annex.alwayscommit=false. Its data will then be committed
less frequently, when a merge or sync is done.
2012-02-25 15:31:42 -04:00
http://adamspiers.myopenid.com/
638741f49e Added a comment: very nice 2012-02-25 15:02:18 +00:00
Joey Hess
2d5974685f Merge branch 'master' of ssh://git-annex.branchable.com 2012-02-25 10:53:29 -04:00
http://www.joachim-breitner.de/
92236dbdaf Added a comment 2012-02-24 23:09:04 +00:00
Joey Hess
39f3e9e068 update 2012-02-24 17:53:21 -04:00
http://joey.kitenet.net/
0aa7f19c93 Added a comment 2012-02-24 20:52:51 +00:00
Joey Hess
21216becb4 Merge branch 'master' of ssh://git-annex.branchable.com 2012-02-24 16:35:33 -04:00
Joey Hess
bd66f962d3 Deal with NFS problem that caused a failure to remove a directory when removing content from the annex.
I was able to reproduce this on linux using the kernel's nfs server and
mounting localhost:/. Determined that removing the directory fails when
the just-deleted file in it was locked. Considered dropping the lock
before removing the directory, but this would complicate parts of the code
that should not need to worry about locking. So instead, ignore the failure
to remove the directory in this case.

While I was at it, made it attempt to remove both levels of hash
directories, in case they're empty.
2012-02-24 16:30:47 -04:00
http://www.joachim-breitner.de/
0b19f7c709 2012-02-24 20:28:20 +00:00
Joey Hess
c9b48520cc move misplaced bug report 2012-02-24 15:48:01 -04:00
Joey Hess
5aa7c7e83a Merge branch 'master' of ssh://git-annex.branchable.com 2012-02-24 15:46:39 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkCoDbzG4_biL7Y9IvUiRsBH_GchCKAaW4
6dca07e255 2012-02-24 17:47:02 +00:00
Joey Hess
ddb8edcf2b improve interface 2012-02-18 18:03:24 -04:00
Joey Hess
db6b4cdfcf rekey: New plumbing level command, can be used to change the keys used for files en masse. 2012-02-16 16:36:35 -04:00
Joey Hess
346c934409 allow pathdepth to drop from the front or take from the end (negative) 2012-02-16 14:26:53 -04:00
Joey Hess
39c3f56b33 addurl: Add --pathdepth option. 2012-02-16 12:25:19 -04:00
Joey Hess
7d1c09fe4a update 2012-02-15 19:46:29 -04:00
Joey Hess
4d8afc1713 tweak wording 2012-02-15 19:43:15 -04:00
Joey Hess
756c236ec7 Merge branch 'master' of ssh://git-annex.branchable.com 2012-02-15 14:36:47 -04:00
Joey Hess
505d6b1a06 fix failure count memory leak
This is the last memory leak that prevents git-annex from running
in constant space, as far as I can see. I can now run git annex find
dummied up to repeatedly find the same file over and over, on millions
olf files, and memory stays entirely constant.
2012-02-15 14:35:49 -04:00
Joey Hess
4645f83678 add tips 2012-02-15 14:34:40 -04:00
http://joey.kitenet.net/
623a42b0e9 Added a comment 2012-02-15 15:22:56 +00:00
Joey Hess
88b3ee8968 Merge branch 'master' of ssh://git-annex.branchable.com 2012-02-15 11:16:28 -04:00
Joey Hess
52c5b164d8 Added a annex.queuesize setting
useful when adding hundreds of thousands of files on a system with plenty
of memory.

git add gets quite slow in such a large repository, so if the system has
more than the ~32 mb of memory the queue can use by default, it's a useful
optimisation to increase the queue size, in order to decrease the number
of times git add is run.
2012-02-15 11:14:19 -04:00
antymat
d380c18c1e Added a comment 2012-02-15 07:13:12 +00:00
http://joey.kitenet.net/
e04e05ef1b Added a comment 2012-02-14 22:57:29 +00:00
Joey Hess
c26db26259 add scalability page 2012-02-14 18:50:25 -04:00
antymat
586e937ad0 Added a comment 2012-02-14 22:48:38 +00:00
Joey Hess
7371209d13 layout 2012-02-14 17:27:13 -04:00
Joey Hess
9da8bb2846 typo 2012-02-14 17:22:56 -04:00
Joey Hess
29dede039c add video tag with RichiH's talk 2012-02-14 17:19:48 -04:00
Joey Hess
e76988f6c2 add 2012-02-14 16:28:16 -04:00
Joey Hess
7ebd98d8d8 fix memory leak when staging the journal
The list of files had to be retained until the end so it could be deleted.
Also, a list of update-index lines was generated and only then fed into it.
Now everything streams in constant space.
2012-02-14 14:37:59 -04:00
http://joey.kitenet.net/
fa7ffd1cc3 Added a comment 2012-02-14 16:58:33 +00:00
antymat
33e03d58ae spelling 2012-02-14 16:39:17 +00:00
antymat
0e3f7b64b6 2012-02-14 16:34:27 +00:00
Joey Hess
a40ec5e03e Fixed a memory leak due to excessive strictness when committing journal files.
When hashing the files, the entire list of shas was read strictly.
That was entirely unnecessary, since there's a cleanup action run
after they're consumed.
2012-02-14 11:20:34 -04:00
Joey Hess
82ae30d820 don't close yet 2012-02-14 11:02:31 -04:00
Joey Hess
2b28c70f5f add, and immediately close bug. useful documentation though 2012-02-14 01:01:38 -04:00
Joey Hess
6335abcab2 doc update 2012-02-10 20:40:18 -04:00
http://joey.kitenet.net/
4ccc01922f Added a comment 2012-02-09 19:42:28 +00:00
http://peter-simons.myopenid.com/
4b4b887d8d Added a comment 2012-02-09 18:53:04 +00:00
http://peter-simons.myopenid.com/
df3be73080 How to expire old versions of files that have been edited? 2012-02-09 18:31:03 +00:00
Joey Hess
ef013506cb addurl: Added a --file option
Can be used to specify what file the url is added to. This can be used to
override the default filename that is used when adding an url, which is
based on the url. Or, when the file already exists, the url is recorded as
another location of the file.
2012-02-08 15:35:29 -04:00
Joey Hess
2dcce5a8bb merged ghc 7.4 support into master 2012-02-07 14:15:37 -04:00
Joey Hess
7d04f3ad58 Merge branch 'master' into ghc7.4 2012-02-07 14:09:23 -04:00
Joey Hess
0ad5d8168f add a bug template 2012-02-06 21:38:05 -04:00
Joey Hess
679e2567d0 add a bug template 2012-02-06 21:37:44 -04:00
Joey Hess
a6c4b10771 add news item 2012-02-06 20:42:48 -04:00
Joey Hess
5a82c0dee7 add a tip about using git's assume-unchanged feature to optimize large trees 2012-02-06 20:42:48 -04:00
Joey Hess
edcd3123d5 list of git branches 2012-02-06 20:42:48 -04:00
Joey Hess
e2bcf1717e already done 2012-02-06 20:34:07 -04:00
http://jefferai.org/
5e59440533 2012-02-07 00:18:24 +00:00
Joey Hess
91fc975964 note 7.4 needed 2012-02-04 14:51:52 -04:00
Joey Hess
2385fe3c4c add news item 2012-02-04 01:59:53 -04:00
Joey Hess
05f89123e0 update; ghc7.4 branch fixes this pretty well now 2012-02-03 16:25:34 -04:00
Joey Hess
94caa26883 update 2012-02-02 15:44:22 -04:00
Joey Hess
828df56453 update; newghc-edges branch 2012-02-02 15:41:22 -04:00
Joey Hess
fc8a1d213b update 2012-02-02 10:56:39 -04:00
Joey Hess
39e887e8e6 update; unix-compat gets some of the way 2012-02-02 10:56:23 -04:00
Joey Hess
33fd49703c update 2012-02-02 10:31:56 -04:00
Joey Hess
f2081ad056 update 2012-02-01 22:24:40 -04:00
Joey Hess
b91569ba98 spent 3 hours on this bug; developed two incomplete fixes 2012-02-01 16:26:23 -04:00
https://www.google.com/accounts/o8/id?id=AItOawk6QAwUsFHpr3Km1yQbg8hf3S7RDYf7hX4
b9a317cdbd Added a comment 2012-01-29 01:51:37 +00:00
Joey Hess
0609e10239 reopen
People seem to want to post comments here with vague details about a new
bug, rather than opening a new bug report.
2012-01-28 18:09:28 -04:00