Commit graph

363 commits

Author SHA1 Message Date
EskildHustvedt
bdadee24db Added a comment 2012-12-01 19:31:18 +00:00
http://joeyh.name/
567030cd96 Added a comment 2012-12-01 19:22:03 +00:00
Joey Hess
714afb8ede tag 2012-11-30 12:35:40 -04:00
EskildHustvedt
24fdb40d3f 2012-11-29 22:39:15 +00:00
Joey Hess
eded99d2bd add 2012-11-25 14:21:10 -04:00
Joey Hess
a5111a6d85 Amazon Glacier special remote; 100% working 2012-11-20 16:43:58 -04:00
http://lj.rossia.org/users/imz/
979df760b7 rename todo/whishlist:_make_partial_files_available_during_transfer.mdwn to todo/wishlist:_make_partial_files_available_during_transfer.mdwn 2012-11-05 04:02:07 +00:00
http://joeyh.name/
dfa8d83709 removed 2012-11-04 19:59:01 +00:00
http://joeyh.name/
07e37172eb removed 2012-11-04 19:58:44 +00:00
http://joeyh.name/
cae5dfaff9 Added a comment 2012-11-04 19:58:28 +00:00
http://joeyh.name/
6be068f918 Added a comment 2012-11-04 19:57:48 +00:00
http://joeyh.name/
7c7ca34c5d Added a comment 2012-11-04 19:57:38 +00:00
http://hands.com/~phil/
837a3dad56 Added a comment: and you can specify ranges to dropunused 2012-11-02 09:07:49 +00:00
http://olg.myid.net/
ae4e2673a7 2012-11-01 23:48:17 +00:00
Joey Hess
133929eb8f fsck --all should, perhaps, check every file in every ref 2012-11-01 18:15:59 -04:00
https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U
480a44c546 Added a comment 2012-10-30 08:09:13 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlgyVag95OnpvSzQofjyX0WjW__MOMKsl0
0677fa698a 2012-10-29 19:15:05 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlgyVag95OnpvSzQofjyX0WjW__MOMKsl0
79b2d0948d 2012-10-29 19:12:05 +00:00
Joey Hess
36f6c694ea Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-24 11:42:30 -04:00
Joey Hess
8c6c40e89c tag 2012-10-24 11:39:11 -04:00
http://adamspiers.myopenid.com/
cb3bacd2c2 Mention assistant explicitly and also relationship to partial content 2012-10-24 15:38:36 +00:00
Joey Hess
fd56f5fa7c Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-24 11:38:17 -04:00
Joey Hess
7427a3e291 close 2012-10-24 11:38:01 -04:00
http://adamspiers.myopenid.com/
91e1756dfe 2012-10-24 15:33:01 +00:00
http://joeyh.name/
474b560041 Added a comment 2012-10-22 15:35:30 +00:00
https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89
01bd7dd390 2012-10-20 19:19:02 +00:00
https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89
de452ca2a9 Added a comment: Response 2012-10-20 05:21:13 +00:00
http://joeyh.name/
76987b849f Added a comment 2012-10-17 18:31:58 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
8fbcb23eb1 Added a comment: What about... 2012-10-16 16:43:29 +00:00
https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89
fdca690900 2012-10-16 16:30:57 +00:00
http://lj.rossia.org/users/imz/
eaac10ac1d typos 2012-10-05 22:56:48 +00:00
Joey Hess
b577ec4a5c response 2012-10-05 17:56:15 -04:00
http://m-f-k.myopenid.com/
ac238eccba Added a comment: +1 2012-10-05 20:00:32 +00:00
http://lj.rossia.org/users/imz/
bbba59aa03 Wikilink to the command in question. 2012-10-01 11:33:51 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U
65acdaa357 2012-09-28 23:37:29 +00:00
http://lj.rossia.org/users/imz/
2f19908461 Any URN is different from a hash in that it isn't computable. It must be known. 2012-09-26 18:28:31 +00:00
http://lj.rossia.org/users/imz/
0573a3426d Cf. URNs -- what about extendings keys to URNs? The there's no guarantee that will get the identified content in always the same format. 2012-09-26 18:20:07 +00:00
http://lj.rossia.org/users/imz/
8c990762bc A different view: extend the key-value backends with ways to look for the content in other content-addressable storage systems 2012-09-26 17:37:53 +00:00
http://lj.rossia.org/users/imz/
0a3949ec80 For more clarity, link to the git-annex's cmds that the menu should be an interface for. 2012-09-26 00:10:33 +00:00
http://lj.rossia.org/users/imz/
316129023f removed 2012-09-26 00:07:27 +00:00
http://lj.rossia.org/users/imz/
072cd641cc Added a comment: the scheme to follow to use the addurl command is longer 2012-09-26 00:07:11 +00:00
http://lj.rossia.org/users/imz/
63bc17fe07 Added a comment: the scheme to follow to use the addurl command is longer 2012-09-26 00:04:03 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
cdd25f830d Added a comment 2012-09-25 23:55:44 +00:00
http://lj.rossia.org/users/imz/
f843e78c0a Added a comment 2012-09-25 23:33:23 +00:00
http://lj.rossia.org/users/imz/
b87b652daa Added a comment 2012-09-25 23:29:49 +00:00
http://lj.rossia.org/users/imz/
eebba8d72e 2012-09-25 23:20:07 +00:00
http://joeyh.name/
6a259e4e4a Added a comment 2012-09-25 22:57:19 +00:00
http://joeyh.name/
9b4122d12b Added a comment 2012-09-25 22:56:22 +00:00
http://lj.rossia.org/users/imz/
052c0296b6 convert a link into an internal one, so that the connections can be tracked by ikiwiki and displayed. 2012-09-25 22:55:24 +00:00
http://lj.rossia.org/users/imz/
ded4ab1e57 The backends for real strorage seem to be called "special remotes", so correcting myself. 2012-09-25 21:47:48 +00:00
http://lj.rossia.org/users/imz/
35b412808f rename todo/wishlist:_backends_for_other_peer_network_data_stores___40__gnunet__44___freenet__41__.mdwn to todo/wishlist:_spec.remotes_for_other_peer_network_data_stores___40__gnunet__44___freenet__41__.mdwn 2012-09-25 21:44:41 +00:00
http://lj.rossia.org/users/imz/
6b137ac511 typo and a wikilink to the type of the thing that is requested 2012-09-25 21:42:54 +00:00
http://lj.rossia.org/users/imz/
adcee1304c rename todo/wishlist:_a_remote_for_netwrok_directories_that_would_mount_them_whenever_needed___40__e.g.__44___with_WebDAV__41__.mdwn to todo/wishlist:_a_spec.remote_for_network_directories_that_would_mount_them_whenever_needed___40__e.g.__44___with_WebDAV__41__.mdwn 2012-09-25 21:40:20 +00:00
http://lj.rossia.org/users/imz/
f53e8d72f7 2012-09-25 21:20:01 +00:00
http://lj.rossia.org/users/imz/
4d6f6637a2 A scenario of how this would be useful. 2012-09-25 20:39:39 +00:00
http://lj.rossia.org/users/imz/
803058a4bb +a wikilink (!and there is a bug that leads to a broken wikilink!) 2012-09-25 20:23:52 +00:00
http://lj.rossia.org/users/imz/
025e210e7d typo 2012-09-25 20:19:48 +00:00
http://lj.rossia.org/users/imz/
6735b06537 2012-09-25 20:19:07 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
e8d854b26f clarify desired behavior of --max-age 2012-09-25 19:53:07 +00:00
Joey Hess
7fa916b975 notes 2012-09-25 15:32:13 -04:00
basak
da7b333557 Added a comment 2012-09-21 22:21:04 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
9f102331ef Added a comment 2012-09-20 14:11:57 +00:00
Joey Hess
e79890664d idea 2012-09-19 12:00:06 -04:00
http://ertai.myopenid.com/
ac365b954a Added a comment: +1 2012-09-18 08:52:22 +00:00
Joey Hess
601ee470af sync: Pushes the git-annex branch to remote/synced/git-annex, rather than directly to remote/git-annex.
This fixes a problem I was seeing in the assistant where two remotes would
attempt to sync with one another at the same time, and both failed pushing
the diverged git-annex branch. Then when both tried to resolve the failed
push, they each modified their git-annex branch, which again each blocked
the other from pushing into it. The result was that the git-annex
branches were perpetually diverged (despite having the same content!) and
once the assistant fell into this trap, it couldn't get out and always
had to do the slow push/fail/pull/merge/push/fail cycle.
2012-09-16 17:54:12 -04:00
http://mike.magin.org/
2075ce728c Added a comment 2012-09-14 04:19:54 +00:00
Joey Hess
f417f7153f move todo item to right place; reply 2012-09-13 17:44:37 -04:00
Joey Hess
ea55609e54 interesting quote 2012-09-12 16:00:25 -04:00
https://me.yahoo.com/a/dASECLNzvckz4VwqUGYsvthiplY.#d2c27
d038f96fd9 Added a comment 2012-09-09 23:48:21 +00:00
Joey Hess
b43580ac6f add glacier todo page 2012-09-04 14:58:11 -04:00
Joey Hess
cbca93cf7c Merge branch 'master' into assistant
Conflicts:
	debian/changelog
2012-08-16 16:36:32 -07:00
https://www.google.com/accounts/o8/id?id=AItOawlc1og3PqIGudOMkFNrCCNg66vB7s-jLpc
456c11ee35 Added a comment: Re: What about NTFS support? 2012-08-16 19:30:38 +00:00
Joey Hess
48d9e65dee Merge branch 'master' into assistant 2012-08-03 10:20:27 -04:00
http://xolus.net/openid/max
f294825b89 Added a comment: What about NTFS support ? 2012-08-02 17:45:10 +00:00
Joey Hess
6de38a2ca8 Merge branch 'master' into assistant 2012-07-26 14:28:19 -04:00
http://joeyh.name/
8c3491f50c Comment moderation 2012-07-26 17:21:26 +00:00
Joey Hess
2fdca82a64 Merge branch 'master' into assistant 2012-07-19 00:58:53 -04:00
Joey Hess
61695f9f41 blog for the day 2012-07-18 19:42:29 -04:00
Joey Hess
d1da9cf221 switch from System.Cmd.Utils to System.Process
Test suite now passes with -threaded!

I traced back all the hangs with -threaded to System.Cmd.Utils. It seems
it's just crappy/unsafe/outdated, and should not be used. System.Process
seems to be the cool new thing, so converted all the code to use it
instead.

In the process, --debug stopped printing commands it runs. I may try to
bring that back later.

Note that even SafeSystem was switched to use System.Process. Since that
was a modified version of code from System.Cmd.Utils, it needed to be
converted too. I also got rid of nearly all calls to forkProcess,
and all calls to executeFile, which I'm also doubtful about working
well with -threaded.
2012-07-18 18:00:24 -04:00
Joey Hess
cfdd4d6602 blog for the day and updates 2012-07-17 18:51:46 -04:00
Joey Hess
1b9ab0ef93 todos 2012-07-07 11:56:23 -06:00
Joey Hess
3247415c56 update; split out hard todo 2012-07-07 11:12:11 -06:00
Joey Hess
affd52be0e response 2012-06-09 17:07:40 -04:00
http://rmunn.myopenid.com/
6c8f76ca28 New idea: using youtube-dl to download video URLs 2012-06-09 18:54:14 +00:00
Joey Hess
6703892e83 reord 2012-05-26 21:24:43 -04:00
https://launchpad.net/~ojwb
09fbc215e8 typo fixes 2012-05-24 05:07:07 +00:00
https://www.google.com/accounts/o8/id?id=AItOawk5cj-itfFHq_yhJHdzk3QOPp-PNW_MjPU
1b1703c84c Added a comment: +1 Cygwin 2012-05-23 19:30:22 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkRITTYYsN0TFKN7G5sZ6BWGZOTQ88Pz4s
b261d09637 Added a comment: cygwin 2012-05-15 00:14:10 +00:00
Joey Hess
f8fc79cf58 fixed 2012-04-22 01:16:08 -04:00
Joey Hess
5fbe83f595 add 2012-04-22 00:07:21 -04:00
Joey Hess
49a95f151c add a todo item 2012-04-12 17:51:16 -04:00
Joey Hess
59e2feeda1 Merge branch 'master' into bloom
Conflicts:
	doc/todo/git-annex_unused_eats_memory.mdwn
2012-03-12 16:33:16 -04:00
Joey Hess
6a95240dff note fixed 2012-03-12 16:32:54 -04:00
Joey Hess
8540183a02 close 2012-03-12 16:31:41 -04:00
Joey Hess
b086e32c63 unused: Reduce memory usage significantly.
Much of the memory bloat turned out to be due to getKeysReferenced
containing a mapM, which is strict and buffered the whole list
rather than streaming it.

The other half of the bloat was due to building a temporary Set
in order to call S.difference. While that is more cpu efficient,
I switched to successive S.delete, since with it, I can run a whole
git annex unused in less than 8 mb of memory.

The whole Set of keys with content available is still stored in memory,
so running unused in a repo with a whole lot of file content will still
use more memory. In a repo containing 6000 files, it needed 40 mb.

Note that the status command still uses the bloatful getKeysReferenced.
2012-03-11 16:24:07 -04:00
Joey Hess
e76988f6c2 add 2012-02-14 16:28:16 -04:00
Joey Hess
39e887e8e6 update; unix-compat gets some of the way 2012-02-02 10:56:23 -04:00
Joey Hess
bc130e355e close 2012-01-24 16:22:24 -04:00
Joey Hess
47250a153a ssh connection caching
Ssh connection caching is now enabled automatically by git-annex. Only one
ssh connection is made to each host per git-annex run, which can speed some
things up a lot, as well as avoiding repeated password prompts. Concurrent
git-annex processes also share ssh connections. Cached ssh connections are
shut down when git-annex exits.

Note: The rsync special remote does not yet participate in the ssh
connection caching.
2012-01-20 17:14:56 -04:00
Joey Hess
e96726caa3 better design
Avoids possible repeated password prompts, at the cost of a small bit of
locking complication.
2012-01-19 21:15:13 -04:00
Joey Hess
3783ccf252 design 2012-01-19 20:41:20 -04:00
Joey Hess
50c063df06 add 2012-01-18 17:30:21 -04:00
Joey Hess
de96ee7208 thought 2012-01-18 16:19:57 -04:00
Joey Hess
f4ddecd322 move windows support to a todo item
not holding my breath on this one..
2012-01-13 13:55:14 -04:00
Joey Hess
85f1f3a63a Updated to build with monad-control 0.3. 2011-12-24 23:05:23 -04:00
http://joey.kitenet.net/
cbaf13e587 Added a comment 2011-12-23 18:02:24 +00:00
http://joey.kitenet.net/
d5889f8271 Added a comment 2011-12-23 17:52:21 +00:00
http://adamspiers.myopenid.com/
d3e80eabe8 Added a comment 2011-12-23 17:22:12 +00:00
http://joey.kitenet.net/
0df51acc52 2011-12-23 16:20:43 +00:00
http://joey.kitenet.net/
538665f477 Added a comment 2011-12-23 16:07:39 +00:00
Joey Hess
8a2105c90a Merge branch 'master' of ssh://git-annex.branchable.com 2011-12-23 11:34:10 -04:00
Joey Hess
7227dd8f21 add escape_var hack
Makes it easy to find files with duplicate contents, anyway.. :)
2011-12-23 01:08:19 -04:00
Joey Hess
13a0c292b3 update example to actually work with new --format option 2011-12-23 01:08:19 -04:00
http://adamspiers.myopenid.com/
c02605919b Added a comment: How much memory would it actually use anyway? 2011-12-22 20:15:23 +00:00
http://adamspiers.myopenid.com/
38ad1065c9 Added a comment 2011-12-22 20:04:21 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlrnOT_XLcNNtmIwVdAJCJYu1BwAAOYtBI
1071a3cf02 2011-12-22 19:21:50 +00:00
http://joey.kitenet.net/
30cf6ce81c Added a comment 2011-12-22 16:39:24 +00:00
http://adamspiers.myopenid.com/
6808b08c1a Added a comment: Here's a Perl version 2011-12-22 15:43:52 +00:00
http://adamspiers.myopenid.com/
97bef4af73 Added a comment: List the duplicate filenames, then let the user decide what to do 2011-12-22 12:31:36 +00:00
Joey Hess
38b02de1a8 update 2011-12-15 15:21:03 -04:00
Joey Hess
20d729514a added a branch for the new monad-control 0.3 2011-12-05 22:54:30 -04:00
Joey Hess
2a1e3bceb3 respond 2011-12-05 15:42:02 -04:00
Joey Hess
fd5c979121 fixed a long time ago 2011-12-05 15:38:04 -04:00
http://peter-simons.myopenid.com/
622c2b9b8b 2011-12-05 19:13:20 +00:00
http://peter-simons.myopenid.com/
04e5bf3644 2011-12-05 19:09:14 +00:00
Joey Hess
3953f7ab81 idea 2011-12-01 17:40:26 -04:00
Joey Hess
e83b966eb5 cleanup 2011-11-15 23:51:24 -04:00
Joey Hess
04edae6791 Optimised union merging; now only runs git cat-file once. 2011-11-12 17:45:12 -04:00
Joey Hess
e9bfa8eaed avoid unnecessary auto-merge when only changing a file in the branch.
Avoids doing auto-merging in commands that don't need fully current
information from the git-annex branch. In particular, git annex add no
longer needs to auto-merge. Affected commands: Anything that doesn't
look up data from the branch, but does write a change to it.

It might seem counterintuitive that we can change a value without first
making sure we have the current value. This optimisation works because
these two sequences are equivilant:

1. pull from remote
2. union merge
3. read file from branch
4. modify file and write to branch

vs.

1. read file from branch
2. modify file and write to branch
3. pull from remote
4. union merge

After either sequence, the git-annex branch contains the same logical content
for the modified file. (Possibly with lines in a different order or
additional old lines of course).
2011-11-12 15:15:57 -04:00
Joey Hess
fe4ad93e4a add 2011-11-12 14:46:32 -04:00
Joey Hess
6e946b9a39 add 2011-11-12 14:24:14 -04:00
Joey Hess
05b7608113 update 2011-11-08 01:27:06 -04:00
Joey Hess
1530eac312 closures 2011-10-30 16:57:20 -04:00
Joey Hess
3cf811ead0 update; status is no longer slow 2011-10-30 16:49:49 -04:00
Joey Hess
22e9f445ab unused, dropunused: Now work in bare repositories.
Turned out I had already done all the work needed to support this when
unused started checking all branches.
2011-10-29 19:16:45 -04:00
Joey Hess
c102e63595 status: clean up for bare repositories
The backend usage graph shows present keys as well as keys found in the
repository tree, so it will also be populated for bare repositories.

Changed wording to "visible annex keys", which explains why it's 0 in
a bare repository (no keys visible as no tree), and also why it varies
depending on which branch is checked out. This seemed better than doing
something expensive to look up keys from the git-annex branch.
2011-10-29 19:06:49 -04:00
Joey Hess
2566eb85fe fsck: Now works in bare repositories.
Checks location log information, and file contents.

Does not check that numcopies is satisfied, as .gitattributes information
about numcopies is not available in a bare repository. In practice, that
should not be a problem, since fsck is also run in a checkout and will
check numcopies there.
2011-10-29 18:03:28 -04:00
Joey Hess
2eefc58070 status too 2011-10-27 14:55:06 -04:00
https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U
12a0a45fb1 2011-10-25 21:40:30 +00:00
Joey Hess
e2853b3fec update 2011-10-25 11:39:15 -07:00
Joey Hess
81fe6f775c close 2011-10-17 14:17:18 -04:00
Joey Hess
279150ccd5 update 2011-10-15 13:30:04 -04:00
Joey Hess
bae3008d17 add a copy of my mailing list post 2011-10-15 13:17:00 -04:00
Joey Hess
c867ae842a add 2011-10-15 13:13:57 -04:00
Joey Hess
8ea48c3e39 update docs 2011-09-18 20:56:37 -04:00
Joey Hess
756338fb2e idea 2011-09-17 18:37:38 -04:00
Joey Hess
f600444ab6 unused --remote: Reduced memory use to 1/4th what was used before.
Using a single strictness annotation, in just the right place.
Tried several others, none of which helped and some of which potentially
hurt. This is only the second time I've really had to deal with this in
a year of using haskell, which is, I suppose not that bad.
2011-08-31 19:13:02 -04:00
Joey Hess
b96443364e smudge update: Not practical. 2011-08-30 13:29:07 -04:00
Joey Hess
5ef11350aa link to patch 2011-08-29 16:41:47 -04:00
Joey Hess
cd199e442f update; showstopper issue with current git
developed a patch for git, we'll see if they like it..
2011-08-29 16:31:47 -04:00