mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions
git-annex/doc/todo
History
Joey Hess b086e32c63 unused: Reduce memory usage significantly. 
Much of the memory bloat turned out to be due to getKeysReferenced
containing a mapM, which is strict and buffered the whole list
rather than streaming it.

The other half of the bloat was due to building a temporary Set
in order to call S.difference. While that is more cpu efficient,
I switched to successive S.delete, since with it, I can run a whole
git annex unused in less than 8 mb of memory.

The whole Set of keys with content available is still stored in memory,
so running unused in a repo with a whole lot of file content will still
use more memory. In a repo containing 6000 files, it needed 40 mb.

Note that the status command still uses the bloatful getKeysReferenced.
2012-03-11 16:24:07 -04:00
..
auto_remotes clarify 2010-12-29 20:28:34 -04:00
cache_key_info Added a comment 2011-05-17 07:27:03 +00:00
object_dir_reorg_v2 Added a comment 2011-03-16 21:05:39 +00:00
parallel_possibilities Added a comment 2011-05-20 20:17:15 +00:00
smudge Added a comment: symlinks 2011-04-03 20:30:22 +00:00
tahoe_lfs_for_reals download urls via tmp file, and support resuming 2011-07-01 18:59:40 -04:00
wishlist:___34__git_annex_add__34___multiple_processes move wishlists to todo 2011-04-09 16:12:32 -04:00
wishlist:_Prevent_repeated_password_prompts_for_one_command Added a comment 2011-05-06 18:30:03 +00:00
wishlist:_Provide_a___34__git_annex__34___command_that_will_skip_duplicates Added a comment 2011-12-23 18:02:24 +00:00
wishlist:_swift_backend Added a comment 2011-05-14 15:00:51 +00:00
add_--exclude_option_to_git_annex_find.mdwn already exists 2010-12-29 20:30:03 -04:00
add_-all_option.mdwn update 2011-12-15 15:21:03 -04:00
add_a_git_backend.mdwn 2011-04-08 22:05:26 +00:00
auto_remotes.mdwn closures 2011-10-30 16:57:20 -04:00
avoid_unnecessary_union_merges.mdwn avoid unnecessary auto-merge when only changing a file in the branch. 2011-11-12 15:15:57 -04:00
backendSHA1.mdwn maybe call it unlock and not checkout 2010-11-09 15:11:45 -04:00
branching.mdwn update 2011-06-22 17:56:07 -04:00
cache_key_info.mdwn update; status is no longer slow 2011-10-30 16:49:49 -04:00
checkout.mdwn documentation for checkout 2010-11-07 21:02:25 -04:00
done.mdwn reorg 2010-10-25 11:47:45 -04:00
exclude_files_on_a_given_remote.mdwn update docs 2011-09-18 20:56:37 -04:00
file_copy_progress_bar.mdwn rsync is now used when copying files from repos on other filesystems 2011-06-13 20:33:52 -04:00
fsck.mdwn close 2010-11-13 15:43:08 -04:00
fsck_special_remotes.mdwn close 2012-01-24 16:22:24 -04:00
git-annex-shell.mdwn git-annex-shell now exclusively used for all remote access 2010-12-31 19:09:17 -04:00
git-annex_unused_eats_memory.mdwn unused: Reduce memory usage significantly. 2012-03-11 16:24:07 -04:00
git_annex_init_:_include_repo_description_and__47__or_UUID_in_commit_message.mdwn close 2011-08-29 12:49:38 -04:00
gitolite_and_gitosis_support.mdwn close 2011-10-17 14:17:18 -04:00
gitrm.mdwn close 2010-11-15 18:42:32 -04:00
hidden_files.mdwn 2011-03-14 17:07:31 +00:00
immutable_annexed_files.mdwn Annexed file contents are now made unwritable and put in unwriteable directories, to avoid them accidentially being removed or modified. (Thanks Josh Triplett for the idea.) 2010-11-08 19:26:37 -04:00
link_file_to_remote_repo_feature.mdwn 2011-12-23 16:20:43 +00:00
network_remotes.mdwn reorg 2010-10-25 11:47:45 -04:00
object_dir_reorg_v2.mdwn update 2011-03-16 16:14:50 -04:00
optimise_git-annex_merge.mdwn cleanup 2011-11-15 23:51:24 -04:00
parallel_possibilities.mdwn update 2011-02-25 15:54:29 -04:00
Please_abort_build_if___34__make_test__34___fails.mdwn fixed a long time ago 2011-12-05 15:38:04 -04:00
Please_add_support_for_monad-control_0.3.x.mdwn Updated to build with monad-control 0.3. 2011-12-24 23:05:23 -04:00
pushpull.mdwn done 2010-10-25 20:20:17 -04:00
redundancy_stats_in_status.mdwn add 2012-02-14 16:28:16 -04:00
rsync.mdwn Rsync will now be used to resume interrupted/failed partial file transfers from a remote. 2010-12-02 16:55:21 -04:00
S3.mdwn close 2011-05-17 12:19:52 -04:00
smudge.mdwn update 2011-10-25 11:39:15 -07:00
speed_up_fsck.mdwn Sped back up fsck, copy --from etc 2011-06-29 21:47:31 -04:00
support-non-utf8-locales.mdwn Rethink filename encoding handling for display. Since filename encoding may or may not match locale settings, any attempt to decode filenames will fail for some files. So instead, do all output in binary mode. 2011-03-12 15:30:17 -04:00
support_fsck_in_bare_repos.mdwn unused, dropunused: Now work in bare repositories. 2011-10-29 19:16:45 -04:00
support_S3_multipart_uploads.mdwn would be nice.. 2011-05-13 23:05:14 -04:00
symlink_farming_commit_hook.mdwn pre-commit hook 2010-10-27 14:33:44 -04:00
tahoe_lfs_for_reals.mdwn Modify location log parser to allow future expansion. 2011-06-28 16:15:50 -04:00
union_mounting.mdwn idea 2010-10-27 19:27:01 -04:00
use_cp_reflink.mdwn Only use cp -a if it is supported, falling back to cp -p or plain cp. 2010-11-18 13:49:01 -04:00
using_url_backend.mdwn reorg 2010-10-25 11:47:45 -04:00
windows_support.mdwn update; unix-compat gets some of the way 2012-02-02 10:56:23 -04:00
wishlist:___34__git_annex_add__34___multiple_processes.mdwn closures 2011-10-30 16:57:20 -04:00
wishlist:_Prevent_repeated_password_prompts_for_one_command.mdwn ssh connection caching 2012-01-20 17:14:56 -04:00
wishlist:_Provide_a___34__git_annex__34___command_that_will_skip_duplicates.mdwn add escape_var hack 2011-12-23 01:08:19 -04:00
wishlist:_support_for_more_ssh_urls_.mdwn move wishlists to todo 2011-04-09 16:12:32 -04:00
wishlist:_swift_backend.mdwn 2011-05-09 12:24:28 +00:00