mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions
git-annex/doc/todo
History
Joey Hess b086e32c63 unused: Reduce memory usage significantly. 
Much of the memory bloat turned out to be due to getKeysReferenced
containing a mapM, which is strict and buffered the whole list
rather than streaming it.

The other half of the bloat was due to building a temporary Set
in order to call S.difference. While that is more cpu efficient,
I switched to successive S.delete, since with it, I can run a whole
git annex unused in less than 8 mb of memory.

The whole Set of keys with content available is still stored in memory,
so running unused in a repo with a whole lot of file content will still
use more memory. In a repo containing 6000 files, it needed 40 mb.

Note that the status command still uses the bloatful getKeysReferenced.
2012-03-11 16:24:07 -04:00
..
auto_remotes clarify 2010-12-29 20:28:34 -04:00
cache_key_info Added a comment 2011-05-17 07:27:03 +00:00
object_dir_reorg_v2 Added a comment 2011-03-16 21:05:39 +00:00
parallel_possibilities Added a comment 2011-05-20 20:17:15 +00:00
smudge Added a comment: symlinks 2011-04-03 20:30:22 +00:00
tahoe_lfs_for_reals download urls via tmp file, and support resuming 2011-07-01 18:59:40 -04:00
wishlist:___34__git_annex_add__34___multiple_processes move wishlists to todo 2011-04-09 16:12:32 -04:00
wishlist:_Prevent_repeated_password_prompts_for_one_command Added a comment 2011-05-06 18:30:03 +00:00
wishlist:_Provide_a___34__git_annex__34___command_that_will_skip_duplicates Added a comment 2011-12-23 18:02:24 +00:00
wishlist:_swift_backend Added a comment 2011-05-14 15:00:51 +00:00
add_--exclude_option_to_git_annex_find.mdwn already exists 2010-12-29 20:30:03 -04:00
add_-all_option.mdwn update 2011-12-15 15:21:03 -04:00
add_a_git_backend.mdwn 2011-04-08 22:05:26 +00:00
auto_remotes.mdwn closures 2011-10-30 16:57:20 -04:00
avoid_unnecessary_union_merges.mdwn avoid unnecessary auto-merge when only changing a file in the branch. 2011-11-12 15:15:57 -04:00
backendSHA1.mdwn
branching.mdwn update 2011-06-22 17:56:07 -04:00
cache_key_info.mdwn update; status is no longer slow 2011-10-30 16:49:49 -04:00
checkout.mdwn
done.mdwn
exclude_files_on_a_given_remote.mdwn update docs 2011-09-18 20:56:37 -04:00
file_copy_progress_bar.mdwn rsync is now used when copying files from repos on other filesystems 2011-06-13 20:33:52 -04:00
fsck.mdwn close 2010-11-13 15:43:08 -04:00
fsck_special_remotes.mdwn close 2012-01-24 16:22:24 -04:00
git-annex-shell.mdwn git-annex-shell now exclusively used for all remote access 2010-12-31 19:09:17 -04:00
git-annex_unused_eats_memory.mdwn unused: Reduce memory usage significantly. 2012-03-11 16:24:07 -04:00
git_annex_init_:_include_repo_description_and__47__or_UUID_in_commit_message.mdwn close 2011-08-29 12:49:38 -04:00
gitolite_and_gitosis_support.mdwn close 2011-10-17 14:17:18 -04:00
gitrm.mdwn close 2010-11-15 18:42:32 -04:00
hidden_files.mdwn 2011-03-14 17:07:31 +00:00
immutable_annexed_files.mdwn
link_file_to_remote_repo_feature.mdwn 2011-12-23 16:20:43 +00:00
network_remotes.mdwn
object_dir_reorg_v2.mdwn update 2011-03-16 16:14:50 -04:00
optimise_git-annex_merge.mdwn cleanup 2011-11-15 23:51:24 -04:00
parallel_possibilities.mdwn update 2011-02-25 15:54:29 -04:00
Please_abort_build_if___34__make_test__34___fails.mdwn fixed a long time ago 2011-12-05 15:38:04 -04:00
Please_add_support_for_monad-control_0.3.x.mdwn Updated to build with monad-control 0.3. 2011-12-24 23:05:23 -04:00
pushpull.mdwn
redundancy_stats_in_status.mdwn add 2012-02-14 16:28:16 -04:00
rsync.mdwn Rsync will now be used to resume interrupted/failed partial file transfers from a remote. 2010-12-02 16:55:21 -04:00
S3.mdwn close 2011-05-17 12:19:52 -04:00
smudge.mdwn update 2011-10-25 11:39:15 -07:00
speed_up_fsck.mdwn Sped back up fsck, copy --from etc 2011-06-29 21:47:31 -04:00
support-non-utf8-locales.mdwn Rethink filename encoding handling for display. Since filename encoding may or may not match locale settings, any attempt to decode filenames will fail for some files. So instead, do all output in binary mode. 2011-03-12 15:30:17 -04:00
support_fsck_in_bare_repos.mdwn unused, dropunused: Now work in bare repositories. 2011-10-29 19:16:45 -04:00
support_S3_multipart_uploads.mdwn would be nice.. 2011-05-13 23:05:14 -04:00
symlink_farming_commit_hook.mdwn
tahoe_lfs_for_reals.mdwn Modify location log parser to allow future expansion. 2011-06-28 16:15:50 -04:00
union_mounting.mdwn
use_cp_reflink.mdwn Only use cp -a if it is supported, falling back to cp -p or plain cp. 2010-11-18 13:49:01 -04:00
using_url_backend.mdwn
windows_support.mdwn update; unix-compat gets some of the way 2012-02-02 10:56:23 -04:00
wishlist:___34__git_annex_add__34___multiple_processes.mdwn closures 2011-10-30 16:57:20 -04:00
wishlist:_Prevent_repeated_password_prompts_for_one_command.mdwn ssh connection caching 2012-01-20 17:14:56 -04:00
wishlist:_Provide_a___34__git_annex__34___command_that_will_skip_duplicates.mdwn add escape_var hack 2011-12-23 01:08:19 -04:00
wishlist:_support_for_more_ssh_urls_.mdwn move wishlists to todo 2011-04-09 16:12:32 -04:00
wishlist:_swift_backend.mdwn 2011-05-09 12:24:28 +00:00