From 412b09e17e31fe671aa0a9f17af5ca2f8d40d158 Mon Sep 17 00:00:00 2001 From: Joey Hess Date: Fri, 10 Jul 2020 15:23:12 -0400 Subject: [PATCH] update --- ...logs_for_speed_with_cat-file_--buffer.mdwn | 20 ++++++++----------- 1 file changed, 8 insertions(+), 12 deletions(-) diff --git a/doc/todo/precache_logs_for_speed_with_cat-file_--buffer.mdwn b/doc/todo/precache_logs_for_speed_with_cat-file_--buffer.mdwn index cf5be8d51f..71d41f4f40 100644 --- a/doc/todo/precache_logs_for_speed_with_cat-file_--buffer.mdwn +++ b/doc/todo/precache_logs_for_speed_with_cat-file_--buffer.mdwn @@ -20,15 +20,11 @@ annexed but in git; don't want to cat those when looking for annex links. That would probably need pre-filtering through a cat-file --buffer that only gets the size of the blob, not its content. -> WIP implementation in the `streamkeys` branch is a win! Nearly 2x faster -> `git-annex get` seeking. It needs more work, to avoid catting large -> non-annexex files. -> -> And, only `git-annex get` uses it, other commands need to be converted. -> -> Also, limits that look up keys still do, before they're looked up -> efficiently. Avoiding that would speed up --in etc, probably another -> 1.5x-2x speedup when such limits are used. What that optimisation needs -> is a way to tell if the current limit needs the key or not. -> If it does, then match on it after getting the key, otherwise before -> getting the key. +> This was a win! Nearly 2x faster `git-annex get` seeking. + +Also, limits that look up keys still do, before the keys are looked up +efficiently. Avoiding that would speed up --in etc, probably another +1.5x-2x speedup when such limits are used. What that optimisation needs +is a way to tell if the current limit needs the key or not. +If it does, then match on it after getting the key, otherwise before +getting the key.