git-annex/doc/devblog/day_132__database_musings.mdwn

18 lines
976 B
Text
Raw Normal View History

2014-03-12 22:20:32 +00:00
Updated the Debian stable backport to the last release. Also it seems that
the last release unexpectedly fixed XMPP SIGILL on some OSX machines.
Apparently when I rebuilt all the libraries recently, it somehow fixed that
[[old_unsolved_bug|bugs/Share_with_friends_crash_in_osx]].
2014-03-15 07:16:46 +00:00
[RichiH](http://richardhartmann.de/) suggested "wrt ballooning memory on
repair: can you read in broken
2014-03-12 22:20:32 +00:00
stuff and simply stop reading once you reach a certain threshold, then
start repairing, re-run fsck, etc?" .. I had considered that but was
not sure it would work. I think I've gotten it to work.
Now working on a design for using a [[design/caching_database]]
2014-03-15 07:16:46 +00:00
for some parts of git-annex. My initial benchmarks using SQLite
2014-03-12 22:20:32 +00:00
indicate it would slow down associated file lookups by nearly an order of
magnitude compared with the current ".map files" implementation.
2014-03-15 07:16:46 +00:00
(But would scale better in edge cases). OTOH, using a SQLite
2014-03-12 22:20:32 +00:00
database to index metadata for use in views looks very promising.