summaryrefslogtreecommitdiff
path: root/doc/devblog/day_132__database_musings.mdwn
blob: 559ad8685b43eece8dce9a4e62e1216a130d11ad (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
Updated the Debian stable backport to the last release. Also it seems that
the last release unexpectedly fixed XMPP SIGILL on some OSX machines.
Apparently when I rebuilt all the libraries recently, it somehow fixed that
[[old_unsolved_bug|bugs/Share_with_friends_crash_in_osx]].

RichiH suggested "wrt balloning memory on repair: can you read in broken
stuff and simply stop reading once you reach a certain threshold, then
start repairing, re-run fsck, etc?" .. I had considered that but was
not sure it would work. I think I've gotten it to work.

Now working on a design for using a [[design/caching_database]]
for some parts of git-annex. My initial benchmarks using sqlite
indicate it would slow down associated file lookups by nearly an order of
magnitude compared with the current ".map files" implementation.
(But would scale better in edge cases). OTOH, using a sqlite
database to index metadata for use in views looks very promising.