diff options
author | 2011-05-17 12:14:46 -0400 | |
---|---|---|
committer | 2011-05-17 12:14:46 -0400 | |
commit | ebfa50b72959de4c4e917771c57b0efcea98e55b (patch) | |
tree | a2d9caf1c029bb89ece8e0dc04758d8398ccfe1a /doc/todo/tahoe_lfs_for_reals.mdwn | |
parent | 0bf1b36f116ff4744ad1cde74511e1a0202716ce (diff) |
add
Diffstat (limited to 'doc/todo/tahoe_lfs_for_reals.mdwn')
-rw-r--r-- | doc/todo/tahoe_lfs_for_reals.mdwn | 28 |
1 files changed, 28 insertions, 0 deletions
diff --git a/doc/todo/tahoe_lfs_for_reals.mdwn b/doc/todo/tahoe_lfs_for_reals.mdwn new file mode 100644 index 000000000..053a763d7 --- /dev/null +++ b/doc/todo/tahoe_lfs_for_reals.mdwn @@ -0,0 +1,28 @@ +[[forum/tips:_special__95__remotes__47__hook_with_tahoe-lafs]] is a good +start, but Zooko points out that using Tahoe's directory translation layer +incurs O(N^2) overhead as the number of objects grows. Also, making +hash subdirectories in Tahoe is expensive. Instead it would be good to use +it as a key/value store directly. The catch is that doing so involves +sending the content to Tahoe, and getting back a key identifier. + +This would be fairly easy to do as a [[backend]], which can assign its +own key names (although typically done before data is stored in it), +but a tahoe-lafs special remote would be more flexible. + +To support a special remote, a mapping is needed from git-annex keys to +Tahoe keys. + +The best place to store this mapping is perhaps as a new field in the +location log: + + date present repo-uuid newfields + +This way, each remote can store its own key-specfic data in the same place +as other key-specific data, with minimal overhead. + +Unfortunatly, the current location log parser throws out lines that it +cannot parse, so making this change would involve something of a flag day +upgrade. Also unfortunatly, the location log and other .git-annex/ data +does not have its own version that can be checked to force an upgrade +across all clones. It might be best to deal with this at the same time +the ideas in [[branching]] are done. --[[Joey]] |