From 4645f836781fd1db91c2b64138d441508a2bb847 Mon Sep 17 00:00:00 2001 From: Joey Hess Date: Wed, 15 Feb 2012 14:34:40 -0400 Subject: add tips --- doc/scalability.mdwn | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/doc/scalability.mdwn b/doc/scalability.mdwn index 71e21ac4c..232a84cc6 100644 --- a/doc/scalability.mdwn +++ b/doc/scalability.mdwn @@ -29,3 +29,16 @@ git-annex is designed for scalability. The key points are: * It can use as much, or as little bandwidth as is available. In particular, any interrupted file transfer can be resumed by git-annex. + +## scalability tips + +* If the files are so big that checksumming becomes a bottleneck, consider + using the [[WORM_backend|backends]]. You can always `git annex migrate` + files to a checksumming backend later on. + +* If you're adding a huge number of files at once (hundreds of thousands), + you'll soon notice that git-annex periodically stops and say + "Recording state in git" while it runs a `git add` command that + becomes increasingly expensive. Consider adjusting the `annex.queuesize` + to a higher value, at the expense of it using more memory. + -- cgit v1.2.3