aboutsummaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorGravatar Joey Hess <joey@kitenet.net>2014-07-26 23:39:51 -0400
committerGravatar Joey Hess <joey@kitenet.net>2014-07-26 23:39:51 -0400
commit07eb1e676829a20cb7bcc73a219f51b76daa4b3f (patch)
tree2437cd5a3e02c5c930cb92b11263ccc09dc23edc
parent748609e54c6bc6ca9d6ac68da04b8dd430416876 (diff)
update does for chunking
-rw-r--r--doc/chunking.mdwn22
-rw-r--r--doc/special_remotes/directory.mdwn8
-rw-r--r--doc/special_remotes/webdav.mdwn12
-rw-r--r--doc/tips/using_box.com_as_a_special_remote.mdwn6
4 files changed, 31 insertions, 17 deletions
diff --git a/doc/chunking.mdwn b/doc/chunking.mdwn
new file mode 100644
index 000000000..1be1fbef6
--- /dev/null
+++ b/doc/chunking.mdwn
@@ -0,0 +1,22 @@
+Some [[special_remotes]] have support for breaking large files up into
+chunks that are stored on the remote.
+
+This can be useful to work around limitations on the size of files
+on the remote.
+
+Note that git-annex has to buffer chunks in memory before they are sent to
+a remote. So, using a large chunk size will make it use more memory.
+
+To enable chunking, pass a `chunk=XXmb` parameter to `git annex
+initremote`.
+
+To disable chunking of a remote that was using chunking,
+pass `chunk=0` to `git annex enableremote`. Any content already stored on
+the remote using chunks will continue to be accessed via chunks, this
+just prevents using chunks when storing new content.
+
+To change the chunk size, pass a `chunk=XXmb` parameter to
+`git annex enableremote`. This only affects the chunk sized used when
+storing new content.
+
+See also: [[design document|design/assistant/chunks]]
diff --git a/doc/special_remotes/directory.mdwn b/doc/special_remotes/directory.mdwn
index de7ab904e..6279024ec 100644
--- a/doc/special_remotes/directory.mdwn
+++ b/doc/special_remotes/directory.mdwn
@@ -25,13 +25,7 @@ remote:
* `keyid` - Specifies the gpg key to use for [[encryption]].
-* `chunk` - Avoid storing files larger than the specified size in the
- directory. For use on directories on mount points that have file size
- limitations. The default is to never chunk files.
- The value can use specified using any commonly used units.
- Example: `chunk=100 megabytes`
- Note that chunking can be disabled later by setting chunk=0,
- and can also safely be changed to a different size as needed.
+* `chunk` - Enables [[chunking]] when storing large files.
* `chunksize` - Deprecated version of chunk parameter above.
Do not use for new remotes. It is not safe to change the chunksize
diff --git a/doc/special_remotes/webdav.mdwn b/doc/special_remotes/webdav.mdwn
index 871540a97..64eed5d0b 100644
--- a/doc/special_remotes/webdav.mdwn
+++ b/doc/special_remotes/webdav.mdwn
@@ -29,13 +29,11 @@ the webdav remote.
be created as needed. Use of a https URL is strongly
encouraged, since HTTP basic authentication is used.
-* `chunksize` - Avoid storing files larger than the specified size in
- WebDAV. For use when the WebDAV server has file size
- limitations. The default is to never chunk files.
- The value can use specified using any commonly used units.
- Example: `chunksize=75 megabytes`
- Note that enabling chunking on an existing remote with non-chunked
- files is not recommended, nor is changing the chunksize.
+* `chunk` - Enables [[chunking]] when storing large files.
+
+* `chunksize` - Deprecated version of chunk parameter above.
+ Do not use for new remotes. It is not safe to change the chunksize
+ setting of an existing remote.
Setup example:
diff --git a/doc/tips/using_box.com_as_a_special_remote.mdwn b/doc/tips/using_box.com_as_a_special_remote.mdwn
index ac59834f5..149d1f824 100644
--- a/doc/tips/using_box.com_as_a_special_remote.mdwn
+++ b/doc/tips/using_box.com_as_a_special_remote.mdwn
@@ -5,9 +5,9 @@ for providing 50 gb of free storage if you sign up with its Android client.
git-annex can use Box as a [[special remote|special_remotes]].
Recent versions of git-annex make this very easy to set up:
- WEBDAV_USERNAME=you@example.com WEBDAV_PASSWORD=xxxxxxx git annex initremote box.com type=webdav url=https://dav.box.com/dav/git-annex chunksize=75mb encryption=shared
+ WEBDAV_USERNAME=you@example.com WEBDAV_PASSWORD=xxxxxxx git annex initremote box.com type=webdav url=https://dav.box.com/dav/git-annex chunk=50mb encryption=shared
-Note the use of chunksize; Box has a 100 mb maximum file size, and this
+Note the use of [[chunking]]; Box has a 100 mb maximum file size, and this
breaks up large files into chunks before that limit is reached.
# old davfs2 method
@@ -58,7 +58,7 @@ Create the special remote, in your git-annex repository.
** This example is non-encrypted; fill in your gpg key ID for a securely
encrypted special remote! **
- git annex initremote box.com type=directory directory=/media/box.com chunksize=2mb encryption=none
+ git annex initremote box.com type=directory directory=/media/box.com chunk=2mb encryption=none
Now git-annex can copy files to box.com, get files from it, etc, just like
with any other special remote.