update does for chunking

This commit is contained in:
Joey Hess 2014-07-26 23:39:51 -04:00
parent 9a8c4bb21f
commit 7db60269eb
4 changed files with 31 additions and 17 deletions

22
doc/chunking.mdwn Normal file
View file

@ -0,0 +1,22 @@
Some [[special_remotes]] have support for breaking large files up into
chunks that are stored on the remote.
This can be useful to work around limitations on the size of files
on the remote.
Note that git-annex has to buffer chunks in memory before they are sent to
a remote. So, using a large chunk size will make it use more memory.
To enable chunking, pass a `chunk=XXmb` parameter to `git annex
initremote`.
To disable chunking of a remote that was using chunking,
pass `chunk=0` to `git annex enableremote`. Any content already stored on
the remote using chunks will continue to be accessed via chunks, this
just prevents using chunks when storing new content.
To change the chunk size, pass a `chunk=XXmb` parameter to
`git annex enableremote`. This only affects the chunk sized used when
storing new content.
See also: [[design document|design/assistant/chunks]]

View file

@ -25,13 +25,7 @@ remote:
* `keyid` - Specifies the gpg key to use for [[encryption]].
* `chunk` - Avoid storing files larger than the specified size in the
directory. For use on directories on mount points that have file size
limitations. The default is to never chunk files.
The value can use specified using any commonly used units.
Example: `chunk=100 megabytes`
Note that chunking can be disabled later by setting chunk=0,
and can also safely be changed to a different size as needed.
* `chunk` - Enables [[chunking]] when storing large files.
* `chunksize` - Deprecated version of chunk parameter above.
Do not use for new remotes. It is not safe to change the chunksize

View file

@ -29,13 +29,11 @@ the webdav remote.
be created as needed. Use of a https URL is strongly
encouraged, since HTTP basic authentication is used.
* `chunksize` - Avoid storing files larger than the specified size in
WebDAV. For use when the WebDAV server has file size
limitations. The default is to never chunk files.
The value can use specified using any commonly used units.
Example: `chunksize=75 megabytes`
Note that enabling chunking on an existing remote with non-chunked
files is not recommended, nor is changing the chunksize.
* `chunk` - Enables [[chunking]] when storing large files.
* `chunksize` - Deprecated version of chunk parameter above.
Do not use for new remotes. It is not safe to change the chunksize
setting of an existing remote.
Setup example:

View file

@ -5,9 +5,9 @@ for providing 50 gb of free storage if you sign up with its Android client.
git-annex can use Box as a [[special remote|special_remotes]].
Recent versions of git-annex make this very easy to set up:
WEBDAV_USERNAME=you@example.com WEBDAV_PASSWORD=xxxxxxx git annex initremote box.com type=webdav url=https://dav.box.com/dav/git-annex chunksize=75mb encryption=shared
WEBDAV_USERNAME=you@example.com WEBDAV_PASSWORD=xxxxxxx git annex initremote box.com type=webdav url=https://dav.box.com/dav/git-annex chunk=50mb encryption=shared
Note the use of chunksize; Box has a 100 mb maximum file size, and this
Note the use of [[chunking]]; Box has a 100 mb maximum file size, and this
breaks up large files into chunks before that limit is reached.
# old davfs2 method
@ -58,7 +58,7 @@ Create the special remote, in your git-annex repository.
** This example is non-encrypted; fill in your gpg key ID for a securely
encrypted special remote! **
git annex initremote box.com type=directory directory=/media/box.com chunksize=2mb encryption=none
git annex initremote box.com type=directory directory=/media/box.com chunk=2mb encryption=none
Now git-annex can copy files to box.com, get files from it, etc, just like
with any other special remote.