summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
...
* | | Merge branch 'master' into newchunksGravatar Joey Hess2014-07-26
|\| |
| | * Added a commentGravatar https://www.google.com/accounts/o8/id?id=AItOawk9nck8WX8-ADF3Fdh5vFo4Qrw1I_bJcR82014-07-26
| |/
| * Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-07-25
| |\
| * | devblogGravatar Joey Hess2014-07-25
| | |
| * | Fix cost calculation for non-encrypted remotes.Gravatar Joey Hess2014-07-25
| | | | | | | | | | | | | | | | | | Encyptable types of remotes that were not actually encrypted still had the encryptedRemoteCostAdj applied to their configured cost, which was a bug.
* | | support new style chunking in directory special remoteGravatar Joey Hess2014-07-25
| | | | | | | | | | | | | | | | | | | | | Only when storing non-encrypted so far, not retrieving or checking if a key is present or removing. This commit was sponsored by Renaud Casenave-Péré.
* | | core implementation of new style chunkingGravatar Joey Hess2014-07-25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Not yet used by any special remotes, but should not be too hard to add it to most of them. storeChunks is the hairy bit! It's loosely based on Remote.Directory.storeLegacyChunked. The object is read in using a lazy bytestring, which is streamed though, creating chunks as needed, without ever buffering more than 1 chunk in memory. Getting the progress meter update to work right was also fun, since progress meter values are absolute. Finessed by constructing an offset meter. This commit was sponsored by Richard Collins.
* | | use same hash directories for chunked key as are used for its parentGravatar Joey Hess2014-07-25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This avoids a proliferation of hash directories when using new-style chunking, and should improve performance since chunks are accessed in sequence and so should have a common locality. Of course, when a chunked key is encrypted, its hash directories have no relation to the parent key. This commit was sponsored by Christian Kellermann.
* | | thought about chunk key hashingGravatar Joey Hess2014-07-25
|/ /
| * Added a commentGravatar https://www.google.com/accounts/o8/id?id=AItOawlVUq_c3-lrQBculOEUu3yjvdavE7JbvEI2014-07-25
| |
| * add a note about direct modeGravatar https://www.google.com/accounts/o8/id?id=AItOawnG_weCiH6IleQfVmRPmFJflHQMHdAcDkU2014-07-25
| |
| * file a bugGravatar https://www.google.com/accounts/o8/id?id=AItOawnG_weCiH6IleQfVmRPmFJflHQMHdAcDkU2014-07-25
|/
* improve a bitGravatar Joey Hess2014-07-24
|
* Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-07-24
|\
* | devblogGravatar Joey Hess2014-07-24
| |
* | move meteredWriteFileChunks out of legacyGravatar Joey Hess2014-07-24
| |
* | implement chunk logsGravatar Joey Hess2014-07-24
| | | | | | | | | | | | | | Slightly tricky as they are not normal UUIDBased logs, but are instead maps from (uuid, chunksize) to chunkcount. This commit was sponsored by Frank Thomas.
* | improve chunk data typesGravatar Joey Hess2014-07-24
| |
* | prepare for new style chunkingGravatar Joey Hess2014-07-24
| | | | | | | | | | | | | | | | | | | | | | | | Moved old legacy chunking code, and cleaned up the directory and webdav remotes use of it, so when no chunking is configured, that code is not used. The config for new style chunking will be chunk=1M instead of chunksize=1M. There should be no behavior changes from this commit. This commit was sponsored by Andreas Laas.
* | add chunk metadata to KeyGravatar Joey Hess2014-07-24
| | | | | | | | | | | | | | | | Added new fields for chunk number, and chunk size. These will not appear in normal keys ever, but will be used for chunked data stored on special remotes. This commit was sponsored by Jouni K Seppanen.
* | document new chunk logfilesGravatar Joey Hess2014-07-24
| |
* | clarify field order reqirementGravatar Joey Hess2014-07-24
| |
* | updateGravatar Joey Hess2014-07-24
| |
| * (no commit message)Gravatar Xyem2014-07-24
| |
* | chunk then encryptGravatar Joey Hess2014-07-23
| |
| * added gpg instructionsGravatar https://www.google.com/accounts/o8/id?id=AItOawlASRUX9jg2piT1lge4KkBU_ZGty6tvM5c2014-07-24
| |
| * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawmp_51DcIT2sqrOhtg7LgCj2Pyaa5ujxTI2014-07-23
| |
| * Added a commentGravatar markusk2014-07-23
| |
| * Added a commentGravatar http://joeyh.name/2014-07-23
|/
* Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-07-23
|\
* | linkGravatar Joey Hess2014-07-23
| |
* | devblogGravatar Joey Hess2014-07-23
| |
* | minorGravatar Joey Hess2014-07-23
| |
| * (no commit message)Gravatar markusk2014-07-23
| |
* | 4 designs for better chunkingGravatar Joey Hess2014-07-23
| | | | | | | | | | | | | | Having a hard time finding a way to totally obscure file sizes, but otherwise happy with design #4. This commit was sponsored by Michael Alan Dorman.
| * (no commit message)Gravatar markusk2014-07-23
| |
* | recommend users not change the chunksizeGravatar Joey Hess2014-07-23
| | | | | | | | | | | | | | Suppose A is 10 mb, and B is 20 mb, and the upload speed is the same. If B starts first, when A will overwrite the file it is uploading for the 1st chunk. Then A uploads the second chunk, and once A is done, B finishes the 1st chunk and uploads its second. We now have 1(from A), 2(from B), so data loss.
| * New bug using webapp with --listen=IP:PortGravatar markusk2014-07-23
| |
| * Added a commentGravatar http://joeyh.name/2014-07-23
| |
* | Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-07-23
|\|
| * Added a commentGravatar http://joeyh.name/2014-07-23
| |
* | close; not a git-annex bugGravatar Joey Hess2014-07-23
| |
| * Added a commentGravatar http://joeyh.name/2014-07-23
|/
* Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-07-23
|\
* | update per requestGravatar Joey Hess2014-07-23
| |
| * Added a comment: ok some progressGravatar https://www.google.com/accounts/o8/id?id=AItOawkt8DjG40gowj_ETchFLDS_Z216tr7p1xw2014-07-23
| |
| * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawkt8DjG40gowj_ETchFLDS_Z216tr7p1xw2014-07-23
| |
| * Added a commentGravatar divB2014-07-23
| |
| * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawnD-eBOHeC-94xRxJ10VZHT8t_4FbOLiPM2014-07-23
| |
| * Added a commentGravatar https://www.google.com/accounts/o8/id?id=AItOawmMLeU-zCzx2mc5pL2XT8a1UNkQwHAHjg82014-07-22
| |