summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Merge branch 'master' into newchunksGravatar Joey Hess2014-08-03
|\
| * testremote --fastGravatar Joey Hess2014-08-03
| |
* | convert gcrypt to new regime, including chunkingGravatar Joey Hess2014-08-03
| | | | | | | | Some reorg of Remote.Rsync code to export the things gcrypt needs.
* | finish making rsync support chunkingGravatar Joey Hess2014-08-03
| | | | | | | | | | This breaks gcrypt, which relies on some internals of the rsync remote. To fix next..
* | move ugly rsync zombie workaroundGravatar Joey Hess2014-08-03
| | | | | | | | | | | | | | | | | | | | | | | | This reaping of any processes came to cause me problems when redoing the rsync special remote -- a gpg process that was running gets waited on and the place that then checks its return code fails. I cannot reproduce any zombies when using the rsync special remote. But I still can when using a normal git remote, accessed over ssh. There is 1 zombie per file downloaded without this horrible hack enabled. So, move the hack to only be used in that case.
* | remove redundant progress meter display codeGravatar Joey Hess2014-08-03
| | | | | | | | specialRemote handles all meter display, so this is redundant.
* | roll ChunkedEncryptable into Special and improve interfaceGravatar Joey Hess2014-08-03
| | | | | | | | Allow disabling progress displays, for eg, rsync.
* | rsync: support chunkingGravatar Joey Hess2014-08-03
| | | | | | | | | | Chunking does not speed up rsync at all, so it's only useful for interop with the directory special remote.
* | Merge branch 'master' into newchunksGravatar Joey Hess2014-08-03
|\|
| * formattingGravatar Joey Hess2014-08-03
| |
| * Added a commentGravatar http://joeyh.name/2014-08-03
| |
| * Added a commentGravatar http://joeyh.name/2014-08-03
| |
| * Added a commentGravatar http://joeyh.name/2014-08-03
| |
| * (no commit message)Gravatar zardoz2014-08-03
| |
* | whitespaceGravatar Joey Hess2014-08-03
| |
* | better byteRetrieverGravatar Joey Hess2014-08-03
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Make the byteRetriever be passed the callback that consumes the bytestring. This way, there's no worries about the lazy bytestring not all being read when the resource that's creating it is closed. Which in turn lets bup, ddar, and S3 each switch from using an unncessary fileRetriver to a byteRetriever. So, more efficient on chunks and encrypted files. The only remaining fileRetrievers are hook and external, which really do retrieve to files.
| * Added a comment: Would you accept a patch?Gravatar https://www.google.com/accounts/o8/id?id=AItOawmkuFJVGp6WVvJtIV5JYb8IqN8mRvSGQdI2014-08-03
| |
| * Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-08-02
| |\
| * | correctionGravatar Joey Hess2014-08-02
| | |
| | * Added a commentGravatar http://joeyh.name/2014-08-02
| |/
| * Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-08-02
| |\
| | * Added a commentGravatar http://joeyh.name/2014-08-02
| | |
| * | devblogGravatar Joey Hess2014-08-02
| | |
* | | convert ddar to new ChunkedEncryptable API (but do not support chunking)Gravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | | | | | Since ddar de-deuplicates, I assume there is no benefit from chunking. This has not been tested!
| | * (no commit message)Gravatar divB2014-08-02
| | |
* | | convert bup to new ChunkedEncryptable API (but do not support chunking)Gravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | bup already splits files and does rolling deltas, so there is no reason to use chunking here. The new API made it easier to add progress support for storeKey, so that's done. Unfortunately, bup-split still outputs its own progress with -q, so a little ugly, but not too bad. Made dropping remove the branch for an object, for two reasons: 1. The new API calls removeKey to roll back a storeKey when the content changed unexpectedly. 2. So that testremote will be happy. Also, fixed a bug that caused a crash when removing the branch for an object in rollback.
* | | Merge branch 'master' into newchunksGravatar Joey Hess2014-08-02
|\| |
* | | hook: use ChunkedEncryptableGravatar Joey Hess2014-08-02
| | |
* | | document that encryption + bup = inneficientGravatar Joey Hess2014-08-02
| | |
* | | convert glacier to new ChunkedEncryptable API (but do not support chunking)Gravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | | | | | | | | | | | Chunking would complicate the assistant's code that checks when a pending retrieval of a key from glacier is done. It would perhaps be nice to support it to allow resuming, but not right now. Converting to the new API still simplifies the code.
| | * (no commit message)Gravatar divB2014-08-02
| | |
| | * (no commit message)Gravatar divB2014-08-02
| | |
| | * (no commit message)Gravatar divB2014-08-02
| | |
| | * (no commit message)Gravatar divB2014-08-02
| | |
| | * (no commit message)Gravatar divB2014-08-02
| | |
| | * (no commit message)Gravatar divB2014-08-02
| | |
* | | S3: support chunkingGravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | | | | | | | | The assistant defaults to 1MiB chunk size for new S3 special remotes. Which will work around a couple of bugs: http://git-annex.branchable.com/bugs/S3_memory_leaks/ http://git-annex.branchable.com/bugs/S3_upload_not_using_multipart/
* | | specialize Preparer a bit, so resourcePrepare can be addedGravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | | | | | | | | The forall a. in Preparer made resourcePrepare not seem to be usable, so I specialized a to Bool. Which works for both Preparer Storer and Preparer Retriever, but wouldn't let the Preparer be used for hasKey as it currently stands.
| | * Added a commentGravatar zardoz2014-08-02
| | |
| | * (no commit message)Gravatar zardoz2014-08-02
| | |
| | * some progress. maybe.Gravatar https://id.koumbit.net/anarcat2014-08-02
| | |
| * | update roadmapGravatar Joey Hess2014-08-01
| | |
| * | typographyGravatar Joey Hess2014-08-01
| | |
| | * removedGravatar http://joeyh.name/2014-08-01
| |/
| * document testremoteGravatar Joey Hess2014-08-01
| |
| * Merge branch 'newchunks'Gravatar Joey Hess2014-08-01
| |\ | |/ |/| | | I am happy enough with this to make it live!
| * Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-08-01
| |\
| * | devblogGravatar Joey Hess2014-08-01
| | |
* | | testremote now tests with and without encryptionGravatar Joey Hess2014-08-01
| | |
* | | fix example external remote script to write files atomicallyGravatar Joey Hess2014-08-01
| | |