summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* convert ddar to new ChunkedEncryptable API (but do not support chunking)Gravatar Joey Hess2014-08-02
| | | | | | Since ddar de-deuplicates, I assume there is no benefit from chunking. This has not been tested!
* convert bup to new ChunkedEncryptable API (but do not support chunking)Gravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | | | | | bup already splits files and does rolling deltas, so there is no reason to use chunking here. The new API made it easier to add progress support for storeKey, so that's done. Unfortunately, bup-split still outputs its own progress with -q, so a little ugly, but not too bad. Made dropping remove the branch for an object, for two reasons: 1. The new API calls removeKey to roll back a storeKey when the content changed unexpectedly. 2. So that testremote will be happy. Also, fixed a bug that caused a crash when removing the branch for an object in rollback.
* Merge branch 'master' into newchunksGravatar Joey Hess2014-08-02
|\
* | hook: use ChunkedEncryptableGravatar Joey Hess2014-08-02
| |
* | document that encryption + bup = inneficientGravatar Joey Hess2014-08-02
| |
* | convert glacier to new ChunkedEncryptable API (but do not support chunking)Gravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | | | Chunking would complicate the assistant's code that checks when a pending retrieval of a key from glacier is done. It would perhaps be nice to support it to allow resuming, but not right now. Converting to the new API still simplifies the code.
* | S3: support chunkingGravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | The assistant defaults to 1MiB chunk size for new S3 special remotes. Which will work around a couple of bugs: http://git-annex.branchable.com/bugs/S3_memory_leaks/ http://git-annex.branchable.com/bugs/S3_upload_not_using_multipart/
* | specialize Preparer a bit, so resourcePrepare can be addedGravatar Joey Hess2014-08-02
| | | | | | | | | | | | | | The forall a. in Preparer made resourcePrepare not seem to be usable, so I specialized a to Bool. Which works for both Preparer Storer and Preparer Retriever, but wouldn't let the Preparer be used for hasKey as it currently stands.
| * update roadmapGravatar Joey Hess2014-08-01
| |
| * typographyGravatar Joey Hess2014-08-01
| |
| * document testremoteGravatar Joey Hess2014-08-01
| |
| * Merge branch 'newchunks'Gravatar Joey Hess2014-08-01
| |\ | |/ |/| | | I am happy enough with this to make it live!
| * Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-08-01
| |\
| * | devblogGravatar Joey Hess2014-08-01
| | |
* | | testremote now tests with and without encryptionGravatar Joey Hess2014-08-01
| | |
* | | fix example external remote script to write files atomicallyGravatar Joey Hess2014-08-01
| | |
* | | minor optimisationGravatar Joey Hess2014-08-01
| | |
* | | testremote: Test retrieveKeyFile resumeGravatar Joey Hess2014-08-01
| | | | | | | | | | | | | | | | | | | | | And fixed a bug found by these tests; retrieveKeyFile would fail when the dest file was already complete. This commit was sponsored by Bradley Unterrheiner.
* | | improve testremote command, adding chunk size testingGravatar Joey Hess2014-08-01
| | | | | | | | | | | | And also a --size parameter to configure the basic object size.
* | | deriving ShowGravatar Joey Hess2014-08-01
| | |
* | | fix a fenchpost bug when resuming chunked store at endGravatar Joey Hess2014-08-01
| | | | | | | | | | | | Discovered thanks to testremote command!
* | | fix chunk=0Gravatar Joey Hess2014-08-01
| | | | | | | | | | | | Found by testremote
* | | testremote: New command to test uploads/downloads to a remote.Gravatar Joey Hess2014-08-01
| | | | | | | | | | | | | | | | | | | | | | | | | | | This only performs some basic tests so far; no testing of chunking or resuming. Also, the existing encryption type of the remote is used; it would be good later to derive an encrypted and a non-encrypted version of the remote and test them both. This commit was sponsored by Joseph Liu.
| | * (no commit message)Gravatar gernot2014-08-01
| | |
* | | add new section for testing commandsGravatar Joey Hess2014-08-01
| | |
| | * Added a commentGravatar https://www.google.com/accounts/o8/id?id=AItOawmAINLSovhWM_4_KrbngOcxduIbBuKv8ZA2014-08-01
| | |
| | * Added a commentGravatar Xyem2014-08-01
| | |
| | * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawmAINLSovhWM_4_KrbngOcxduIbBuKv8ZA2014-08-01
| | |
| | * Added a commentGravatar zardoz2014-07-31
| | |
| | * Add tip to make Firefox behave as expected when opening annexed HTML documents.Gravatar zardoz2014-07-31
| | |
| | * Added a comment: Bug still validGravatar https://www.google.com/accounts/o8/id?id=AItOawm8BAEUyzYhORZmMuocRTk4M-3IumDm5VU2014-07-31
| | |
| | * typoGravatar http://olivier.mehani.name/2014-07-31
| | |
| | * Added a commentGravatar https://www.google.com/accounts/o8/id?id=AItOawn-TDneVW-8kwb1fyTRAJfH3l1xs2VSEmk2014-07-30
| | |
| | * Added a commentGravatar https://www.google.com/accounts/o8/id?id=AItOawmwjQzWgiD7_I3zw-_91rMRf_6qoThupis2014-07-30
| | |
| * | Display exception message when a transfer fails due to an exception.Gravatar Joey Hess2014-07-30
| |/ | | | | | | | | | | For example, I had a copy to a remote that was failing for an unknown reason. This let me see the exception was createDirectory: permission denied; the underlying problem being a permissions issue.
* | chunk size adviceGravatar Joey Hess2014-07-30
| |
| * Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2014-07-30
| |\
| * | add missing Ord constraint (fixes android build)Gravatar Joey Hess2014-07-30
| | | | | | | | | | | | | | | Probably the new ghc used on android is the root cause of needing this constraint.
* | | WebDAV: Dropped support for DAV before 0.6.1.Gravatar Joey Hess2014-07-30
| | | | | | | | | | | | | | | 0.6.1 is in testing, and stable does not have DAV at all, so I can dispense with this compatability code
| | * Added a comment: interesting ideaGravatar http://joeyh.name/2014-07-30
| | |
| | * Added a commentGravatar http://joeyh.name/2014-07-30
| | |
| * | mention possibility of parallel chunk upload/downloadGravatar Joey Hess2014-07-30
| |/
* | only chunk stable keysGravatar Joey Hess2014-07-30
| | | | | | | | | | | | The content of unstable keys can potentially be different in different repos, so eg, resuming a chunked upload started by another repo would corrupt data.
| * devblogGravatar Joey Hess2014-07-29
| |
* | update progress after each chunk, at leastGravatar Joey Hess2014-07-29
| | | | | | | | | | | | This way, when the remote implementation neglects to update progress, there will still be a somewhat useful progress display, as long as chunks are used.
* | fix cleanup of FileContents once done when them when retrievingGravatar Joey Hess2014-07-29
| |
* | optimise case of remote that retrieves FileContent, when chunks and ↵Gravatar Joey Hess2014-07-29
| | | | | | | | | | | | | | | | | | | | encryption are not being used No need to read whole FileContent only to write it back out to a file in this case. Can just rename! Yay. Also indidentially, fixed an attempt to open a file for write that was already opened for write, which caused a crash and deadlock.
* | support chunking for all external special remotes!Gravatar Joey Hess2014-07-29
| | | | | | | | | | | | | | Removing code and at the same time adding great features, including upload/download resuming. This commit was sponsored by Romain Lenglet.
* | better type for RetrieverGravatar Joey Hess2014-07-29
| | | | | | | | | | | | | | | | Putting a callback in the Retriever type allows for the callback to remove the retrieved file when it's done with it. I did not really want to make Retriever be fixed to Annex Bool, but when I tried to use Annex a, I got into some type of type mess.
* | allow Retriever action to update the progress meterGravatar Joey Hess2014-07-29
| | | | | | | | | | | | | | | | Needed for eg, Remote.External. Generally, any Retriever that stores content in a file is responsible for updating the meter, while ones that procude a lazy bytestring cannot update the meter, so are not asked to.