aboutsummaryrefslogtreecommitdiff
path: root/Logs
Commit message (Collapse)AuthorAge
...
* fixes for transfer resumeGravatar Joey Hess2012-09-24
| | | | | | | | | Fix resuming of downloads, which do not have a transfer info file to read. When checking upload progress, use the MVar, rather than re-reading the info file. Catch exceptions in the transfer action. Required a tryAnnex.
* changelog and minor cleanup to fix mixed spaces/tabsGravatar Joey Hess2012-09-23
|
* Merge remote-tracking branch 'npouillard/trustedcopies'Gravatar Joey Hess2012-09-23
|\
| * Limiting the number of copies per trustlevelGravatar Nicolas Pouillard2012-09-23
| | | | | | | | | | | | | | | | The --copies flag now takes an argument of the form: trustlevel:number or number If a trust level is specified the command is limited to files with at least 'number' copies of this 'trustlevel'.
* | make the assistant retry failed transfersGravatar Joey Hess2012-09-23
| | | | | | | | | | | | | | When a transfer fails, the progress info can be used to intelligently retry it. If the transfer managed to make some progress, but did not fully complete, then there's a good chance that a retry will finish it (or at least make more progress).
* | git-annex-shell transferinfo commandGravatar Joey Hess2012-09-21
| | | | | | | | | | TODO: Use this when running sendkey, to feed back transfer info from the client side rsync.
* | avoid updating transfer info file until another 1% of the total has been ↵Gravatar Joey Hess2012-09-21
| | | | | | | | transferred
* | unify typesGravatar Joey Hess2012-09-21
| |
* | fix reading of transfer info files with a bytesComplete valueGravatar Joey Hess2012-09-20
| |
* | add a progress callback to storeKey, and threaded it all the way throughGravatar Joey Hess2012-09-19
| | | | | | | | | | | | | | | | Transfer info files are updated when the callback is called, updating the number of bytes transferred. Left unused p variables at every place the callback should be used. Which is rather a lot..
* | make other repositories list list all autostarted reposGravatar Joey Hess2012-09-18
| | | | | | | | And add a form to add another, unrelated repository
* | cleanupGravatar Joey Hess2012-09-17
| |
* | flip catchDefaultIOGravatar Joey Hess2012-09-17
| |
* | Avoid crashing on encoding errors in filenames when writing transfer info ↵Gravatar Joey Hess2012-09-16
| | | | | | | | files and reading from checksum commands.
* | stupid typoGravatar Joey Hess2012-08-29
| |
* | when canceling a transfer, also cancel all other downloads of the same keyGravatar Joey Hess2012-08-29
| |
* | fix resume buttonGravatar Joey Hess2012-08-29
| | | | | | | | | | Change alterTransferInfo to not merge in old values, including transferPaused.
* | don't show "unknown" as the percent complete for transferinfo with no ↵Gravatar Joey Hess2012-08-28
| | | | | | | | bytesComplete value
* | avoid possibly re-adding a removed transfer when updating its infoGravatar Joey Hess2012-08-28
|/ | | | Doesn't fix the bug I thought it'd fix, but is clearly correct.
* keep track of which remotes have been scanned in process stateGravatar Joey Hess2012-08-24
| | | | | Since it turned out to make sense to always scan all remotes on startup, there's no need to persist the info about which have been scanned.
* keep logs of failed transfers, and requeue them when doing a non-full scanGravatar Joey Hess2012-08-23
| | | | of a remote
* add transfer scanned flag filesGravatar Joey Hess2012-08-23
|
* implement pausing of transfersGravatar Joey Hess2012-08-10
| | | | | | A paused transfer's thread keeps running, keeping the slot in use. This is intentional; pausing a transfer should not let other queued transfers to run in its place.
* add routes to pause/start/cancel transfersGravatar Joey Hess2012-08-08
| | | | | | | | | | | | | | | | This commit includes a paydown on technical debt incurred two years ago, when I didn't know that it was bad to make custom Read and Show instances for types. As the routes need Read and Show for Transfer, which includes a Key, and deriving my own Read instance of key was not practical, I had to finally clean that up. So the compact Key read and show functions are now file2key and key2file, and Read and Show are now derived instances. Changed all code that used the old instances, compiler checked. (There were a few places, particularly in Command.Unused, and the test suite where the Show instance continue to be used for legitimate comparisons; ie show key_x == show key_y (though really in a bloom filter))
* Merge branch 'master' into assistantGravatar Joey Hess2012-08-07
|\
| * fix transfer log cleanup crashGravatar Joey Hess2012-08-07
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Avoid crashing when "git annex get" fails to download from one location, and falls back to downloading from a second location. The problem is that git annex get calls download recursively from within itself if the first download attempt fails. So the first time through, it writes a transfer info file, which is then overwritten on the second, recursive call. Then on cleanup, it tries to delete the file twice, which of course doesn't work. Fixed both by not crashing if the transfer file is removed, and by changing Get to not run download recursively like that. It's the only thing that did so, and it just seems like a bad idea.
* | webapp now displays the real running and queued transfersGravatar Joey Hess2012-07-27
| | | | | | | | yowza!!!
| * pull in transfer log code from assistant branchGravatar Joey Hess2012-07-18
| | | | | | | | New log file format.
* | fix parsing of startedTimeGravatar Joey Hess2012-07-18
| |
* | run file transfers in threads, not processesGravatar Joey Hess2012-07-18
| | | | | | | | | | | | This should fix OSX/BSD issues with not noticing transfer information files with kqueue. Now that threads are used, the thread can manage the transfer slot allocation and deallocation by itself; much cleaner.
* | add thread id field to transferinfoGravatar Joey Hess2012-07-18
| | | | | | | | | | Also converted its timestand to posix seconds, like is used in the other log files.
* | avoid parsing lock files as transfer filesGravatar Joey Hess2012-07-17
| | | | | | | | | | This seems to happen with kqueue, not inotify. The newly added lck file triggers an add event and was then parsed as a transfer file.
* | bugfixGravatar Joey Hess2012-07-17
| |
* | change transfer lock filenames to avoid ambiguityGravatar Joey Hess2012-07-17
| | | | | | | | | | foo.lck could be a lock file for a transfer of foo, or a transfer of a key that happened to end in ".lck". Fix this by using "lck.foo" instead.
* | split transfer info and lock filesGravatar Joey Hess2012-07-07
| | | | | | | | | | | | | | Since the lock file has to be kept open, this prevented the TransferWatcher from noticing when it appeared, since inotify (and more importantly kqueue) events happen when a new file is closed. Writing a separate info file fixes that problem.
* | wait on child transfer processes, and invalidate cacheGravatar Joey Hess2012-07-06
| | | | | | | | | | | | There's still a bug; if the child updates its transfer info file, then the data from it will superscede the TransferInfo, losing the info that we should wait on this child.
* | unfinished (and unbuildable) work toward separate transfer processesGravatar Joey Hess2012-07-05
| |
* | wrote transfer threadGravatar Joey Hess2012-07-05
| | | | | | | | finally!
| * startedTime needs to be a Maybe to handle transfers that have not started yetGravatar Joey Hess2012-07-02
| | | | | | | | This changes the file format.
* | startedTime needs to be a Maybe to handle transfers that have not started yetGravatar Joey Hess2012-07-02
|/ | | | This changes the file format.
* updateGravatar Joey Hess2012-07-02
|
* fix reading of empty filename from transfer info fileGravatar Joey Hess2012-07-02
|
* cleanupGravatar Joey Hess2012-07-02
|
* record transfers for git-annex-shellGravatar Joey Hess2012-07-02
| | | | | | | | | Not yet tested and places git-annex-shell is run need to be modified to pass the new field settings. Note that rsyncServerSend was changed to fork, rather than directly exec rsync, because it needs to keep the transfer lock held, and clean up the transfer log when done.
* record transfer information on local git remotesGravatar Joey Hess2012-07-01
| | | | | | | | | | | | | | | In order to record a semi-useful filename associated with the key, this required plumbing the filename all the way through to the remotes' storeKey and retrieveKeyFile. Note that there is potential for deadlock here, narrowly avoided. Suppose the repos are A and B. A sends file foo to B, and at the same time, B gets file foo from A. So, A locks its upload transfer info file, and then locks B's download transfer info file. At the same time, B is taking the two locks in the opposite order. This is only not a deadlock because the lock code does not wait, and aborts. So one of A or B's transfers will be aborted and the other transfer will continue. Whew!
* bugfixesGravatar Joey Hess2012-07-01
| | | | | | fdToHandle seems to close the fd avoid excess trailing newline
* tested; bugfixesGravatar Joey Hess2012-07-01
|
* add transfer information filesGravatar Joey Hess2012-07-01
|
* pointlessnessGravatar Joey Hess2012-06-29
|
* use strict insertWithGravatar Joey Hess2012-05-04
|