summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* cleanupGravatar Joey Hess2012-08-26
|
* scan multiple remotes in one passGravatar Joey Hess2012-08-26
| | | | | | | | | | | | | | | | | | | | | | | | | The expensive transfer scan now scans a whole set of remotes in one pass. So at startup, or when network comes up, it will run only once. Note that this can result in transfers from/to higher cost remotes being queued before other transfers of other content from/to lower cost remotes. Before, low cost remotes were scanned first and all their transfers came first. When multiple transfers are queued for a key, the lower cost ones are still queued first. However, this could result in transfers from slow remotes running for a long time while transfers of other data from faster remotes waits. I expect to make the transfer queue smarter about ordering and/or make it allow multiple transfers at a time, which should eliminate this annoyance. (Also, it was already possible to get into that situation, for example if the network was up, lots of transfers from slow remotes might be queued, and then a disk is mounted and its faster transfers have to wait.) Also note that this means I don't need to improve the code in Assistant.Sync that currently checks if any of the reconnected remotes have diverged, and if so, queues scans of all of them. That had been very innefficient, but now doesn't matter.
* thread safe git-annex index file useGravatar Joey Hess2012-08-24
|
* add transferkey commandGravatar Joey Hess2012-08-24
| | | | | | | Used by the assistant, rather than copy, this is faster because it avoids using git ls-files, avoids checking the location log redundantly, and runs in oneshot mode, avoiding making a commit to the git-annex branch for every file transferred.
* keep track of which remotes have been scanned in process stateGravatar Joey Hess2012-08-24
| | | | | Since it turned out to make sense to always scan all remotes on startup, there's no need to persist the info about which have been scanned.
* fix priority inversionGravatar Joey Hess2012-08-24
| | | | low cost ==> high priority
* avoid crash when directory doesn't existGravatar Joey Hess2012-08-24
|
* run full transfer scan on all remotes at startupGravatar Joey Hess2012-08-24
| | | | Or when a remote first becomes available after startup.
* make higher priorities and full scans be preserved when addingGravatar Joey Hess2012-08-24
|
* avoid requeueing a download from a remote that no longer has a keyGravatar Joey Hess2012-08-24
|
* Bugfix: Fix fsck in SHA*E backends, when the key contains composite ↵Gravatar Joey Hess2012-08-24
| | | | extensions, as added in 3.20120721.
* remove slightly misleading extended messageGravatar Joey Hess2012-08-23
|
* also notice dbus unmount eventsGravatar Joey Hess2012-08-23
|
* make the NetWatcher always rescan networked remotes every 30 minutesGravatar Joey Hess2012-08-23
| | | | | | | | | There are multiple reasons to do this: * The local network may be up solid, but a route to a networked remote is having trouble. Any transfers to it that fail should be retried. * Someone might have wicd running, but like to bring up new networks by hand too. This way, it'll eventually notice them.
* don't rely on hasKeyCheap in the transfer scanGravatar Joey Hess2012-08-23
| | | | | | | The problem with using it here is that, if a removable drive is scanned and gets disconnected during the scan, testing for all the files will indicate it doesn't have them, and the scan is logged as completed successfully, without necessary transfers being queued.
* remove pointless bracketGravatar Joey Hess2012-08-23
|
* keep logs of failed transfers, and requeue them when doing a non-full scanGravatar Joey Hess2012-08-23
| | | | of a remote
* add transfer scanned flag filesGravatar Joey Hess2012-08-23
|
* scan cheapest remotes firstGravatar Joey Hess2012-08-23
| | | | This way, we get transfers from cheapest remotes.
* better nameGravatar Joey Hess2012-08-22
|
* avoid unnecessary transfer scans when syncing a disconnected remoteGravatar Joey Hess2012-08-22
| | | | | | | | | | | | | | | | | | | | Found a very cheap way to determine when a disconnected remote has diverged, and has new content that needs to be transferred: Piggyback on the git-annex branch update, which already checks for divergence. However, this does not check if new content has appeared locally while disconnected, that should be transferred to the remote. Also, this does not handle cases where the two git repos are in sync, but their content syncing has not caught up yet. This code could have its efficiency improved: * When multiple remotes are synced, if any one has diverged, they're all queued for transfer scans. * The transfer scanner could be told whether the remote has new content, the local repo has new content, or both, and could optimise its scan accordingly.
* move some git operations outside the annex monad to avoid blocking other threadsGravatar Joey Hess2012-08-22
|
* refactorGravatar Joey Hess2012-08-22
|
* add NetWatcher threadGravatar Joey Hess2012-08-21
| | | | | | This deals with interruptions in network connectevity, by listening for a new network interface coming up (using dbus to see when network-manager or wicd do it), and forcing a rescan of
* Merge branch 'master' into assistantGravatar Joey Hess2012-08-21
|\
| * add amazon glacierGravatar Joey Hess2012-08-21
| |
| * responseGravatar Joey Hess2012-08-21
| |
| * Merge remote-tracking branch 'origin/master'Gravatar Joey Hess2012-08-21
| |\
| | * Added a comment: Justin is rightGravatar http://joeyh.name/2012-08-21
| | |
| | * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawla3gLc6_rHuggFfy7o7eGMPvPztFZTrUQ2012-08-21
| | |
| | * Added a commentGravatar https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo2012-08-21
| | |
| | * New questionGravatar https://me.yahoo.com/speredenn#aaf382012-08-21
| | |
| | * Added a comment: better logo?Gravatar http://dieter-be.myopenid.com/2012-08-20
| | |
* | | Merge branch 'master' into assistantGravatar Joey Hess2012-08-20
|\| | | | | | | | | | | | | | | | | Conflicts: Makefile debian/copyright
| * | ignore build-stampGravatar Joey Hess2012-08-20
| |/
| * use a stamp file to avoid running ghc in make installGravatar Joey Hess2012-08-20
| | | | | | | | | | That fails when make install is run sudoed, but cabal has been used to install dependencies in a user's home directory.
| * responseGravatar Joey Hess2012-08-20
| |
| * Merge branch 'master' of ssh://git-annex.branchable.comGravatar Joey Hess2012-08-20
| |\
| * | blog for the dayGravatar Joey Hess2012-08-20
| | |
| * | thank rsync.net for providing me with a free account thereGravatar Joey Hess2012-08-20
| | |
| | * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawlup4hyZo4eCjF8T85vfRXMKBxGj9bMdl02012-08-20
| | |
| | * removedGravatar https://www.google.com/accounts/o8/id?id=AItOawkS6aFVrEwOrDuQBTMXxtGHtueA69NS_jo2012-08-20
| | |
| | * Added a comment: error: unknown option `no-edit'Gravatar https://www.google.com/accounts/o8/id?id=AItOawkS6aFVrEwOrDuQBTMXxtGHtueA69NS_jo2012-08-20
| | |
| | * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawla3gLc6_rHuggFfy7o7eGMPvPztFZTrUQ2012-08-20
| | |
| | * (no commit message)Gravatar https://www.google.com/accounts/o8/id?id=AItOawla3gLc6_rHuggFfy7o7eGMPvPztFZTrUQ2012-08-20
| | |
| * | add svg versions of the git-annex logo, in color and black and whiteGravatar Joey Hess2012-08-19
| | | | | | | | | | | | | | | This is a simple application of inkscape's rather amazing tracing capabilities.
| * | updatesGravatar Joey Hess2012-08-19
| | |
| | * Fail to add attachment.Gravatar https://www.google.com/accounts/o8/id?id=AItOawlu7K3h7Ry1uDAU_ERYGuqt0LoGNJqGuRo2012-08-18
| | |
| | * Add description of file name related bug.Gravatar https://www.google.com/accounts/o8/id?id=AItOawlu7K3h7Ry1uDAU_ERYGuqt0LoGNJqGuRo2012-08-18
| | |
| | * Added a commentGravatar http://claimid.com/strager2012-08-17
| |/