diff options
| author |  Joey Hess <joeyh@joeyh.name> | 2016-09-06 12:42:50 -0400 |
|---|---|---|
| committer | Joey Hess <joeyh@joeyh.name> | 2016-09-06 12:45:21 -0400 |
| commit | d90783a507ef2776cb43e0d55204adb7e91cfea5 (patch) | |
| tree | 6e059450d0612966e5434db0d8709968618a4d6d /doc | |
| parent | 14c485bb43f071e8f7ff2614bf3eb3e7a7ab0065 (diff) | |
get -J: Download different files from different remotes when the remotes have the same costs.
Only done in -J mode because only if there's concurrency can downloading
from two remotes be faster. Without concurrency, it's likely the case that
sequential downloads from the same remote are faster than switching back
and forth between two remotes.
There is some hairy MVar code here, but basically it just keeps
the activeremotes MVar full except when deciding which remote to assign
to a thread.
Also affects gets by sync --content -J
This commit was sponsored by Jochen Bartl.
Diffstat (limited to 'doc')
| -rw-r--r-- | doc/todo/get_round_robin.mdwn | 9 | ||||
| -rw-r--r-- | doc/todo/wishlist__58___do_round_robin_downloading_of_data.mdwn | 3 |
2 files changed, 12 insertions, 0 deletions
diff --git a/doc/todo/get_round_robin.mdwn b/doc/todo/get_round_robin.mdwn index 9fad9da9d..25c3a8644 100644 --- a/doc/todo/get_round_robin.mdwn +++ b/doc/todo/get_round_robin.mdwn @@ -20,3 +20,12 @@ it might not really be desirable when not run in parallel. In particular, if A and B are on different spinning disks, then an access pattern of A,B,A,B might keep the disks idle enough that they spin down in-between access. + +> done for `git annex get -JN` where two remotes have the same cost. +> +> Also for `git annex sync --content -JN` when downloading and two remotes +> have the same cost. +> +> Can't think of any other places that apply, except perhaps the assistant, +> but it does its own much different queuing of transfers. [[done]] +> --[[Joey]] diff --git a/doc/todo/wishlist__58___do_round_robin_downloading_of_data.mdwn b/doc/todo/wishlist__58___do_round_robin_downloading_of_data.mdwn index 2a283b3df..00777faa2 100644 --- a/doc/todo/wishlist__58___do_round_robin_downloading_of_data.mdwn +++ b/doc/todo/wishlist__58___do_round_robin_downloading_of_data.mdwn @@ -5,3 +5,6 @@ This of course assumes that we like the idea of "parallel" launching and running This wish item is probably only useful for the paranoid people who store more than 1 copy of their data. See [[get_round_robin]] --[[Joey]] + +> [[done]], at least for `git annex get -JN` when two remotes have the same +> cost.. |