diff options
-rw-r--r-- | doc/design/assistant/syncing.mdwn | 1 | ||||
-rw-r--r-- | doc/todo/Slow_transfer_for_a_lot_of_small_files..mdwn (renamed from doc/Slow_transfer_for_a_lot_of_small_files..mdwn) | 9 |
2 files changed, 10 insertions, 0 deletions
diff --git a/doc/design/assistant/syncing.mdwn b/doc/design/assistant/syncing.mdwn index 58b3257e3..34ea4a26f 100644 --- a/doc/design/assistant/syncing.mdwn +++ b/doc/design/assistant/syncing.mdwn @@ -41,6 +41,7 @@ all the other git clones, at both the git level and the key/value level. to a remote, so it won't be uploading content to us.) Note: Does not need to use the TransferScanner, if we get and check a list of the changed files. +* [[use multiple transfer slots|todo/Slow_transfer_for_a_lot_of_small_files.]] ## data syncing diff --git a/doc/Slow_transfer_for_a_lot_of_small_files..mdwn b/doc/todo/Slow_transfer_for_a_lot_of_small_files..mdwn index acccec93a..00cdad0fe 100644 --- a/doc/Slow_transfer_for_a_lot_of_small_files..mdwn +++ b/doc/todo/Slow_transfer_for_a_lot_of_small_files..mdwn @@ -8,4 +8,13 @@ But currently it seems like git-annex is only using one thread to transfer(per h An option to select number of transfer threads to use(possibly per host) would be very nice. +> Opening a lot of connections to a single host is probably not desirable. +> +> I do want to do something to allow slow hosts to not hold up transfers to +> other hosts, which might involve running multiple queued transfers at +> once. The webapp already allows the user to force a given transfer to +> happen immediately. --[[Joey]] + And maybe also an option to limit how long a queue the browser should show, it can become quite resource intensive with a long queue. + +> The queue is limited to 20 items for this reason. --[[Joey]] |