diff options
| author |  A. Unique TensorFlower <gardener@tensorflow.org> | 2018-06-08 18:12:16 -0700 |
|---|---|---|
| committer | TensorFlower Gardener <gardener@tensorflow.org> | 2018-06-08 18:14:57 -0700 |
| commit | 9070f24ae15a4f589219d4cb9c962b14612c2d8c (patch) | |
| tree | 561e2362e67fc2c45ddd0e8736de2d9e5b5a022f /tensorflow/core/common_runtime/build_graph_options.h | |
| parent | 53901f9bb9a3965ed5dce65284053b0eb387b0c4 (diff) | |
Collective Ops Part 8
Enable collective op execution in distibuted mode:
Pass collective_graph_key into graph building and
step execution contexts (MasterSession) where it triggers
allocation of an RpcCollectiveExecutorMgr that becomes
accessible via the WorkerEnv and MasterEnv.
The collective_graph_key is used to synchronize step_ids
(which are otherwise random) between otherwise independent
graph executions that contain collective ops that need
to rendezvous.
All APIs for using collectives are still non-public and
experimental.
PiperOrigin-RevId: 199879087
Diffstat (limited to 'tensorflow/core/common_runtime/build_graph_options.h')
| -rw-r--r-- | tensorflow/core/common_runtime/build_graph_options.h | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/tensorflow/core/common_runtime/build_graph_options.h b/tensorflow/core/common_runtime/build_graph_options.h index 5ca170e922..3d0f242ea5 100644 --- a/tensorflow/core/common_runtime/build_graph_options.h +++ b/tensorflow/core/common_runtime/build_graph_options.h @@ -31,6 +31,9 @@ struct BuildGraphOptions { // TODO(mrry): Remove this when the distributed runtime supports Arg/Retval. bool use_function_convention = false; + static const int64 kNoCollectiveGraphKey = 0; + int64 collective_graph_key = kNoCollectiveGraphKey; + string DebugString() const; }; |