# MPI TensorFlow integration Tensorflow MPI integration allows communicating between different TensorFlow processes using MPI. This enables training across multiple nodes and GPUs using high-speed interconnects.