diff options
| author |  A. Unique TensorFlower <nobody@tensorflow.org> | 2016-03-18 05:59:44 -0800 |
|---|---|---|
| committer |  TensorFlower Gardener <gardener@tensorflow.org> | 2016-03-18 08:48:33 -0700 |
| commit | 9742a2ed4e1e2015334d53dc2824c82812ad21e8 (patch) | |
| tree | 41966c3ce0b15e7b0f2dc19ddfdd6c71930780a3 /tensorflow/tools/dist_test/Dockerfile.local | |
| parent | aaca1ccefab6307a0948c782440016389bf994f1 (diff) | |
Test for distributed (grpc) runtime in OSS TensorFlow
See README.md for detailed descriptions of the usage of the tools and tests in this changeset.
Three modes of testing are supported:
1) Launch a local Kubernetes (k8s) cluster and run the test suites on it
(See local_test.sh)
2) Launch a remote k8s cluster on Google Container Engine (GKE) and run the test suite on it
(See remote_test.sh)
3) Run the test suite on an existing k8s TensorFlow cluster
(Also see remote_test.sh)
Take the remote test for example, the following steps are performed:
1) Builds a Docker image with gcloud and Kubernetes tools, and the latest TensorFlow pip installed (see Dockerfile)
2) Launches a Docker container based on the said image (see test_distributed.sh)
3) From within the image, authenticate the gcloud user (with credentials files mapped from outside the container), configer the k8s cluster and launch a new k8s container cluster for TensorFlow workers
4) Generate a k8s (yaml) config file and user this yaml file to create a TensorFlow worker cluster consisting of a certian number of parameter servers (ps) and workers. The workers are exposed as external services with public IPs (see dist_test.sh)
5) Run a simple softmax MNIST model on multiple workers, with the model weights and biases located on the ps nodes. Train the models in parallel and observe the final validation cross entropy (see dist_mnist_test.sh)
Change: 117543657
Diffstat (limited to 'tensorflow/tools/dist_test/Dockerfile.local')
| -rw-r--r-- | tensorflow/tools/dist_test/Dockerfile.local | 20 |
1 files changed, 20 insertions, 0 deletions
diff --git a/tensorflow/tools/dist_test/Dockerfile.local b/tensorflow/tools/dist_test/Dockerfile.local new file mode 100644 index 0000000000..4d82904707 --- /dev/null +++ b/tensorflow/tools/dist_test/Dockerfile.local @@ -0,0 +1,20 @@ +FROM jpetazzo/dind + +MAINTAINER Shanqing Cai <cais@google.com> + +RUN apt-get update + +RUN apt-get install -y \ + bc \ + build-essential \ + dbus \ + git \ + software-properties-common + +# Install the latest golang +RUN wget https://storage.googleapis.com/golang/go1.4.2.linux-amd64.tar.gz +RUN tar -C /usr/local -xzf go1.4.2.linux-amd64.tar.gz +RUN rm -f go1.4.2.linux-amd64.tar.gz +RUN echo 'PATH=/usr/local/go/bin:${PATH}' >> /root/.bashrc + +ADD . /var/tf-k8s |