aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/tensorboard/DEVELOPMENT.md
blob: 3ff2c87dab70e6fc794af16705becec7d9c8ffa7 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
# How to Develop TensorBoard

## Launching a Development Instance

The first step is getting a TensorBoard development environment set up. You
should start by making sure you have [nodejs](https://nodejs.org/en/) and
[npm](https://www.npmjs.com/). On Ubuntu, `sudo apt-get install -y nodejs
nodejs-legacy npm`. Ensure your npm version is >=3.0 by running
'npm --version'. If the version is <3.0, run 'sudo npm install npm -g' to
update to the latest version. You may need to open a new terminal window after
updating in order to make use of the newly-installed version.

Next, you'll want to install [gulp](http://gulpjs.com/) and
[bower](http://bower.io/), which are used for build tooling and dependency
management respectively. Both must be installed globally: `sudo npm install -g
gulp bower` will do that.

Then, cd into the TensorBoard directory:

`cd tensorflow/tensorboard`

and install dependencies:

`npm run prep`

Then, run gulp: `gulp`

(Don't worry if there are some linter errors.)

Now you can navigate to
[http://localhost:8000/demo/index.html](http://localhost:8000/demo/index.html)
and play with the demo TensorBoard instance. If you make changes to the source
code, `gulp` should detect it, recompile (if Typescript), and reload your
browser.

This demo TensorBoard will have a small amount of demo data generated by
[generate_testdata.py](https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tensorboard/scripts/generate_testdata.py).
You can use [serialize_tensorboard.py](https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tensorboard/scripts/serialize_tensorboard.py)
to create a realistic demo directory from your own data files.

## Launching TensorBoard with modified source

If you are developing in open source, and have made some changes to TensorBoard
that you'd like to try out on real data, then you need to regenerate
`dist/tf-tensorboard.html`.

Run `gulp regenerate`. That will recompile all of the TensorBoard assets, and
produce a new tf-tensorboard.html with your changes.

Now, you can use `bazel` to launch TensorBoard:

`bazel run //tensorflow/tensorboard:tensorboard -- --logdir=/path/to/logs`.

## Updating the vulcanized HTML file (for linux)

The vulcanized HTML file `dist/tf-tensorboard.html.OPENSOURCE` is the version of
Tensorboard started up by users who install TensorFlow via pip. Today, updating
that file involves using gulp. Future efforts will streamline this process.

First, `cd` into the `tensorflow/tensorboard` directory within a git repository
(a piper client will not work). Run `npm run prepare`.

Next, we build some third party JS dependencies via webfiles targets. Run

    bazel build \
        tensorflow/tensorboard/components/tf_imports:d3 \
        tensorflow/tensorboard/components/tf_imports:lodash \
        tensorflow/tensorboard/components/tf_imports:graphlib \
        tensorflow/tensorboard/components/tf_imports:dagre \
        tensorflow/tensorboard/components/tf_imports:plottable

Users internal to Google should use the internal build tool instead. Move the
output JS binaries into the tf_imports directory.

Run `gulp vulcanize`. If compilation errors arise (such as those related to
TypeScript), fix them and re-run. This step should update the contents of
`dist/tf-tensorboard.html.OPENSOURCE`.

Next, we perform some manual find-and-replaces on script `src` paths within
`dist/tf-tensorboard.html.OPENSOURCE`. Manually replace:

* `<script src="../tf-imports/d3.js"></script>` with `<script src="../d3/d3.js"></script>`
* `<script src="../tf-imports/dagre.js"></script>` with `<script src="../dagre/dist/dagre.core.js"></script>`
* `<script src="../tf-imports/graphlib.js"></script>` with `<script src="../graphlib/dist/graphlib.core.js"></script>`
* `<script src="../tf-imports/lodash.js"></script>` with `<script src="../lodash/lodash.min.js"></script>`
* `<script src="../tf-imports/plottable.js"></script>` with `<script src="../plottable/plottable.js"></script>`

Also, remove duplicate instances of script includes. Each of those scripts
should only be included once (the first time) within the vulcanized output.

### Try out the vulcanized Tensorboard HTML output

To test the vulcanized output, prepare a pip package within a virtualized
environment, and run `tensorboard` after activating the environment.

To do that, we first create and activate a virtual environment called say
`tf_foo` (Pick your own name.).

    virtualenv --system-site-packages ~/tf_foo
    source ~/tf_foo/bin/activate

Make sure that you have installed `pip` and `virtualenv` beforehand. If not, run

    sudo easy_install pip
    sudo pip install --upgrade virtualenv

Next, we run this command from the `tensorflow directory`.

    tools/google/make_tree.sh --pip_dir=/tmp/pip_dir

to create a pip package. If you are running within Google, also provide the
`--pending_cl` flag. That script will generate a wheel file (.whl) within
`/tmp/pip_dir`. Lets say that it is
`tensorflow-1.0.0rc2-cp27-none-linux_x86_64.whl`.

Run

    pip install --upgrade /tmp/pip_dir/tensorflow-1.0.0rc2-cp27-none-linux_x86_64.whl

to update the pip installation of TensorFlow within the virtual environment.
Verify that the `tensorboard` command defers to the tensorboard instance
installed within your virtual environment (`tf_foo`) by running
`which tensorboard`. To run tensorboard, start it up as usual within the virtual
environment:

    tensorboard --logdir=/tmp/my/logdir