diff options
| author |  Chris Ying <chrisying@google.com> | 2017-09-28 11:05:39 -0700 |
|---|---|---|
| committer |  TensorFlower Gardener <gardener@tensorflow.org> | 2017-09-28 11:09:20 -0700 |
| commit | 125f7afa4a483855dc75791445d2dea64587876a (patch) | |
| tree | bc9f097825e600b1e84b194577711f95ccf584dc /tensorflow/tools/dist_test | |
| parent | d3d60ff6acec178b1cf912938aa6180bbd1a676f (diff) | |
Implementing ghost batch norm as defined in https://arxiv.org/pdf/1705.08741.
Reuses most of tf.layers.batch_normalization's existing functionality by using some reshaping and transposing tricks. Toggled via additional optional parameter `num_virtual_batches`.
Ghost batch norm is essential for large batch training where the true batch
size is different than the batch norm batch size.
PiperOrigin-RevId: 170368495
Diffstat (limited to 'tensorflow/tools/dist_test')
0 files changed, 0 insertions, 0 deletions