diff options
| author |  A. Unique TensorFlower <gardener@tensorflow.org> | 2017-09-28 11:53:24 -0700 |
|---|---|---|
| committer | TensorFlower Gardener <gardener@tensorflow.org> | 2017-09-28 11:59:04 -0700 |
| commit | 0254d0d31337724db911c89609336afd60e8192d (patch) | |
| tree | fb167b3647a9b2030173387831b94eece9a59fdd /CODE_OF_CONDUCT.md | |
| parent | 996a85d436a0f45d5bfdaad2946cef12f70883eb (diff) | |
Adds tf.contrib.nn.scaled_softplus(x, alpha) = alpha * softplus(x/alpha). This can be thought of as a smoothed version of a ReLU. On Imagenet, alpha=0.3 gives 0.6-1% improvement in validation accuracy compared to ReLU, by reducing the generalization gap.
PiperOrigin-RevId: 170376244
Diffstat (limited to 'CODE_OF_CONDUCT.md')
0 files changed, 0 insertions, 0 deletions