blob: 985f09312f515ccaa9e1075cfe483a7a5b0a5049 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
|
op {
graph_op_name: "Selu"
summary: "Computes scaled exponential linear: `scale * alpha * (exp(features) - 1)`"
description: <<END
if < 0, `scale * features` otherwise.
To be used together with
`initializer = tf.variance_scaling_initializer(factor=1.0, mode='FAN_IN')`.
For correct dropout, use `tf.contrib.nn.alpha_dropout`.
See [Self-Normalizing Neural Networks](https://arxiv.org/abs/1706.02515)
END
}
|