diff options
Diffstat (limited to 'tensorflow/core/api_def/base_api/api_def_SparseApplyRMSProp.pbtxt')
| -rw-r--r-- | tensorflow/core/api_def/base_api/api_def_SparseApplyRMSProp.pbtxt | 6 |
1 files changed, 3 insertions, 3 deletions
diff --git a/tensorflow/core/api_def/base_api/api_def_SparseApplyRMSProp.pbtxt b/tensorflow/core/api_def/base_api/api_def_SparseApplyRMSProp.pbtxt index a4dbd608b8..ee9f57fa9d 100644 --- a/tensorflow/core/api_def/base_api/api_def_SparseApplyRMSProp.pbtxt +++ b/tensorflow/core/api_def/base_api/api_def_SparseApplyRMSProp.pbtxt @@ -71,8 +71,8 @@ and mom will not update in iterations during which the grad is zero. mean_square = decay * mean_square + (1-decay) * gradient ** 2 Delta = learning_rate * gradient / sqrt(mean_square + epsilon) -ms <- rho * ms_{t-1} + (1-rho) * grad * grad -mom <- momentum * mom_{t-1} + lr * grad / sqrt(ms + epsilon) -var <- var - mom +$$ms <- rho * ms_{t-1} + (1-rho) * grad * grad$$ +$$mom <- momentum * mom_{t-1} + lr * grad / sqrt(ms + epsilon)$$ +$$var <- var - mom$$ END } |