diff options
Diffstat (limited to 'tensorflow/core/api_def/base_api/api_def_SparseApplyFtrl.pbtxt')
-rw-r--r-- | tensorflow/core/api_def/base_api/api_def_SparseApplyFtrl.pbtxt | 10 |
1 files changed, 5 insertions, 5 deletions
diff --git a/tensorflow/core/api_def/base_api/api_def_SparseApplyFtrl.pbtxt b/tensorflow/core/api_def/base_api/api_def_SparseApplyFtrl.pbtxt index 524b5c5a47..9a6b6bca5f 100644 --- a/tensorflow/core/api_def/base_api/api_def_SparseApplyFtrl.pbtxt +++ b/tensorflow/core/api_def/base_api/api_def_SparseApplyFtrl.pbtxt @@ -71,10 +71,10 @@ END summary: "Update relevant entries in \'*var\' according to the Ftrl-proximal scheme." description: <<END That is for rows we have grad for, we update var, accum and linear as follows: -accum_new = accum + grad * grad -linear += grad + (accum_new^(-lr_power) - accum^(-lr_power)) / lr * var -quadratic = 1.0 / (accum_new^(lr_power) * lr) + 2 * l2 -var = (sign(linear) * l1 - linear) / quadratic if |linear| > l1 else 0.0 -accum = accum_new +$$accum_new = accum + grad * grad$$ +$$linear += grad + (accum_{new}^{-lr_{power}} - accum^{-lr_{power}} / lr * var$$ +$$quadratic = 1.0 / (accum_{new}^{lr_{power}} * lr) + 2 * l2$$ +$$var = (sign(linear) * l1 - linear) / quadratic\ if\ |linear| > l1\ else\ 0.0$$ +$$accum = accum_{new}$$ END } |