| Commit message (Collapse) | Author | Age |
|
|
|
| |
PiperOrigin-RevId: 215857772
|
|
|
|
| |
PiperOrigin-RevId: 215239710
|
|
|
|
| |
PiperOrigin-RevId: 215025019
|
|
|
|
| |
PiperOrigin-RevId: 215010842
|
|
|
|
| |
PiperOrigin-RevId: 214824023
|
|\
| |
| |
| | |
PiperOrigin-RevId: 214008973
|
| |
| |
| |
| |
| |
| |
| |
| | |
self.test_session() has been deprecated in 9962eb5e84b15e309410071b06c2ed2d6148ed44 as its name confuses readers of the test. Moving to cached_session() instead which is more explicit about:
* the fact that the session may be reused.
* the session is not closed even when doing a "with self.test_session()" statement.
PiperOrigin-RevId: 213326581
|
| |
| |
| |
| |
| |
| | |
Also: Port over more of the unit tests from the original AdamOptimier
to LazyAdamOptimizer
PiperOrigin-RevId: 212000394
|
| |
| |
| |
| | |
PiperOrigin-RevId: 211832421
|
|\ \
| | |
| | |
| | | |
PiperOrigin-RevId: 211519911
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 211488610
|
| |\ \
| |/ /
|/| | |
|
| | |
| | |
| | |
| | |
| | |
| | | |
Add M^1/2 to reduce condition numbers, before computing inverse pth root.
PiperOrigin-RevId: 211162032
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 211161790
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 211126048
|
| | | |
|
| | | |
|
| | |
| | |
| | |
| | | |
LOCAL VARIABLES
|
| | | |
|
| | |
| | |
| | |
| | |
| | |
| | | |
loss should update the accumulator) through tf.contrib.opt.
PiperOrigin-RevId: 210253451
|
| | | |
|
| |/
|/| |
|
| |
| |
| |
| |
| |
| |
| |
| | |
self.test_session() has been deprecated in 9962eb5e84b15e309410071b06c2ed2d6148ed44 as its name confuses readers of the test. Moving to cached_session() instead which is more explicit about:
* the fact that the session may be reused.
* the session is not closed even when doing a "with self.test_session()" statement.
PiperOrigin-RevId: 209836477
|
| | |
|
| |
| |
| |
| |
| |
| | |
self.test_session() has been deprecated in cl/208545396 as its behavior confuses readers of the test. Moving to self.session() instead.
PiperOrigin-RevId: 209696110
|
|\ \
| | |
| | |
| | | |
PiperOrigin-RevId: 209638931
|
|\ \ \
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 209198285
|
| | | | |
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
Based on CL from Chris Ying and contributions from Y. You and Wang Tao.
Introduced by "Large Batch Training of Convolutional Networks" by Y. You,
I. Gitman, and B. Ginsburg. (https://arxiv.org/abs/1708.03888)
Implements the LARS learning rate scheme presented in the paper above. This
optimizer is useful when scaling the batch size to up to 32K without
significant performance degradation. It is recommended to use the optimizer
in conjunction with:
- Gradual learning rate warm-up
- Linear learning rate scaling
- Poly rule learning rate decay
With this optimizer, ResNet-50 now converges to 76.3% top-1 accuracy at batch 32K on a JF Pod.
PiperOrigin-RevId: 208914187
|
| | | | |
|
| | | | |
|
| | | | |
|
| | | | |
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 208090007
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
Updates Shampoo default matrix size to ones that work better on TPUs.
Change norm to use the F norm.
PiperOrigin-RevId: 207967042
|
|/ / / |
|
| | |
| | |
| | |
| | |
| | |
| | | |
Paper link: https://arxiv.org/pdf/1802.09568.pdf
PiperOrigin-RevId: 206834923
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 203547001
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 203497303
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 203037623
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 202585094
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 202115471
|
| | |
| | |
| | |
| | |
| | |
| | | |
Relnotes: hooks will now see deterministically the value of the global
step before updating instead of the value after updating.
PiperOrigin-RevId: 202000826
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 201110240
|
| | |
| | |
| | |
| | |
| | |
| | | |
Paper link: https://arxiv.org/pdf/1806.02958.pdf
PiperOrigin-RevId: 201063723
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 201033171
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 201011811
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 200525639
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 200467580
|
| | | |
|