aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/contrib/opt
Commit message (Collapse)AuthorAge
* Remove dependency on epsilon for diagonal shampoo.Gravatar A. Unique TensorFlower2018-10-04
| | | | PiperOrigin-RevId: 215857772
* Automated rollback of commit 5f822d694af6e4aa57fe8a426032a91dc61e30d6Gravatar Alexandre Passos2018-10-01
| | | | PiperOrigin-RevId: 215239710
* Internal change.Gravatar Revan Sopher2018-09-28
| | | | PiperOrigin-RevId: 215025019
* fix broken tests.Gravatar A. Unique TensorFlower2018-09-28
| | | | PiperOrigin-RevId: 215010842
* Updating the V2 variables API.Gravatar Alexandre Passos2018-09-27
| | | | PiperOrigin-RevId: 214824023
* Merge pull request #21859 from weidankong:agnGravatar TensorFlower Gardener2018-09-21
|\ | | | | | | PiperOrigin-RevId: 214008973
* | Move from deprecated self.test_session() to self.cached_session().Gravatar A. Unique TensorFlower2018-09-17
| | | | | | | | | | | | | | | | self.test_session() has been deprecated in 9962eb5e84b15e309410071b06c2ed2d6148ed44 as its name confuses readers of the test. Moving to cached_session() instead which is more explicit about: * the fact that the session may be reused. * the session is not closed even when doing a "with self.test_session()" statement. PiperOrigin-RevId: 213326581
* | Fix LazyAdamOptimizer behavior for ResourceVariables (second try)Gravatar A. Unique TensorFlower2018-09-07
| | | | | | | | | | | | Also: Port over more of the unit tests from the original AdamOptimier to LazyAdamOptimizer PiperOrigin-RevId: 212000394
* | Automated rollback of commit 4cd79b3f6361b6518463349a51fe33f7520f3b49Gravatar A. Unique TensorFlower2018-09-06
| | | | | | | | PiperOrigin-RevId: 211832421
* | Merge pull request #19661 from jinxin0924:ma_easgdGravatar TensorFlower Gardener2018-09-04
|\ \ | | | | | | | | | PiperOrigin-RevId: 211519911
* | | Fix LazyAdamOptimizer for sparse updates on resource variables.Gravatar A. Unique TensorFlower2018-09-04
| | | | | | | | | | | | PiperOrigin-RevId: 211488610
| * | Merge branch 'master' into ma_easgdGravatar Xin Jin2018-09-04
| |\ \ | |/ / |/| |
* | | Fix normalization in Shampoo when dealing with differently sized tensors.Gravatar A. Unique TensorFlower2018-08-31
| | | | | | | | | | | | | | | | | | Add M^1/2 to reduce condition numbers, before computing inverse pth root. PiperOrigin-RevId: 211162032
* | | Add weight decay version of Shampoo.Gravatar A. Unique TensorFlower2018-08-31
| | | | | | | | | | | | PiperOrigin-RevId: 211161790
* | | Add newton-shulz method for matrix square root.Gravatar A. Unique TensorFlower2018-08-31
| | | | | | | | | | | | PiperOrigin-RevId: 211126048
| | * AGN: fix sanity failureGravatar weidankong2018-08-28
| | |
| | * AGN: fix Sanity testGravatar weidankong2018-08-27
| | |
| | * AGN: use variable_creator_scope to move variables from GLOBAL_VARIABLES to ↵Gravatar weidankong2018-08-27
| | | | | | | | | | | | LOCAL VARIABLES
| | * AGN: remove compute_gradientGravatar weidankong2018-08-27
| | |
* | | Expose the RegAdagradOptimizer (which allows the user to specify whether a ↵Gravatar A. Unique TensorFlower2018-08-25
| | | | | | | | | | | | | | | | | | loss should update the accumulator) through tf.contrib.opt. PiperOrigin-RevId: 210253451
| | * AGN: clear unused importsGravatar weidankong2018-08-24
| | |
| | * Accumulated Gradient Normalization OptimizerGravatar weidankong2018-08-24
| |/ |/|
* | Move from deprecated self.test_session() to self.cached_session().Gravatar A. Unique TensorFlower2018-08-22
| | | | | | | | | | | | | | | | self.test_session() has been deprecated in 9962eb5e84b15e309410071b06c2ed2d6148ed44 as its name confuses readers of the test. Moving to cached_session() instead which is more explicit about: * the fact that the session may be reused. * the session is not closed even when doing a "with self.test_session()" statement. PiperOrigin-RevId: 209836477
* | Fix sparse updates for optimizer using DecoupledWeightDecay.Gravatar Philipp Jund2018-08-22
| |
* | Move from deprecated self.test_session() to self.session() when a graph is set.Gravatar A. Unique TensorFlower2018-08-21
| | | | | | | | | | | | self.test_session() has been deprecated in cl/208545396 as its behavior confuses readers of the test. Moving to self.session() instead. PiperOrigin-RevId: 209696110
* | Merge pull request #18959 from Rholais:patch-1Gravatar TensorFlower Gardener2018-08-21
|\ \ | | | | | | | | | PiperOrigin-RevId: 209638931
* \ \ Merge pull request #21486 from weidankong:elastic_averageGravatar TensorFlower Gardener2018-08-17
|\ \ \ | | | | | | | | | | | | PiperOrigin-RevId: 209198285
| * | | fix feedback/copybara failure: change to self.get_temp_dir for saving checkpointGravatar weidankong2018-08-16
| | | |
* | | | LARS Optimizer in TensorFlowGravatar A. Unique TensorFlower2018-08-15
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Based on CL from Chris Ying and contributions from Y. You and Wang Tao. Introduced by "Large Batch Training of Convolutional Networks" by Y. You, I. Gitman, and B. Ginsburg. (https://arxiv.org/abs/1708.03888) Implements the LARS learning rate scheme presented in the paper above. This optimizer is useful when scaling the batch size to up to 32K without significant performance degradation. It is recommended to use the optimizer in conjunction with: - Gradual learning rate warm-up - Linear learning rate scaling - Poly rule learning rate decay With this optimizer, ResNet-50 now converges to 76.3% top-1 accuracy at batch 32K on a JF Pod. PiperOrigin-RevId: 208914187
| * | | fix Ubuntu Sanity check failureGravatar weidankong2018-08-15
| | | |
| * | | fix sanity check failureGravatar weidankong2018-08-14
| | | |
| * | | update according commentsGravatar weidankong2018-08-14
| | | |
| * | | update according review commentsGravatar weidankong2018-08-13
| | | |
* | | | Make sure Shampoo preconditions grads of matrices of size max_matrix_sizeGravatar A. Unique TensorFlower2018-08-09
| | | | | | | | | | | | | | | | PiperOrigin-RevId: 208090007
* | | | Add support for ResourceVariables in Shampoo optimizer.Gravatar A. Unique TensorFlower2018-08-08
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Updates Shampoo default matrix size to ones that work better on TPUs. Change norm to use the F norm. PiperOrigin-RevId: 207967042
| * | | elastic averaging SGD update: support partitioner & more optimizersGravatar weidan.kong2018-08-08
|/ / /
* | | This is an initial submission of the Shampoo Optimizer to tensorflow contrib.Gravatar A. Unique TensorFlower2018-07-31
| | | | | | | | | | | | | | | | | | Paper link: https://arxiv.org/pdf/1802.09568.pdf PiperOrigin-RevId: 206834923
* | | [TF:XLA] Add implementation of ResourceApplyPowerSign and ResourceApplyAddSign.Gravatar A. Unique TensorFlower2018-07-07
| | | | | | | | | | | | PiperOrigin-RevId: 203547001
* | | fix linkGravatar Mark Daoust2018-07-06
| | | | | | | | | | | | PiperOrigin-RevId: 203497303
* | | Merge changes from github.Gravatar Yifei Feng2018-07-02
| | | | | | | | | | | | PiperOrigin-RevId: 203037623
* | | Merge changes from github.Gravatar Mingxing Tan2018-06-28
| | | | | | | | | | | | PiperOrigin-RevId: 202585094
* | | Automated g4 rollback of changelist 202000826Gravatar A. Unique TensorFlower2018-06-26
| | | | | | | | | | | | PiperOrigin-RevId: 202115471
* | | Uses resource variables by default for the global step.Gravatar Alexandre Passos2018-06-25
| | | | | | | | | | | | | | | | | | Relnotes: hooks will now see deterministically the value of the global step before updating instead of the value after updating. PiperOrigin-RevId: 202000826
* | | Merge changes from github.Gravatar Akshay Modi2018-06-18
| | | | | | | | | | | | PiperOrigin-RevId: 201110240
* | | This is an initial submission of GGT to tensorflow contrib.Gravatar A. Unique TensorFlower2018-06-18
| | | | | | | | | | | | | | | | | | Paper link: https://arxiv.org/pdf/1806.02958.pdf PiperOrigin-RevId: 201063723
* | | Automated g4 rollback of changelist 201011811Gravatar Akshay Modi2018-06-18
| | | | | | | | | | | | PiperOrigin-RevId: 201033171
* | | Merge changes from github.Gravatar Akshay Modi2018-06-18
| | | | | | | | | | | | PiperOrigin-RevId: 201011811
* | | Automated g4 rollback of changelist 200467580Gravatar A. Unique TensorFlower2018-06-14
| | | | | | | | | | | | PiperOrigin-RevId: 200525639
* | | Uses a resource variable by default for the global step.Gravatar Alexandre Passos2018-06-13
| | | | | | | | | | | | PiperOrigin-RevId: 200467580
| | * fix "workers share local variables" errorGravatar JxKing2018-05-31
| | |
generated by cgit v1.2.3 (git 2.39.1) at 2024-06-14 01:33:24 +0000