diff options
| author |  Russell Power <power@google.com> | 2018-07-27 09:47:23 -0700 |
|---|---|---|
| committer |  TensorFlower Gardener <gardener@tensorflow.org> | 2018-07-27 09:51:12 -0700 |
| commit | 96c5b537c331011bccafd87d3f90c870c777f349 (patch) | |
| tree | 90bfb679dc157adeecd37ec48fb31712d8e2c271 /tensorflow/core/platform | |
| parent | e6138e96def4b6432ad930cfb34b3806c5f9fb8b (diff) | |
Improve restore performance for large checkpoints.
When loading large tensors, the cost of creating a new BundleReader is small relative to the load time for the Tensor. When reading from network storage, using a threadpool for large tensor loads allows us to push expensive operations (alloc, fetch, checksum) to separate cores.
PiperOrigin-RevId: 206330021
Diffstat (limited to 'tensorflow/core/platform')
| -rw-r--r-- | tensorflow/core/platform/env_test.cc | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/tensorflow/core/platform/env_test.cc b/tensorflow/core/platform/env_test.cc index c461a40086..305a9a682f 100644 --- a/tensorflow/core/platform/env_test.cc +++ b/tensorflow/core/platform/env_test.cc @@ -86,7 +86,7 @@ TEST_F(DefaultEnvTest, IncompleteReadOutOfRange) { TEST_F(DefaultEnvTest, ReadFileToString) { for (const int length : {0, 1, 1212, 2553, 4928, 8196, 9000, (1 << 20) - 1, - 1 << 20, (1 << 20) + 1}) { + 1 << 20, (1 << 20) + 1, (256 << 20) + 100}) { const string filename = strings::StrCat(BaseDir(), "/bar/..//file", length); // Write a file with the given length |