aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/python/debug
Commit message (Collapse)AuthorAge
* Copy tf.distributions to tfp.distributions, and deprecate the ↵Gravatar A. Unique TensorFlower2018-10-02
| | | | | | tf.distributions API. PiperOrigin-RevId: 215441733
* [tf.data] Deprecate `tf.contrib.data` and introduce `tf.data.experimental` ↵Gravatar Derek Murray2018-10-01
| | | | | | | | | | | | | | | | | | | | to replace it. This change prepares `tf.data` for TensorFlow 2.0, where `tf.contrib` will no longer exist. It retains the pre-existing endpoints in `tf.contrib.data` with deprecation warnings. Note there are some exceptions to the move: * Deprecated symbols in `tf.contrib.data` have not been moved to `tf.data.experimental`, because replacements already exist. * `tf.contrib.data.LMDBDataset` has not been moved, because we plan to move it to a SIG-maintained repository. * `tf.contrib.data.assert_element_shape()` has not yet been moved, because it depends on functionality in `tf.contrib`, and it will move in a later change. * `tf.contrib.data.AUTOTUNE` has not yet been moved, because we have not yet determined how to `tf_export()` a Python integer. * The stats-related API endpoints have not yet appeared in a released version of TensorFlow, so these are moved to `tf.data.experimental` without retaining an endpoint in `tf.contrib.data`. In addition, this change includes some build rule and ApiDef refactoring: * Some of the "//third_party/tensorflow/python:training" dependencies had to be split in order to avoid a circular dependency. * The `tf.contrib.stateless` ops now have a private core library for the generated wrappers (and accordingly are hidden in their ApiDef) so that `tf.data.experimental.sample_from_datasets()` can depend on them. PiperOrigin-RevId: 215304249
* Updating the V2 variables API.Gravatar Alexandre Passos2018-09-27
| | | | PiperOrigin-RevId: 214824023
* Reduce the size of //tensorflow/tools/pip_package:simple_console_windowsGravatar A. Unique TensorFlower2018-09-27
| | | | | | | | This change reduce the size of //tensorflow/tools/pip_package:simple_console_windows's zip file from 1000027677 bytes to 47690474 bytes for a CPU build. For GPU build, it will avoid going over 4GB when multiple CUDA compatibility are specified. To fix #22390 PiperOrigin-RevId: 214764423
* Add PinToHostOptimizer to grappler: force small ops to happen on CPU (instead ofGravatar A. Unique TensorFlower2018-09-22
| | | | | | GPU). This avoids many unnecessary CPU<->GPU memcpy and syncs. PiperOrigin-RevId: 214108484
* Move from deprecated self.test_session() to self.cached_session().Gravatar A. Unique TensorFlower2018-09-21
| | | | | | | | self.test_session() has been deprecated in 9962eb5e84b15e309410071b06c2ed2d6148ed44 as its name confuses readers of the test. Moving to cached_session() instead which is more explicit about: * the fact that the session may be reused. * the session is not closed even when doing a "with self.test_session()" statement. PiperOrigin-RevId: 213944932
* tfdbg: adjust the scope of mutex for keeping track of disk usageGravatar Shanqing Cai2018-09-07
| | | | PiperOrigin-RevId: 211966207
* failing on tsan so disablingGravatar Olivia Nordquist2018-09-06
| | | | PiperOrigin-RevId: 211892283
* disabling tsan in testGravatar Olivia Nordquist2018-09-06
| | | | PiperOrigin-RevId: 211875205
* tfdbg: fix a bug in the example debug_tflearn_irisGravatar Shanqing Cai2018-08-30
| | | | | | Previously, if neither the --debug or --tensorboard_debug_address flag is used, the example will error out because the variable debug_hook is unset. PiperOrigin-RevId: 210973500
* tfdbg: Add adjustable limit to total bytes dumped to diskGravatar Shanqing Cai2018-08-28
| | | | | RELNOTES: tfdbg: Limit the total disk space occupied by dumped tensor data to 100 GBytes. Add environment variable `TFDBG_DISK_BYTES_LIMIT` to allow adjustment of this upper limit. PiperOrigin-RevId: 210648585
* Enable two grpc-related tests on MacGravatar Shanqing Cai2018-08-23
| | | | | | now that grpcio is installed as a dependency with the tensorflow pip package. PiperOrigin-RevId: 209971052
* Remove magic-doc-links from code.Gravatar Mark Daoust2018-08-16
| | | | | | | | | | This change contains no code changes. Only doc-strings. We can't use relative links in code files, so we don't have much choice but to link to tensorflow.org/ The deleted links were to docs that no longer exist. PiperOrigin-RevId: 209019572
* Re-enable some tests on WindowsGravatar A. Unique TensorFlower2018-08-14
| | | | PiperOrigin-RevId: 208695032
* Remove usage of magic-api-link syntax from source files.Gravatar Mark Daoust2018-08-09
| | | | | | | | | | | | | | | | | | | | Back-ticks are now converted to links in the api_docs generator. With the new docs repo we're moving to simplify the docs pipeline, and make everything more readable. By doing this we no longer get test failures for symbols that don't exist (`tf.does_not_exist` will not get a link). There is also no way, not to set custom link text. That's okay. This is the result of the following regex replacement (+ a couple of manual edits.): re: @\{([^$].*?)(\$.+?)?} sub: `\1` Which does the following replacements: "@{tf.symbol}" --> "`tf.symbol`" "@{tf.symbol$link_text}" --> "`tf.symbol`" PiperOrigin-RevId: 208042358
* Internal Change.Gravatar Michael Case2018-07-18
| | | | PiperOrigin-RevId: 205167512
* Disable failing gpu tests on WindowsGravatar A. Unique TensorFlower2018-07-10
| | | | PiperOrigin-RevId: 203948138
* Fix tfdbg pip test by adding missing dependencyGravatar Shanqing Cai2018-07-09
| | | | PiperOrigin-RevId: 203766656
* tfdbg: Fix compatibility with C++ MakeCallable and _make_callable_from_optionsGravatar Shanqing Cai2018-06-28
| | | | | | | Fixes #20160 REL_NOTES: tfdbg: Fix compatibility with `tf.keras.Model`s training on `tf.data.Dataset`s. PiperOrigin-RevId: 202543231
* Rename programmers_guide/ directory to guide/.Gravatar Billy Lamberta2018-06-22
| | | | | | Update references in source files and docs in tensorflow and related projects. PiperOrigin-RevId: 201766994
* tfdbg CLI: Add command to print tensorflow versionGravatar Shanqing Cai2018-06-21
| | | | | | | | | Usage example: tfdbg> ver or tfdbg> version PiperOrigin-RevId: 201593552
* Reduce Grappler overhead by skipping optimizers when the graph is tiny.Gravatar A. Unique TensorFlower2018-06-18
| | | | PiperOrigin-RevId: 201095811
* Improve tfdbg's handling of runtime errorsGravatar Shanqing Cai2018-06-11
| | | | | | | | | | | | | | * In some cases the RuntimeError object (tf_error in cli_shared.py) doesn't have the op or its name available. Handle that situation properly. * Previously, we used client graphs in the debugger CLI whenever it's available. This has caused issues in which the device names (e.g., "/device:GPU:0" vs "/job:localhost/replica:0/task:0/device:CPU:0"). This CL fixes that by favoring the runtime graph on the disk over the client graph. The former has the actual device names. Use the latter only if the former isn't available for some reason (e.g., writing graph to the disk failed.) PiperOrigin-RevId: 200128582
* Merge changes from github.Gravatar Yifei Feng2018-05-24
| | | | | | | Revert #18413. Too many internal test failures due to the name scope change caused by this change. Revert #18192. Cannot use re2::StringPiece internally. Need alternative for set call. Will pull and clean this up in a separate change. PiperOrigin-RevId: 197991247
* tfdbg: fix issue where total source file size exceeds gRPC message size limitGravatar Shanqing Cai2018-05-24
| | | | | | | | | | * Source file content is now sent one by one, making it less likely that individual messages will have sizes above the 4-MB gRPC message size limit. * In case the message for a single source file exceeds the limit, the client handles it gracefully by skipping the sending and print a warning message. Fixes: https://github.com/tensorflow/tensorboard/issues/1118 PiperOrigin-RevId: 197949416
* Internal ChangeGravatar A. Unique TensorFlower2018-05-22
| | | | PiperOrigin-RevId: 197661636
* Fix build failure for macos py3Gravatar James Qin2018-05-04
| | | | PiperOrigin-RevId: 195475780
* tfdbg + tflearn: replace deprecated classes and methods in example & docsGravatar Shanqing Cai2018-05-03
| | | | | | | | | * `tf.contrib.learn.Experiment` is deprecated. Remove it from debug_tflearn_iris.py. * Use `tf.estimator.DNNClassifier`, instead of the older one from `tf.contrib.learn`. * Use `train()`, instead of `fit()` of Estimators. * `Estimator.predict()` supports hooks. Add example lines for that. PiperOrigin-RevId: 195301913
* tfdbg: disable grpc_large_data_test on ASANGravatar Shanqing Cai2018-04-26
| | | | PiperOrigin-RevId: 194402869
* Merge changes from github.Gravatar Yifei Feng2018-04-23
| | | | PiperOrigin-RevId: 194031845
* Disabled some tests on WindowsGravatar A. Unique TensorFlower2018-04-03
| | | | PiperOrigin-RevId: 191494857
* Windows: Enable tensorflow/contrib in Bazel build (Second try)Gravatar A. Unique TensorFlower2018-04-02
| | | | | | This reverts commit 4e108ef30d7cd7ae5e1c550ec5ae27e79b8c6e39. PiperOrigin-RevId: 191391075
* Remove all_opensource_files. It's not needed any more.Gravatar Martin Wicke2018-03-28
| | | | PiperOrigin-RevId: 190878279
* tfdbg CLI: Allow node exclusion with tensor filtersGravatar Shanqing Cai2018-03-26
| | | | | | | | | | | | | | | | | Fixes: #16619 See the referred GitHub issue for details, but users want to be able to skip certain nodes when searching for inf/nans, because some nodes generate inf/nans even in nominal conditions. This CL adds a new optional flag `--filter_exclude_node_names` (or `-fenn` for short), which allows users to do exactly that, by using a regex for node names. RELNOTES: tfdbg CLI: Allow exclusion of nodes by regular expressions during tensor filter-enabled Session runs: see the new flags `--filter_exclude_node_names` (or `-fenn` for short). PiperOrigin-RevId: 190504225
* tfdbg: Curses CLI: Fill line-end whitespace with default color pairGravatar Shanqing Cai2018-03-20
| | | | | | | | to prevent spurious color pairs from appearing in certain text terminal environments. RELNOTES: Bug fix: tfdbg curses CLI: fix spurious background colors in some text terminals. PiperOrigin-RevId: 189742433
* Automated g4 rollback of changelist 189231636Gravatar A. Unique TensorFlower2018-03-15
| | | | PiperOrigin-RevId: 189258641
* Merge changes from github.Gravatar Jacques Pienaar2018-03-15
| | | | PiperOrigin-RevId: 189231636
* tfdbg: split session_debug_grpc_testGravatar Shanqing Cai2018-03-13
| | | | | | | | | | | * so that the test sizes are medium for both the existing session_debug_grpc_test and the new grpc_large_data_test Also in this CL * Consolidate the functions for creating no-grappler-rewrite ConfigProtos in one place: in session_debug_testlib.py PiperOrigin-RevId: 188955135
* tfdbg: add reference to the TensorBoard Debugger Plugin in README.mdGravatar Shanqing Cai2018-03-12
| | | | PiperOrigin-RevId: 188828898
* Removing underscore prefixes from hidden generated Python functions.Gravatar Anna R2018-02-28
| | | | PiperOrigin-RevId: 187386941
* Internal change.Gravatar Jeremy Lau2018-02-21
| | | | PiperOrigin-RevId: 186510594
* Merge changes from github.Gravatar Ankur Taly2018-02-16
| | | | PiperOrigin-RevId: 186073337
* TensorBoard debugger plugin: SIGINT handler for easier termination of ↵Gravatar Shanqing Cai2018-02-13
| | | | | | | | debugged runtime from TensorBoardDebugWrapperSession and TensorBoardDebugHook. PiperOrigin-RevId: 185617989
* Merge changes from github.Gravatar Michael Case2018-02-07
| | | | PiperOrigin-RevId: 184897758
* Improve model_pruner:Gravatar A. Unique TensorFlower2018-02-07
| | | | | | | | | | | | | | * Actually remove nodes marked for removal if fetches are known. * Remove trivial nodes even in the presence of control inputs, except for Identity nodes when a) they are anchored on an Identity following a Switch node and removal would require anchoring a control identity on the Switch, or b) they have control inputs and feed a Merge node. * Remove nodes only when in_degree * out_degree <= in_degree + out_degree. Move input deduping utility function to utils.{h,cc}. PiperOrigin-RevId: 184858685
* tfdbg: deflake session_debug_file_testGravatar Shanqing Cai2018-02-06
| | | | | | by disabling grappler in the test. PiperOrigin-RevId: 184721353
* Remove Identity nodes if num_inputs * num_outputs <= num_inputs + ↵Gravatar A. Unique TensorFlower2018-01-29
| | | | | | | | num_outputs. Exceptions are Identity nodes after Variable nodes, and Identity nodes after Switch nodes when removing the node would require anchoring a control dependency on the Switch. Another exception is Identity nodes where inputs or outputs cross a device boundary, since we are not allowed to remove Identity nodes after _Recv that might be inserted in the graph later. PiperOrigin-RevId: 183759826
* tfdbg: let session wrappers handle empty fetches correctlyGravatar Shanqing Cai2018-01-29
| | | | | Fixes: #15882 PiperOrigin-RevId: 183685645
* tfdbg: add tensorboard debugger plugin option to three existing examplesGravatar Shanqing Cai2018-01-29
| | | | PiperOrigin-RevId: 183661140
* Add C0301 line-too-long error to pylint sanity check.Gravatar Yifei Feng2018-01-26
| | | | PiperOrigin-RevId: 183467186