aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/python/kernel_tests/parsing_ops_test.py
Commit message (Collapse)AuthorAge
* Move from deprecated self.test_session() to self.cached_session().Gravatar A. Unique TensorFlower2018-09-13
| | | | | | | | self.test_session() has been deprecated in 9962eb5e84b15e309410071b06c2ed2d6148ed44 as its name confuses readers of the test. Moving to cached_session() instead which is more explicit about: * the fact that the session may be reused. * the session is not closed even when doing a "with self.test_session()" statement. PiperOrigin-RevId: 212766976
* Add a batch sequence example parsing op, part 2.Gravatar Patrik Sundberg2018-08-31
| | | | PiperOrigin-RevId: 211082479
* Add test coverage for example parsing with a feature that is an empty string.Gravatar Derek Murray2017-12-21
| | | | PiperOrigin-RevId: 179875758
* FixedLenSequenceFeature for parsing a variable-length tensor with ↵Gravatar A. Unique TensorFlower2017-03-23
| | | | | | parse_single_example. Change: 151038761
* Identify and fix bug in handling of variable-length data in ExampleParserOp.Gravatar Eugene Brevdo2017-03-17
| | | | | | | The bug was that the parsing code generated blocks of output, where each block may contain 0 or more var-len batch entries. I had originally assumed that each block corresponded to a single minibatch entry. The existing unit tests were small enough that this always ended up to be true because for small batch sizes, the thread pool just gave each minibatch entry its own block. But for any reasonable batch size, this assumption broke down and I would accidentally skip copying some minibatch data to the output Tensors. This has now been fixed. Change: 150509644
* Add support for FixedLenSequenceFeature for parse_example/parse_single_example.Gravatar A. Unique TensorFlower2017-03-13
| | | | | With this you may parse variable-length feature of the Example into a padded Tensor. Change: 150009250
* Adding support for higher rank SparseFeatures.Gravatar A. Unique TensorFlower2017-03-01
| | | | Change: 148942856
* Add support for variable major dimension in dense features in example parser ↵Gravatar Eugene Brevdo2017-02-07
| | | | | | | c++ op. Full python support (including more comprehensive documentation) coming soon. Change: 146852707
* Allow empty tf.Features in the FeatureLists for sparse sequence examples.Gravatar A. Unique TensorFlower2017-01-06
| | | | Change: 143802382
* Small fix for named arguments in SparseFeature parsing.Gravatar A. Unique TensorFlower2017-01-06
| | | | Change: 143799509
* Remove hourglass imports from kernel_testsGravatar Justine Tunney2016-12-14
| | | | Change: 142080137
* Part 2c of renaming SparseTensor.shape -> SparseTensor.dense_shapeGravatar Eugene Brevdo2016-12-05
| | | | Change: 141066682
* Type information in error logging for ParseExample.Gravatar A. Unique TensorFlower2016-12-01
| | | | Change: 140763104
* Adding a SparseFeature to the tf.Example parser API.Gravatar A. Unique TensorFlower2016-11-30
| | | | | | | Allows declaring two Example keys (an index key and a value key) for a single Feature, the returned value is a SparseTensor with indices given by the index key. Change: 140671682
* Make concatenated example parsing semantics identical to standard parser.Gravatar A. Unique TensorFlower2016-09-23
| | | | | Also: factor out common code, improve collision detection, add fuzzer test, add some monitoring. Change: 134127077
* Add a new parse_tensor op for parsing a serialized TensorProto into a Tensor.Gravatar A. Unique TensorFlower2016-08-12
| | | | Change: 130143090
* Fix tf.Example parsing when the Example feature name is provided, but noGravatar Eugene Brevdo2016-08-04
| | | | | | | | | value exists. In this case, if no default is given then the error should be correct. If a default *is* provided, it should be used. Also, reformatted the parsing_ops_test.py file (which doesn't lose history, since it hasn't changed much since my original version). Change: 129393762
* Update copyright for 3p/tf/python.Gravatar A. Unique TensorFlower2016-06-02
| | | | Change: 123900456
* Remove the ability to run the entire graph by passing an empty target list.Gravatar Derek Murray2016-04-20
| | | | | This was only used in testing, and when used in the wild could lead to confusing behavior (by running all of the nodes in the graph and performing all of their side effects) such as placeholder-not-fed errors or deadlocks. Change: 120329908
* Get rid of some import cruft.Gravatar Josh Levenberg2016-02-10
| | | | Change: 114374558
* Merge changes from GitHub, clean up linter errors, fix dependencies test.Gravatar Martin Wicke2016-02-07
| | | | Change: 114064632
* Fix python3 issuesGravatar Martin Wicke2016-02-06
| | | | Change: 114043720
* Fix a test for Python 3Gravatar Geoffrey Irving2016-01-21
| | | | Change: 112703190
* Adds `tf.decode_json_example()` op that parses JSON into binary Example protos.Gravatar Derek Murray2016-01-20
| | | | Change: 112615357
* Change: 111879963Gravatar Vijay Vasudevan2016-01-11
|
* Add new parse_example functions that take namedtuple config objects, and ↵Gravatar A. Unique TensorFlower2016-01-11
| | | | | | prepend old API functions with "legacy_". Change: 111745511
* Fix parse_single_sequence_example to not fail when debug_name is NoneGravatar A. Unique TensorFlower2016-01-06
| | | | Change: 111526769
* Added 'logging' import to control_flow_ops which is used in the file but not ↵Gravatar A. Unique TensorFlower2016-01-05
| | | | | | imported. Change: 110842260
* TensorFlow: merge changes from internalGravatar Vijay Vasudevan2015-12-11
| | | | | | | | | | | | | | | | | | | | | Change 110004767 Add Cast to list of supported ConstantValue ops, mainly useful for shape inference Change 110002200 Bug fix for b/24814668. The fix uses mdevin's CL/109324239, which adds support to clear control dependency and control flow contexts. Bug fix for b/25914830. We now clear the control related contexts for initial values of variables in adagrad. Change 110000213 Further (minor) improvements to print usage in docs and tutorials Change 109975099 Update `tensor_util.ConstantValue()` to return scalars when appropriate. The `ConstantValue()` implementations for `tf.size()` and `tf.rank()` were returning single-element numpy vectors, whereas the op implementations produce scalar outputs. Change 109950165 TensorBoard tag to 5 Base CL: 110006867
* TensorFlow: upstream latest changes to git.Gravatar Vijay Vasudevan2015-12-06
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change 109537918 TensorFlow pip setup: wheel >= 0.26 for python3 pip install Change 109505848 Fix distortion default value to 1.0 in fixed_unigram_candidate_sampler. This means we default to the actual provided unigram distribution, instead of to the uniform (as it is currently). Change 109470494 Bugfix in gradients calculation when the ys rely on each other. Change 109467619 Fix CIFAR-10 model to train on all the training data instead of just 80% of it. Fixes #396. Change 109467557 Replaced checkpoint file with binary GraphDef. Change 109467433 Updates to C++ tutorial section. Change 109465269 TensorFlow: update documentation for tutorials to not assume use of bazel (when possible). Change 109462916 A tutorial for image recognition to coincide with the release of the latest Inception image classification model. Change 109462342 Clear control dependencies in variable_scope.get_variable() when creating ops for the initializer. Add tests of various error conditions. Change 109461981 Various performance improvements in low-level node execution code paths. Speeds up ptb_word_lm on my desktop with a Titan X from 3638 words per second to 3751 words per second (3.1% speedup). Changes include: o Avoided many strcmp operations per node execution and extra touches of cache lines in executor.cc, by making all the various IsMerge, IsSwitch, IsSend, etc. operations instead be based on an internal enum value that is pre-computed at Node construction time, rather than doing string comparisons against node->type_string(). We were doing about 6 such comparisons per executed node. o Removed mutex_lock in executor.cc in ExecutorState::Process. The lock was not needed and the comment about the iterations array being potentially resized is not true (the iterations arrays are created with a fixed size). Checked with yuanbyu to confirm this. o Added new two-argument port::Tracing::ScopedAnnotation constructor that takes two StringPiece arguments, and only concatenates them lazily if tracing is enabled. Also changed the code in platform/tracing.{h,cc} so that the ScopedAnnotation constructor and the TraceMe constructor can be inlined. o In BaseGPUDevice::Compute, used the two-argument ScopedAnnotation constructor to avoid doing StrCat(opkernel->name(), ":", op_kernel->type_string()) on every node execution on a GPU. o Introduced a new TensorReference class that just holds a reference to an underlying TensorBuffer, and requires an explicit Unref(). o Changed the EventMgr interface to take a vector of TensorReference objects for EventMgr::ThenDeleteTensors, rather than a vector of Tensor objects. o Used TensorReference in a few places in gpu_util.cc o Minor: switched to using InlinedVectors in a few places to get better cache locality. Change 109456692 Updated the label_image example to use the latest Inception model Change 109456545 Provides classify_image which performs image recognition on a 1000 object label set. $ ./classify_image giant panda, panda, panda bear, coon bear, Ailuropoda melanoleuca (score = 0.88493) indri, indris, Indri indri, Indri brevicaudatus (score = 0.00878) lesser panda, red panda, panda, bear cat, cat bear, Ailurus fulgens (score = 0.00317) custard apple (score = 0.00149) earthstar (score = 0.00127) Change 109455002 TensorFlow: make the helper libraries for various models available in the pip package so that when users type: python translate.py ... the absolute import works. This change is supposed to help make our tutorials run without the *need* to use bazel. Change 109450041 TensorFlow: remove cifar and convolutional binary copies from pip install. Adds embedding and some other models to the list. Change 109448520 Move the description of a failing invariant from a comment into the dcheck-fail message text. Change 109447577 TensorBoard has release tagging (tensorboard/TAG) Also track TensorBoard changes (tensorboard/CHANGES) Change 109444161 Added ParseSingleSequenceExample + python wrappers + unit tests. Change 109440864 Update all the TensorFlow Dockerfiles, and simplify GPU containers. This change updates all four of our Dockerfiles to match the targets discussed in https://github.com/tensorflow/tensorflow/issues/149. The most notable change here is moving the GPU images to use the NVidia containers which include cudnn and other build-time dependencies, dramatically simplifying both the build and run steps. A description of which tags exist and get pushed where will be in a follow-up. Change 109432591 Some pylint and pydoc changes in saver. Change 109430127 Remove unused hydrogen components Change 109419354 The RNN api, although moved into python/ops/, remains undocumented. It may still change at any time. Base CL: 109538006
* TensorFlow: Upstream changes to git.Gravatar Vijay Vasudevan2015-12-03
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change 109344341 Teach ./configure about Python 3 (and other minor Python 3 issues) ./configure now writes bazel.rc based on a bazel.rc.template, which gives us a place to tell bazel which version of Python we were using. Also fix a few tests whose Python 3 support had degraded. The only thing left before we have Python 3 support is https://github.com/google/protobuf/pull/1023 Change 109343002 Update ops.pbtxt to reflect 109321497. Change 109342838 Do memory deallocation outside the critical section in gpu_event_mgr.cc. Change 109334210 PTB LSTM example: use slicing instead of splitting the inputs. Change 109332238 Cleanup TensorBoard local development environment Change 109331051 Use __all__ in __init__.py to restrict exported modules Specifically, __all__ is now anything that (1) doesn't begin with an underscore and (2) isn't a non-whitelisted module. This fixes one tiny piece of b/25561952. Specifically, the following no longer exist: tf.np, tf.math_ops, and tf.variables. tf.ops and tf.tensor_util still exist but shouldn't; that will have to wait for a later CL. Change 109327154 tf.tuple allow Tensors to be passed in as control_inputs like tf.control_dependencies. Change 109324239 Make tf.control_dependencies(None) clear the control dependencies. Use that to prevent ops created for Variables to inherit the current control dependencies. This fixes issues when using ExponentialMovingAverages with control dependencies. Change 109323719 Added support for boolean tf.scatter_update. Base CL: 109348398
* TensorFlow: Upstream changes to git.Gravatar Vijay Vasudevan2015-12-02
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change 109240606 Fix typo Change 109240358 Fix bug in Concat's shape inference due to legacy scalar handling. The shape function was inadvertently converting outputs of unknown shape (rank=None) to vectors of unknown length (rank=1), due to inability to distinguish between legacy scalars and vectors, because `max(1, None)` is 1. Change 109237152 Remove numarray requirement in python_config. Change 109234003 Fix typo in elu documentation. Change 109232946 Python must now be configured via ./configure script Change 109232134 Backported fixes to the tensor comparison operators from the public Eigen repository Change 109231761 Test invalid inputs to softmax_cross_entropy_with_logits. Change 109230218 Backported fixes to the tensor comparison operators from the public Eigen repository Change 109229915 Correct comments in seq2seq to show the right input types for embedding models. (Thanks to hugman@github for bringing this up.) Change 109229118 Fix resize_images example in documentation and allow resize_images to run on a single image with partially-known shape. Change 109228940 Fix demo and node add/remove button spacing Change 109227909 Include Elu in the NN docs. Change 109227059 Adds variable_op_scope and makes variable_scope always add a name_scope. This creates an op scope for variables that makes it easy to create independent operations with a default name by making that name unique for the current scope and it allows explicit names that are not made unique. Change 109224492 Streamline yuv -> rgb conversion to be done in one pass in native code. The entire process now takes ~2ms (including the ByteBuffer.get() calls), down from 10+ ms when the arrays were being interleaved in Java prior to conversion. Also abstracting common yuv->rgb color conversion into helper method. Change 109224389 Add ability to move nodes in and out of auxiliary nodes in graph. Change 109217177 Update generated Op docs. Change 109215030 Implementation of the ELU activation function: http://arxiv.org/abs/1511.07289 Change 109209848 When GPUBFCAllocator runs out of memory, also log a summary of chunks in use by size. Change 109206569 Switched to the public version of the Eigen::sign method since it supports complex numbers. Change 109199813 Modify tensorflow.SequenceExample to support multiple-length sequences. Base CL: 109241553
* TensorFlow: Upstream changes to gitGravatar Manjunath Kudlur2015-11-25
| | | | | | | | | Changes: - Updates to docs - Several changes for Python 3 compatibility - Added license headers Base CL: 108710566
* TensorFlow: Improve performance of AlexnetGravatar Manjunath Kudlur2015-11-20
| | | | | | | | | | | | | | | | | | | | | | Changes: * error message that refers to removed `DefaultSession` method. * -Wnull-conversion warnings * the "_start_time" attr for recvs when the flag "--brain_enable_scheduling_for_recvs" is set. * typo in tutorial data download progress message. * a typo ("however their installing"=>"however installing"). * typo, rename "TensorFlow Mechanics" to "How To" to be consistent with the website. * a typo ("subtact"=>"subtract"). * protobuf examples in comments in tensorflow::Example.proto. * formula formatting in MNIST beginner tutorial * negative fraction-of-queue-full stats * protobuf inclusion path so that Android demo will build under Blaze. * small typo (moderatly > moderately) * Session.run() to check that tensor arguments come from the session's graph. * another six import * seq2seq typo in bazel command Base CL: 108349164
* TensorFlow: upstream changes from the afternoon.Gravatar Vijay Vasudevan2015-11-11
| | | | | | | | | | | | | | | | | | | | | | | | | | Changes: - futurize --stage2 changes for Python 3 compatibility by @girving. - Small updates to documentation by @vrv, schuster and others - Account for failure of std::thread::hardware_concurrency by @ebrevdo. - More changes for backwards-compatibility tests by Josh - Updates to python op doc generation by Josh - Added support for using the best-fit allocator via ConfigProto by @vrv. - Rename LocalSession to DirectSession, since local was a bad name for it. - Enable tf.nn.moments() to work with tensors of unknown shape by @mrry. GITHUB_ISSUE: 139 - Changes for Android build by Andrew. Base CL: 107645181
* TensorFlow: upstream changes to git (doc fixes).Gravatar Vijay Vasudevan2015-11-10
| | | | | | | | | | | | | | | | | | | Changes: - Fix typos across several files contributed by Erik Erwitt, and Michael R. Berstein - Fix bug in translate example (fr->en typo) by schuster - Updates to some documentation (mcoram,shlens,vrv,joshl) - Fix to Android camera demo app window size detection (andrewharp) - Fix to support lookup table of high rank tensors (yleon) - Fix invalid op names for parse_example (dga) Base CL: 107531031
* TensorFlow: Initial commit of TensorFlow library.Gravatar Manjunath Kudlur2015-11-06
TensorFlow is an open source software library for numerical computation using data flow graphs. Base CL: 107276108