aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/core/kernels
Commit message (Collapse)AuthorAge
* Add 'remove' operation to MutableHashTable and MutableDenseHashTable.Gravatar A. Unique TensorFlower2018-10-09
| | | | PiperOrigin-RevId: 216443201
* Add RaggedTensors to tf.core. Moving the RaggedGather op kernel.Gravatar A. Unique TensorFlower2018-10-09
| | | | PiperOrigin-RevId: 216400726
* [tf.data] NUMA-aware MapAndBatch dataset.Gravatar Brennan Saeta2018-10-09
| | | | PiperOrigin-RevId: 216395709
* Create SDCAOptimizerV2 op to fix the "adaptative" typo.Gravatar Yuefeng Zhou2018-10-09
| | | | PiperOrigin-RevId: 216370193
* Register int64 SUM GPU kernel.Gravatar James Qin2018-10-08
| | | | PiperOrigin-RevId: 216280913
* Fix the seeding for `Dataset.shuffle(..., reshuffle_each_iteration=False)`.Gravatar Derek Murray2018-10-08
| | | | | | | | | Previously, we were passing the first (graph-level) seed for both the graph-level and op-level seeds when creating a C++ dataset. This change passes the op-level seed to the appropriate point, and adds a test for the behavior with graph-but-not-op-level seeds. PiperOrigin-RevId: 216280641
* Automated rollback of commit 13b47e6c4f9d7b295948b1057139bf676e394b6fGravatar Derek Murray2018-10-08
| | | | PiperOrigin-RevId: 216260575
* Automated rollback of commit 09b0fc199129e0f487a39741bdf674cf09035cbcGravatar Derek Murray2018-10-08
| | | | PiperOrigin-RevId: 216256115
* [tf.data] Choose non-deterministic seed once per Python-level `Dataset` object.Gravatar Derek Murray2018-10-08
| | | | | | | | | | This changes the behavior of randomness-introducing datasets (`tf.data.Dataset.shuffle()`, `tf.data.experimental.shuffle_and_repeat()`, and `tf.data.experimental.RandomDataset`). Previously, when you used the same `tf.data.Dataset` object multiple times in a pipeline (e.g. by zipping two datasets derived from the same randomness-introducing dataset) *and* you did not specify an explicit `seed`, the implementation would choose different non-deterministic seeds for each use of the `Dataset` object. With this change, the seed will be chosen once per `Dataset` (technically, once per `Dataset`-`Graph` combination, due to the vagaries of capturing state in `Dataset.make_one_shot_iterator()`), which means that all uses of the same dataset object will observe the same sequence of values. This change also revealed a small bug in how `Dataset.shuffle(..., reshuffle_each_iteration=False)` is serialized when an explicit seed is specified. The op-level seed was dropped, which could lead to non-deterministic behavior. This change fixes that issue by forwarding the op-level seed to the appropriate place. PiperOrigin-RevId: 216248013
* Automated rollback of commit 295b3c80555cc82d8d70faf96a47681e1d904b9cGravatar Derek Murray2018-10-08
| | | | PiperOrigin-RevId: 216247929
* Merge pull request #21658 from lowintelligence:masterGravatar TensorFlower Gardener2018-10-08
|\ | | | | | | PiperOrigin-RevId: 216217509
* | [tf.data] Adding specialization for `MapDataset`, `ParallelMapDataset`, and ↵Gravatar Jiri Simsa2018-10-08
| | | | | | | | | | | | `MapAndBatchDataset` whose user-provided functions have the property that each output argument take its value directly from an input argument (e.g. `lambda x, y: y, x`). This specialization can produce the result without having to schedule the function using the executor. PiperOrigin-RevId: 216206232
* | Fix compilation in unique_op when Eigen::Index != int64.Gravatar A. Unique TensorFlower2018-10-08
| | | | | | | | PiperOrigin-RevId: 216205396
* | Merge pull request #22386 from girving:statelessGravatar TensorFlower Gardener2018-10-05
|\ \ | | | | | | | | | PiperOrigin-RevId: 215995215
| * | Expand stateless random generators to match their stateful cousinsGravatar Geoffrey Irving2018-10-05
| | | | | | | | | | | | | | | | | | | | | | | | | | | stateless_random_uniform now take minval+maxval and handles ints, and stateless_normal/stateless_truncated_normal take mean+stddev. Additionally, all of the stateless functions now have proper doc strings. This is step one of moving stateless random numbers out of contrib.
* | | Automated rollback of commit ae0bc6f006497cc04a2ee75166d4ec71c7154fd8Gravatar Jiri Simsa2018-10-05
| | | | | | | | | | | | PiperOrigin-RevId: 215969360
* | | [tf.data] Adding specialization for `MapDataset`, `ParallelMapDataset`, and ↵Gravatar Jiri Simsa2018-10-05
| | | | | | | | | | | | | | | | | | `MapAndBatchDataset` whose user-provided functions have the property that each output argument take its value directly from an input argument (e.g. `lambda x, y: y, x`). This specialization can produce the result without having to schedule the function using the executor. PiperOrigin-RevId: 215957592
* | | Error out when PartitionedCall is created with the wrong number of arguments.Gravatar Alexandre Passos2018-10-04
| | | | | | | | | | | | | | | | | | (used to be a segfault) PiperOrigin-RevId: 215791737
* | | [tf.data] Add a notion of `captured args` to MapDefunGravatar Rachel Lim2018-10-04
| | | | | | | | | | | | PiperOrigin-RevId: 215788485
* | | Remove obsolete TODO.Gravatar Paul Donnelly2018-10-04
| | | | | | | | | | | | PiperOrigin-RevId: 215780734
* | | Add "encoding" attribute to string substr op, which controls how each ↵Gravatar A. Unique TensorFlower2018-10-04
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | "character" is treated: * BYTE: Position & length refer to bytes in the string. (Default) * UTF8: The string is interpreted as UTF-8 encoded Unicode code points, and position & length are treated relative to them. RELNOTES: Add option to get substring using Unicode characters PiperOrigin-RevId: 215773373
* | | [tf.data] Fix C++ shape inference for `Dataset.concatenate()`.Gravatar Derek Murray2018-10-04
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Previously, we were returning an unknown shape in `Dataset::output_shapes()` for the "most specific compatible shape" between the two inputs. While this does not cause correctness problems (since the unknown shape *is* compatible), we gain the ability to raise errors earlier when more shape information is available. PiperOrigin-RevId: 215764530
* | | Gracefully disallow updating resource variables with invalid shapes.Gravatar Asim Shankar2018-10-04
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | During graph construction, the shape function for AssignAddVariableOp etc. would raise an error when the value being "assign add"ed to the variable has an incompatible shape. With eager execution, no such validation was being made which triggerred an assertion failure in eigen: https://github.com/eigenteam/eigen-git-mirror/blob/7d97e1cbbe4424fda39e31c88def7c0863897640/unsupported/Eigen/CXX11/src/Tensor/TensorEvaluator.h#L479 This change prevents that assertion failure. PiperOrigin-RevId: 215749071
* | [tf.data] Fix bug in `tf.data.experimental.unbatch()`.Gravatar Derek Murray2018-10-03
| | | | | | | | | | | | | | | | | | Previously, if the rank of the input to this transformation was statically unknown, we would erroneously report that the output is a scalar, and violate downstream shape integrity checks. Instead, in that case the output shape should be unknown. PiperOrigin-RevId: 215683027
* | [data-stats] Sets user given `tag` and `counter_prefix` with ↵Gravatar Shivani Agrawal2018-10-03
| | | | | | | | | | | | | | | | `set_stats_aggregator`. `tag` would get prep-end with all the statistics recorded as summary and `counter_prefix` would set the prefix for the statistics recorded as counter. Note: `counter` defaults to `\tensorflow`, and `tag` and `prefix` gets associated with the dataset (not the stats_aggregator). PiperOrigin-RevId: 215609159
* | Automated rollback of commit c9bdd3938e2b43334a0065b4c198ec9d491c8cb8Gravatar Derek Murray2018-10-03
| | | | | | | | PiperOrigin-RevId: 215607038
* | [tf.data] Switch background threads to use `BackgroundWorker`.Gravatar Derek Murray2018-10-03
| | | | | | | | PiperOrigin-RevId: 215579950
* | [tf.data] Adding `tf.data.Options()`, `tf.data.Dataset.options()`, and ↵Gravatar Jiri Simsa2018-10-01
| | | | | | | | | | | | `tf.data.Dataset.with_options()` to make it possible to respectively represent, get, and set options, such as optimization configuration, of a tf.data input pipeline. PiperOrigin-RevId: 215310764
* | [tf.data] More robust solution for input pipeline <--> performance model ↵Gravatar Jiri Simsa2018-10-01
| | | | | | | | | | | | coordination. PiperOrigin-RevId: 215309735
* | Fixes possible out-of-bounds access by strided slice.Gravatar Alexandre Passos2018-10-01
| | | | | | | | PiperOrigin-RevId: 215269882
* | Automated rollback of commit 6a787235b95dd3040fc5ff7fb7104585e746c66aGravatar Christopher Olston2018-10-01
| | | | | | | | PiperOrigin-RevId: 215248737
* | Merge pull request #22571 from Intel-tensorflow:agramesh/fix_mkl_sliceGravatar TensorFlower Gardener2018-09-30
|\ \ | | | | | | | | | PiperOrigin-RevId: 215161850
* | | [TF] Fix incorrect type constraint on _VarHandlesOp kernel on GPU. The ↵Gravatar Peter Hawkins2018-09-28
| | | | | | | | | | | | | | | | | | kernel supports any combination of the dtypes, and does not need a separate kernel for each dtype. PiperOrigin-RevId: 215019812
* | | [tf.data] Use `std::make_shared` as appropriate in `ParallelMapIterator`.Gravatar Derek Murray2018-09-28
| | | | | | | | | | | | PiperOrigin-RevId: 215019058
* | | Copy shape into CollectiveParams only once per CollectiveReduce kernel.Gravatar Ayush Dubey2018-09-28
| | | | | | | | | | | | PiperOrigin-RevId: 214997213
* | | Internal change.Gravatar A. Unique TensorFlower2018-09-28
| | | | | | | | | | | | PiperOrigin-RevId: 214986756
* | | Merge pull request #22324 from Intel-tensorflow:fix_typo_envGravatar TensorFlower Gardener2018-09-28
|\ \ \ | | | | | | | | | | | | PiperOrigin-RevId: 214983237
* | | | [tf.data] Referencing an internal issue.Gravatar Jiri Simsa2018-09-28
| | | | | | | | | | | | | | | | PiperOrigin-RevId: 214964640
* | | | [tf.data] Throws appropriate error while trying to checkpoint input pipeline ↵Gravatar Shivani Agrawal2018-09-28
| | | | | | | | | | | | | | | | | | | | | | | | with associated stats_aggregator. PiperOrigin-RevId: 214961678
* | | | Roll-forward of CL 214320700: Split up SPARSE_DEPS, adding each individual ↵Gravatar A. Unique TensorFlower2018-09-28
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | dependency only to the sparse operators that need it. Automated rollback of commit 120620caf23a044b8aa2db6ba5984384ec936009 PiperOrigin-RevId: 214950946
* | | | [tf.data] Move `tf.contrib.data` C++ code to a core "experimental" directory.Gravatar Derek Murray2018-09-28
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | NOTE: All ops and kernels previously previously defined in tensorflow/contrib/data have had their name prefixed with "Experimental" to indicate that they are not (yet) stable, and thus not subject to backwards or forwards compatibility guarantees. PiperOrigin-RevId: 214940819
* | | | Fixing a couple of small bugs with the multi device iterator having to dealGravatar Rohan Jain2018-09-28
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | with the case when the background thread terminated because the iterator finished and yet some other requests were coming in. 1. The GetNextFromShard would see an empty buffer and return cancelled instead of OutOfRange errors 2. On shutdown, we weren't calling all the pending callbacks. Tested with runs_per_test=5000 PiperOrigin-RevId: 214939274
* | | | [tf.data Introducing tf.data.Dataset.reduce() which reduces elements of a ↵Gravatar Jiri Simsa2018-09-27
| | | | | | | | | | | | | | | | | | | | | | | | (finite) dataset to a single element. PiperOrigin-RevId: 214852364
* | | | Merge pull request #22286 from Intel-tensorflow:nhasabni/unit-test-fixesGravatar TensorFlower Gardener2018-09-27
|\ \ \ \ | | | | | | | | | | | | | | | PiperOrigin-RevId: 214821528
* | | | | Dynamic subdivisions in collective ring reduce.Gravatar Ayush Dubey2018-09-27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Before this change, a CollectiveOp user was required to specify subdiv_offsets for the RingReduce algorithm. During ring reduction, we created chunks of the tensor to exchange between devices. If the chunks were too large, or if the hardware supported multiple data exchanges in parallel, the user could further subdivide the chunk by specifying more than 1 subdiv offset. Each subdiv offset corresponded to another subdivision of the chunk, so effectively the total number of tensor chunks is number of devices * number of subdivs. After this change, we can dynamically infer the number of subdivisions based on a target chunk size. In ring_reducer.cc, we start with 1 subdiv, and keep increasing until chunk size is less than MAX_CHUNK_SIZE. Currently, MAX_CHUNK_SIZE is set at 4 MB, although it may make sense to change this based on specific hardware. As a part of this change, a user can now provide an empty subdiv_offset list. If empty, we dynamically add subdivisions based on the above algorithm. If non-empty, we take the user-specified subdivions. PiperOrigin-RevId: 214815959
| | | * | Merge branch 'master' into agramesh/fix_mkl_sliceGravatar AG Ramesh2018-09-27
| | | |\ \ | |_|_|/ / |/| | | |
* | | | | Add tf.strings.unicode_script, which detects the script of a unicode codepointGravatar A. Unique TensorFlower2018-09-27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | based on standard ranges. PiperOrigin-RevId: 214796357
* | | | | Merge pull request #22076 from Intel-tensorflow:feature/daoxin/sliceGravatar TensorFlower Gardener2018-09-26
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | PiperOrigin-RevId: 214726180
* | | | | | Add xlogy and xdivy op.Gravatar A. Unique TensorFlower2018-09-26
| | | | | | | | | | | | | | | | | | | | | | | | PiperOrigin-RevId: 214700693
* | | | | | Extract Conv2D dimensions parsing and validation into helper functions.Gravatar Eugene Zhulenev2018-09-26
| | | | | | | | | | | | | | | | | | | | | | | | PiperOrigin-RevId: 214691838
generated by cgit v1.2.3 (git 2.39.1) at 2024-06-03 15:38:30 +0000