aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/core/kernels/data/group_by_reducer_dataset_op.cc
Commit message (Collapse)AuthorAge
* [tf.data Introducing tf.data.Dataset.reduce() which reduces elements of a ↵Gravatar Jiri Simsa2018-09-27
| | | | | | (finite) dataset to a single element. PiperOrigin-RevId: 214852364
* Automated rollback of commit b1ff7c2cedcc7d49d430d56655870e6d68a0c8f7Gravatar Derek Murray2018-09-18
| | | | PiperOrigin-RevId: 213528716
* Creating an InstantiatedCapturedFunction that captures the instantiated ↵Gravatar Rohan Jain2018-09-18
| | | | | | | | state of a function to be executed, separating it out from the non instantiated regular state such as function name, captured inputs etc. This allows us to truly separate Dataset kernel creation from Iterator creation i.e. each time a dataset is created that uses functions, we create only a CapturedFunction whereas we create an InstantiatedCapturedFunction each time a new iterator is created. PiperOrigin-RevId: 213456128
* [tf.data] Move all C++ code inside the `tensorflow::data` namespace.Gravatar Derek Murray2018-09-05
| | | | PiperOrigin-RevId: 211733735
* [tf.data] Enable optimizations for input pipelines with stateful functions.Gravatar Jiri Simsa2018-08-28
| | | | PiperOrigin-RevId: 210559796
* [tf.data] Move captured function instantiation to iterator initialization time.Gravatar Derek Murray2018-08-21
| | | | | | | | | | Previously, a function instantiation error (e.g. in `Dataset.map()`) would lead to an error in each GetNext() call that attempted to use the function. Moving this to iterator instantiation time has the benefit that the error will be reported once when the initialization op is executed, which has a more helpful stack trace, since it should not be conflated with other potential op failures. PiperOrigin-RevId: 209633511
* [tf.data] Internal refactoring of C++ classes and APIs.Gravatar Jiri Simsa2018-08-13
| | | | | | | | | | - replacing `OpKernelContext` with newly introduced `DatasetContext` in `DatasetBase` constructor to make it possible to instantiate `DatasetBase` in places where an instance of `OpKernelContext` is not available - replacing `dataset::MakeIteratorContext(OpKernelContext* ctx)` factory with `IteratorContext(OpKernelContext *ctx)` constructor. - folding `GraphDatasetBase` into `DataseBase` and removing the default implementation of `AsGraphDefInternal`, making it the responsibility of the derived class to implement it to encourage/hint developers to provide serialization logic PiperOrigin-RevId: 208560010
* [tf.data] Optimization checkpointing improvements.Gravatar Jiri Simsa2018-08-10
| | | | | | | | This CL: - changes the `OptimizeDataset` checkpointing logic to checkpoint the optimized dataset (as opposed to the original dataset + the optimizations, re-running optimization every time a checkpoint is restored) - replaces `OpKernelContext` with newly introduced `SerializationContext` in the signature of `AsGraphDefInternal` to reduce the scope of the context and also simplify the logic for overriding the `FunctionLibraryDefinition` when optimizations take place PiperOrigin-RevId: 208282562
* [tf.data] Minor API refactoring.Gravatar Jiri Simsa2018-08-10
| | | | | | Renaming `AddParentDataset`, `SaveParent`, and `RestoreParent` to `AddInputDataset`, `SaveInput`, and `RestoreInput`. PiperOrigin-RevId: 208272695
* [tf.data] Experimental transformations for windowing and batching of windows.Gravatar Jiri Simsa2018-07-03
| | | | | | | | This change introduces the `window` tf.data transformation, which can be used to create windows of elements (represented as a dataset) from a dataset. This transformation enables applying different batching logic to different components of a dataset. To illustrate the benefits of the transformation, this CL also introduces transformations for batching and padded batching of windows of both dense and sparse tensors. Notably, padded batching of sparse tensors was previously not possible. PiperOrigin-RevId: 203179522
* [tf.data] Mark DebugString() as const.Gravatar Brennan Saeta2018-05-31
| | | | | | By marking DebugString() as const we can make some error messages more descriptive. Because DatasetIterator marks the return value of the dataset() function const, DebugString() cannot be called. PiperOrigin-RevId: 198796894
* [tf.data] Changing signature of `MakeIterator` to enable propagating error ↵Gravatar Jiri Simsa2018-05-31
| | | | | | status. PiperOrigin-RevId: 198772254
* [tf.data] Adding an experimental `group_by_reducer` transformation which ↵Gravatar Jiri Simsa2018-04-30
groups elements of an input pipeline by a key, applies a reduce function to elements of each group "on-the-fly", and outputs the results once all input elements have been processed. PiperOrigin-RevId: 194874087
generated by cgit v1.2.3 (git 2.39.1) at 2024-06-27 02:04:24 +0000