aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/core/kernels/data/concatenate_dataset_op.cc
Commit message (Collapse)AuthorAge
* [tf.data] Fix C++ shape inference for `Dataset.concatenate()`.Gravatar Derek Murray2018-10-04
| | | | | | | | | | Previously, we were returning an unknown shape in `Dataset::output_shapes()` for the "most specific compatible shape" between the two inputs. While this does not cause correctness problems (since the unknown shape *is* compatible), we gain the ability to raise errors earlier when more shape information is available. PiperOrigin-RevId: 215764530
* [tf.data] Move all C++ code inside the `tensorflow::data` namespace.Gravatar Derek Murray2018-09-05
| | | | PiperOrigin-RevId: 211733735
* [tf.data] Internal refactoring of C++ classes and APIs.Gravatar Jiri Simsa2018-08-13
| | | | | | | | | | - replacing `OpKernelContext` with newly introduced `DatasetContext` in `DatasetBase` constructor to make it possible to instantiate `DatasetBase` in places where an instance of `OpKernelContext` is not available - replacing `dataset::MakeIteratorContext(OpKernelContext* ctx)` factory with `IteratorContext(OpKernelContext *ctx)` constructor. - folding `GraphDatasetBase` into `DataseBase` and removing the default implementation of `AsGraphDefInternal`, making it the responsibility of the derived class to implement it to encourage/hint developers to provide serialization logic PiperOrigin-RevId: 208560010
* [tf.data] Optimization checkpointing improvements.Gravatar Jiri Simsa2018-08-10
| | | | | | | | This CL: - changes the `OptimizeDataset` checkpointing logic to checkpoint the optimized dataset (as opposed to the original dataset + the optimizations, re-running optimization every time a checkpoint is restored) - replaces `OpKernelContext` with newly introduced `SerializationContext` in the signature of `AsGraphDefInternal` to reduce the scope of the context and also simplify the logic for overriding the `FunctionLibraryDefinition` when optimizations take place PiperOrigin-RevId: 208282562
* [tf.data] Minor API refactoring.Gravatar Jiri Simsa2018-08-10
| | | | | | Renaming `AddParentDataset`, `SaveParent`, and `RestoreParent` to `AddInputDataset`, `SaveInput`, and `RestoreInput`. PiperOrigin-RevId: 208272695
* [tf.data] Mark DebugString() as const.Gravatar Brennan Saeta2018-05-31
| | | | | | By marking DebugString() as const we can make some error messages more descriptive. Because DatasetIterator marks the return value of the dataset() function const, DebugString() cannot be called. PiperOrigin-RevId: 198796894
* [tf.data] Changing signature of `MakeIterator` to enable propagating error ↵Gravatar Jiri Simsa2018-05-31
| | | | | | status. PiperOrigin-RevId: 198772254
* [tf.data] Change the IteratorBase::RestoreInternal() method to take ↵Gravatar Derek Murray2018-01-11
| | | | | | | | | | | IteratorContext*. The IteratorContext type contains all of the state needed to restore an iterator and it is easier to construct, so this change will make it possible to control the environment of the restoration more easily (e.g. when using function overlays on a shared runtime). PiperOrigin-RevId: 181662977
* [tf.data] Move existing tests to use dataset_serialization_test_base.Gravatar Shivani Agrawal2018-01-02
| | | | PiperOrigin-RevId: 180571052
* Moving tf.data kernels to their own package.Gravatar Jiri Simsa2017-12-14
PiperOrigin-RevId: 179112798