aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/contrib/hadoop
Commit message (Collapse)AuthorAge
* [tf.data] Adding a private method for (recursively) tracking dataset inputs.Gravatar Jiri Simsa2018-09-25
| | | | PiperOrigin-RevId: 214495925
* Move from deprecated self.test_session() to self.cached_session().Gravatar A. Unique TensorFlower2018-09-17
| | | | | | | | self.test_session() has been deprecated in 9962eb5e84b15e309410071b06c2ed2d6148ed44 as its name confuses readers of the test. Moving to cached_session() instead which is more explicit about: * the fact that the session may be reused. * the session is not closed even when doing a "with self.test_session()" statement. PiperOrigin-RevId: 213326581
* [tf.data] Move all C++ code inside the `tensorflow::data` namespace.Gravatar Derek Murray2018-09-05
| | | | PiperOrigin-RevId: 211733735
* [tf.data] Internal refactoring of C++ classes and APIs.Gravatar Jiri Simsa2018-08-13
| | | | | | | | | | - replacing `OpKernelContext` with newly introduced `DatasetContext` in `DatasetBase` constructor to make it possible to instantiate `DatasetBase` in places where an instance of `OpKernelContext` is not available - replacing `dataset::MakeIteratorContext(OpKernelContext* ctx)` factory with `IteratorContext(OpKernelContext *ctx)` constructor. - folding `GraphDatasetBase` into `DataseBase` and removing the default implementation of `AsGraphDefInternal`, making it the responsibility of the derived class to implement it to encourage/hint developers to provide serialization logic PiperOrigin-RevId: 208560010
* Merge pull request #19534 from yongtang:hadoopGravatar TensorFlower Gardener2018-08-09
| | | | PiperOrigin-RevId: 208112353
* Update signature change and fix pylint issueGravatar Yong Tang2018-07-02
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Address review commentsGravatar Yong Tang2018-06-29
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Fix python 3 issue with `b` prefix stringsGravatar Yong Tang2018-06-29
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add bazel BUILD file to hadoopGravatar Yong Tang2018-06-29
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Expose op to tf.contrib.hadoop namespaceGravatar Yong Tang2018-06-29
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test case for hadoop SequenceFileDatasetGravatar Yong Tang2018-06-29
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add python wrapper for tf.contrib.hadoop.SequenceFileDatasetGravatar Yong Tang2018-06-29
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Register SequenceFileDataset opsGravatar Yong Tang2018-06-29
| | | | Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add Hadoop SequenceFile support for tensorflow DatasetGravatar Yong Tang2018-06-29
This fix adds Hadoop SequenceFile for tensorflow Dataset, so that it is possible to process files stored in Hadoop system directly. This fix is a very preliminary and early implementation. It supports `org.apache.hadoop.io.Text` only, and there is no compression support. Will work on expanding the support of other seralization types, and compresion support in the follow up PR. Signed-off-by: Yong Tang <yong.tang.github@outlook.com>