| Commit message (Collapse) | Author | Age |
|\ |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 183728562
|
|\| |
|
| |
| |
| |
| |
| |
| | |
be necessary any longer.
PiperOrigin-RevId: 183474194
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
* Add KafkaReader for processing streaming data with Apache Kafka
Apache Kafka is a widely used distributed streaming platform in
open source community. The goal of this fix is to create a contrib
Reader ops (inherits ReaderBase and is similiar to
TextLineReader/TFRecordReader) so that it is possible to reader
Kafka streaming data from TensorFlow in a similiar fashion.
This fix uses a C/C++ Apache Kafka client library librdkafka which
is released under the 2-clause BSD license, and is widely used in
a number of Kafka bindings such as Go, Python, C#/.Net, etc.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add KafkaReader Python wrapper.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add BUILD file and op registration for KafkaReader.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add C++ Kernel for KafkaReader
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add librdkafka to third_party packages in Bazel
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add contrib/kafka to part of the contrib bazel file.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Update workspace.bzl
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Comment out clean_deps of `tensorflow/core:framework` and `tensorflow/core:lib`
so that it is possible to build with ReaderBase.
See 1419 for details.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add group id flag.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Sync offset
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test cases and scipt to start and stop Kafka server (with docker)
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Convert to KafkaConsumer from the legacy Consumer with librdkafka
so that thread join does not hang.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Only output offset as the key.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add timeout attr so that Kafka Consumer could use
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Build Kafka kernels by default, so that to get around the linkage issue.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Convert KafkaReader to KafkaDataset.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Fix workspace.bzl for kafka with tf_http_archive
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add public visibility
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Address review feedbacks
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Optionally select Kafka support through ./configure
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 183347199
|
| |
| |
| |
| |
| | |
The libjpeg-turbo package has ALTIVEC SIMD and this updates the
third_party build to build the ALTIVEC SIMD on the appropriate
platform.
|
|\| |
|
| |
| |
| |
| |
| |
| | |
They don't make sense in the open source repository.
PiperOrigin-RevId: 183140889
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 183100142
|
| |
| |
| | |
See #15777
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 182829120
|
| |
| |
| |
| | |
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
|
| |
| |
| |
| | |
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 182511847
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 182258809
|
| |
| |
| |
| | |
PiperOrigin-RevId: 182247687
|
| |
| |
| |
| |
| |
| |
| | |
This is necessary to compile with Clang. Since the TF GCP code doesn't have any
try/catch statements, this could be a bug fix.
PiperOrigin-RevId: 182143536
|
| |
| |
| |
| |
| |
| |
| |
| |
| | |
This makes it 400kB smaller. This is worth it because even
-O6 would only make SQLite 3% faster.
https://www.sqlite.org/footprint.html
PiperOrigin-RevId: 182143488
|
| | |
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 181494416
|
| |
| |
| |
| | |
PiperOrigin-RevId: 181469026
|
|\| |
|
| |
| |
| |
| |
| |
| |
| |
| | |
It matches the way bazel's autoconf works and seems to be the right thing to
do.
This change should fix #14380.
PiperOrigin-RevId: 181305871
|
|\| |
|
| |
| |
| |
| |
| |
| | |
counterparts instead of removing them. Re-enable a few tests to verify.
PiperOrigin-RevId: 181035075
|
|\ \
| | |
| | | |
Branch 180856860
|
|\ \ \
| | | |
| | | | |
[Bazel/Windows] Wrap rm -rf in Bash for Windows (and some refactoring)
|
| |/| |
|/| |/ |
|
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | | |
* Revert "Fix the headers error due to recent CUDA9.1 change (#15739)"
This reverts commit 3bc4900e7e60f43dc901523f1574f52440e7e701.
* Bump eigen dependency.
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 180746153
|
|/ / |
|
| |
| |
| |
| |
| |
| |
| |
| |
| | |
This change also puts the necessary build infrastructure in place so we can
continue to build many proper lightweight SQLite extensions in the future that
are easy for users to copy over into their own environments, so they can
readily access their data.
PiperOrigin-RevId: 180673039
|
| | |
|
| | |
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 179971055
|
| |
| |
| |
| | |
PiperOrigin-RevId: 179960166
|
|\| |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 179953488
|
| |
| |
| |
| |
| |
| |
| |
| |
| | |
builds.
Tested only on Linux, but should also work for Mac.
No support for Windows is available yet.
PiperOrigin-RevId: 179910980
|
|\ \
| | |
| | | |
FreeBSD compatibility
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 179263865
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 179260538
|