| Commit message (Collapse) | Author | Age |
| |
|
| |
|
|\ |
|
| |
| |
| |
| | |
PiperOrigin-RevId: 202961895
|
| |
| |
| |
| |
| |
| | |
Fix Windows failure caused by cl/202664219
PiperOrigin-RevId: 202960843
|
| |
| |
| |
| | |
PiperOrigin-RevId: 202960334
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
When running any trivial XLA program with --v=1, you will see bogus message such
as "Invalid argument: Shape f32[] size may overflow int64". The reason for this
is because in ShapeUtil::ValidateShapeSize, we incorrectly construct an
InvalidArgument object prematurely. This change postpones the construction of
the InvalidArgument object until an invalid argument is actually discovered.
PiperOrigin-RevId: 202959886
|
| |
| |
| |
| | |
PiperOrigin-RevId: 202950690
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
* Add KinesisDataset support for tensorflow Dataset
This fix is an attempt to add Kinesis support
for tensorflow's Dataset. Kinesis is provided by
AWS as a managed data streaming service. It is
similiar to Apache Kafka, often used in places
where maintaining a independent Kafka cluster on AWS
is not desirable or possible.
This fix adds the Kinesis support for tensorflow Dataset.
Similiar to the Kafka integration in tensorflow,
KinesisDataset outputs tf.string for records.
Test cases have also been added, which could be invoked manually.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Expose KinesisDataset in dataset_ops.cc
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Expose KinesisDataset in python wrapper
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test cases for KinesisDataset
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Update AWS library include files
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add Bazel BUILD files
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Rename s3_crypto to aws_crypto
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Rename with_s3_support to with_aws_support
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Selectively add kinesis to tensorflow/contrib/BUILD
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Set different partition key and pylint fix.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add missing modules in cmake's python_modules.txt
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Address review feedback
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
Reciprocal} and move them to a new client library xla/client/lib/math.h. Remove the F32 type constraint.
Add an xla::Rqsrt function.
Move {Erf, Erfc, ErfInv, EvaluatePolynomial} to the same library.
[TF:XLA] Update many places in the bridge to use the new functions. Rewrite many of the training ops in operator notation.
PiperOrigin-RevId: 202948474
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
New functions include xla::ScalarLike, xla::Zero, xla::Zeros, xla::ZerosLike, xla::One, xla::Epsilon, xla::{Min,Max,MinFinite,MaxFinite}Value.
Update Erf, Erfc, ErfInv to use new operator overloads and xla::ScalarLike. Remove the explicit type arguments.
[TF:XLA] Refactor various parts of the bridge to use new constant functions. Make more types implicit. Clean up ArgMin/ArgMax as part of adapting it to use the new APIs.
No functional changes intended.
PiperOrigin-RevId: 202943293
|
| |
| |
| |
| |
| |
| |
| |
| |
| | |
We now look into the computations of kWhile and kConditional ops when profiling.
This still does not help regarding the statistics of the estimated optimum,
but at least we can see the relative performance of the ops within a
subcomputation.
PiperOrigin-RevId: 202916616
|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| | |
needed for RNN back-edge support)
- Make the delegate return errors from unsupported operations, datatypes and
rank rather than abort
- Make the delegate propagate errors from preparation and compilation phase
rather than abort
- Add a flag for allowing generated tests to pass if delegation returns an
error - however if delegation succeeds the results are verified
PiperOrigin-RevId: 202916432
|
|\ \
| | |
| | | |
Make sure calibrator don't miss last batch
|
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | | |
202883475 by A. Unique TensorFlower:
Internal testing changes
--
202880708 by yifeif:
Internal change.
--
202876685 by A. Unique TensorFlower:
Internal change
--
202850194 by yifeif:
Internal change.
--
PiperOrigin-RevId: 202883475
|
| | | |
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 202753310
|
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | | |
and max range,
when the op is on the GPU but the range tensor is on the host.
PiperOrigin-RevId: 202748603
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 202744028
|
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | | |
When running any trivial XLA program with --v=1, you will see bogus message such
as "Invalid argument: Shape f32[] size may overflow int64". The reason for this
is because in ShapeUtil::ValidateShapeSize, we incorrectly construct an
InvalidArgument object prematurely. This change postpones the construction of
the InvalidArgument object until an invalid argument is actually discovered.
PiperOrigin-RevId: 202738924
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 202736707
|
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | | |
will be used for distributed variables.
Add Enum `VariableSynchronization` with values for `synchronization`: AUTO, UNREPLICATED, ON_WRITE, ON_READ
Add Enum `VariableAggregation` with values for `aggregation`: NONE, SUM, MEAN. Replace all the aggregation methods strings in distribution strategy to the enum values.
Update Mirrored strategy to use these parameters to decide on whether a variable should be Mirrored or TowerLocal.
Update different distribution strategy value types to use the `VariableAggregation` Enum
PiperOrigin-RevId: 202736077
|
| | |
| | |
| | |
| | | |
PiperOrigin-RevId: 202735104
|
|\ \ \
| | | |
| | | | |
Branch 202673820
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202728713
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
* Update kafka to v0.11.4
This fix updates kafka from v0.11.1 to v0.11.4
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add additional source files in kafka
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
|
| | | |
| | | |
| | | |
| | | |
| | | | |
cloud_py now depends on big_table which does not build on Windows.
Excluding from Window Bazel build for now.
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202725501
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202724720
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
by extending the core/platform API with some basic functionality.
The new functions allow:
1. Determining how many NUMA nodes are available.
2. Setting the executing thread to be bound to a particular node,
or not bound at all.
3. Allocating memory affiliated with a particular node.
This change introduces the API only, there is not yet a real
implementation.
PiperOrigin-RevId: 202724194
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202724146
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202724096
|
| | | |
| | | |
| | | |
| | | |
| | | | |
Excluded dependency on contrib/bigtable from Windows build.
There are several Bazel build errors when trying to build it.
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202720777
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
Return the first unsupported op with detailed error message instead of all unsupported ops without details.
PiperOrigin-RevId: 202720375
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
back.
PiperOrigin-RevId: 202719394
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202716942
|
| | | |
| | | |
| | | |
| | | | |
Re-adding installing h5py.
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
StatusOr<TensorShape>.
PiperOrigin-RevId: 202711909
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
tf.contrib.data.bucket_by_sequence_length.
PiperOrigin-RevId: 202711095
|
| | | | |
|
| | | | |
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202706517
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
The overall approach is to teach the gradients code how to traverse
the implicit edges between captured external tensors and ops inside
the function body.
PiperOrigin-RevId: 202705929
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202705179
|
| | | | |
|
| | | |
| | | |
| | | |
| | | | |
PiperOrigin-RevId: 202703970
|
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | |
| | | | |
Conceptually lists just get replaced with a list-like wrapper. A shallow copy is maintained for error checking (since appends to it aren't monitored, we can't do restore-on-create for variables unless it's being modified through the wrapper).
There are lots of other details. I gave up on generalizing our isinstance(obj, (list, tuple)) checks and just subclassed list. Behaving like a list means the type should be unhashable, which requires some workarounds when we're collecting objects (object-identity collections, and object-identity versions of weak reference containers).
Adds a decorator for exempting whole methods from automatic dependency tracking so we don't need to track down every last self.inputs = [] statement to avoid polluting dependencies.
There's a TODO for tuples and dictionaries.
PiperOrigin-RevId: 202703271
|
| | | | |
|
|\ \ \ \
| | | | |
| | | | | |
Fix math equation rendering format in api definitions
|