aboutsummaryrefslogtreecommitdiffhomepage
path: root/tensorflow/core/lib
Commit message (Collapse)AuthorAge
* Correct a couple of format stringsHEADmasterGravatar Benjamin Barenblat2018-10-10
| | | | | | | Change a couple of fscanf-style format strings to use the format macro constants defined in cinttypes. This quashes -Wformat. PiperOrigin-RevId: 216545604
* Check for too large jpeg images before decompressing.Gravatar Mihai Maruseac2018-09-24
| | | | PiperOrigin-RevId: 214279868
* Add Metadata object for RecordReader and associated stats computing /Gravatar Vijay Vasudevan2018-09-23
| | | | | | | | | | | | | | | | | MD fetching method. TFRecord files do not contain a file-level header that describes the MD of the file. To avoid backwards compatibility issues, we add a lightweight function that computes the statistics over the file once and caches the result for future calls. A future implementor could do a better job of computing GetMetadata() by having the RecordWriter emit these entries during writing so that GetMetadata() only reads. Doing so will require additional backwards compatibility checks to ensure that the function works both for old TFRecords and the new format. PiperOrigin-RevId: 214178704
* Add an API which gives explicit control over shard sizes and introspection ↵Gravatar A. Unique TensorFlower2018-09-20
| | | | | | into the number of shards used. This is a variant of threadpool::parallelFor PiperOrigin-RevId: 213920649
* Removed unnecessary includes from stringpiece.hGravatar A. Unique TensorFlower2018-09-14
| | | | PiperOrigin-RevId: 213008707
* Prevent an integral division by zero (undefined behavior).Gravatar Mihai Maruseac2018-09-13
| | | | PiperOrigin-RevId: 212851417
* Modify signature of WritableFile::Append to accept StringPiece data by value.Gravatar Eugene Brevdo2018-09-12
| | | | PiperOrigin-RevId: 212736286
* Add helper functions that allow users to write TFRecords in memory.Gravatar Eugene Brevdo2018-09-10
| | | | PiperOrigin-RevId: 212293765
* Automated rollback of commit d6f107761459dfdf8773a148e11193a3512a51a6Gravatar A. Unique TensorFlower2018-09-10
| | | | PiperOrigin-RevId: 212289067
* Automated rollback of commit 24787842adfefe35f5a520313d775b14c29f143aGravatar A. Unique TensorFlower2018-09-06
| | | | PiperOrigin-RevId: 211895566
* Add compression options to Python's TFRecordOptionsGravatar A. Unique TensorFlower2018-09-06
| | | | | | Plumb these through to RecordWriterOptions PiperOrigin-RevId: 211894734
* Alias tensorflow::gtl::InlinedVector to absl::InlinedVectorGravatar Benjamin Kramer2018-09-05
| | | | PiperOrigin-RevId: 211639440
* There were two different error reporting formats within TensorFlow: `{{key ↵Gravatar A. Unique TensorFlower2018-09-04
| | | | | | value}}` and `^^key:value^^`. This change consolidate these two format. PiperOrigin-RevId: 211550259
* Currently there are two formats for error reporting inside TensorFlow. This ↵Gravatar A. Unique TensorFlower2018-08-31
| | | | | | is first of a series of CL to merge these into one. In this change, we remove the format tag from the errors. PiperOrigin-RevId: 211146036
* Alias gtl::optional to absl::optional and remove the old implementation.Gravatar Benjamin Kramer2018-08-31
| | | | PiperOrigin-RevId: 211110958
* Renamed tensorflow::strings::PadSpec enum values to match absl::PadSpec enum ↵Gravatar A. Unique TensorFlower2018-08-31
| | | | | | | | values. This is necessary in order to replace tensorflow::strings::StrCat with absl::StrCat. PiperOrigin-RevId: 211087745
* Rollback of a rollback with fixes included. See below for details of the ↵Gravatar A. Unique TensorFlower2018-08-30
| | | | | | | | | | | | original change. This CL fixes additional two CI tests that broke due to the changed bfloat16 behavior. ================================================== Automated rollback of commit 37b2b0eb613b6c3c66b96374851cfd95050346a0 PiperOrigin-RevId: 211031073
* Remove (Mutable)ArraySlice implementation and alias them to absl::Span.Gravatar Tim Shen2018-08-30
| | | | | | | | There are several API migrations happening: * ArraySlice's sub-slice constructor => .subspan * MutableArraySlice's container pointer constructor => absl::MakeSpan PiperOrigin-RevId: 210946124
* Replaced tensorflow::StringPiece with an alias of absl::string_view.Gravatar A. Unique TensorFlower2018-08-30
| | | | PiperOrigin-RevId: 210929192
* Removed redundant std::string -> string conversions.Gravatar A. Unique TensorFlower2018-08-28
| | | | PiperOrigin-RevId: 210596417
* Removed ToString method from tensorflow::StringPiece.Gravatar A. Unique TensorFlower2018-08-28
| | | | | | This will make it easier to replace tensorflow::StringPiece with absl::string_view, as absl::string_view does not contain a ToString method. PiperOrigin-RevId: 210550029
* Remove tensorflow::gtl::{Mutable,}ArraySlice's old API that don't show up in ↵Gravatar Tim Shen2018-08-27
| | | | | | absl::Span, so that transitioning to the latter is easier. PiperOrigin-RevId: 210461037
* Replaced calls to tensorflow::StringPiece::ToString with std::string ↵Gravatar A. Unique TensorFlower2018-08-27
| | | | | | | | | | conversions. That is, instances of sp.ToString() are replaced with string(sp). This will allow tensorflow::StringPiece::ToString to be removed, which is necessary before it can be replaced with absl::string_view. PiperOrigin-RevId: 210394878
* Removed redundant std::string -> string conversions.Gravatar A. Unique TensorFlower2018-08-24
| | | | PiperOrigin-RevId: 210127626
* Automated rollback of commit 2d4214415269bee2c8c98d5466c540e4004652fdGravatar A. Unique TensorFlower2018-08-24
| | | | PiperOrigin-RevId: 210116745
* This change makes casts to bfloat16 use rounding instead of truncation by ↵Gravatar A. Unique TensorFlower2018-08-23
| | | | | | default. The motivation is that rounding achieves better accuracy than truncation. PiperOrigin-RevId: 209985826
* Replaced calls to tensorflow::StringPiece::ToString with string conversions.Gravatar A. Unique TensorFlower2018-08-22
| | | | | | | | That is, instances of sp.ToString() are replaced with string(sp). This will allow tensorflow::StringPiece::ToString to be removed, which is necessary before it can be replaced with absl::string_view. PiperOrigin-RevId: 209806694
* fix C++ header guards.Gravatar A. Unique TensorFlower2018-08-21
| | | | PiperOrigin-RevId: 209679086
* Added non-std string support to tensorflow::StringPiece string conversion ↵Gravatar A. Unique TensorFlower2018-08-16
| | | | | | operator. PiperOrigin-RevId: 209050419
* Merge pull request #20029 from yoya:masterGravatar TensorFlower Gardener2018-08-09
|\ | | | | | | PiperOrigin-RevId: 208076674
* | Add nullptr checks so that Write() and Flush() fail instead of segfaultGravatar A. Unique TensorFlower2018-08-06
| | | | | | | | PiperOrigin-RevId: 207596283
* | Change PyRecordWriter destructor order so that file_ is still available for ↵Gravatar A. Unique TensorFlower2018-08-03
| | | | | | | | | | | | writing when writer_ destructor is called PiperOrigin-RevId: 207355721
* | Adding NodeDef names to error messages for better debuggability.Gravatar A. Unique TensorFlower2018-07-27
| | | | | | | | | | | | | | The format used is as follows: {{node <node_name>}} PiperOrigin-RevId: 206370355
| * $ mogrify +matte tensorflow/core/lib/png/testdata/lena_palette.pngGravatar Yoshihiro Yamazaki2018-07-26
| | | | | | | | (remove tRNS chunk)
* | This change started with an intention of adding an attribute to cast ops to ↵Gravatar A. Unique TensorFlower2018-07-25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | decide whether bfloat16 casts should use truncation or rounding. This is a preparatory change before we switch the default float ==> bfloat16 cast to use rounding instead of truncation. The attribute added can then be specified on casts that rely on the truncation, e.g., the TensorFlow send/receive operations. It later emerged that the choice of doing truncation is useful more generally. Therefore, this change allows the new attribute to be used by all relevant casts to use truncation instead of rounding. PiperOrigin-RevId: 205996367
* | Merge pull request #20944 from skambha:issue-opendbGravatar TensorFlower Gardener2018-07-20
|\ \ | | | | | | | | | PiperOrigin-RevId: 205466416
* | | Test io::RecordWriter.flush()Gravatar A. Unique TensorFlower2018-07-19
| | | | | | | | | | | | | | | | | | | | | Requires changing flush_mode from default Z_NO_FLUSH See tensorflow/core/lib/io/zlib_compression_options.h PiperOrigin-RevId: 205293231
* | | A deleter class that calls RefCounted::Unref, and a unique_ptr alias ↵Gravatar A. Unique TensorFlower2018-07-19
| | | | | | | | | | | | | | | | | | | | | | | | RefCountPtr that uses this deleter. This class can be used to automate the management of ref-owned objects. PiperOrigin-RevId: 205217510
| * | Add SQLITE_OPEN_URI flag to sqlite open to support db_uri and add a unit testGravatar Sunitha Kambhampati2018-07-18
| | |
* | | Automated rollback of commit 0ba51c741981c4f264dc06356a44b89ab9dbacd1Gravatar Rachel Lim2018-07-17
|/ / | | | | | | PiperOrigin-RevId: 205002413
| * - adding PNG-8(palette) files.Gravatar Yoshihiro Yamazaki2018-07-18
| | | | | | | | | | | | | | | | convert lena_std.png -scale '51x26!' png8:lena_palette.png convert lena_rgba.png png8:lena_palette_trns.png - update python test script - update core/BUILD file
* | Merge changes from github.Gravatar Yifei Feng2018-07-02
| | | | | | | | PiperOrigin-RevId: 203037623
* | Remove ARCH_PIII variant from manual_constructor_test.cc.Gravatar A. Unique TensorFlower2018-07-02
| | | | | | | | PiperOrigin-RevId: 203007540
* | [TF:XLA] Implement UnsortedSegment{Prod,Min,Max} operators.Gravatar Peter Hawkins2018-06-25
| | | | | | | | PiperOrigin-RevId: 202030418
| * fix decode_png function.Gravatar Yoshihiro Yamazaki2018-06-15
|/ | | | Problem: In the case of palette png & channels=0, force into grayscale.
* Remove logic in RandomAccessInputStream to check for out of range read, as ↵Gravatar Ruoxin Sang2018-06-08
| | | | | | it has been done in RandomAccessFile::Read(). PiperOrigin-RevId: 199873976
* Removed parts of numbers_test that caused asan/msan/tsan failureGravatar Rachel Lim2018-06-06
| | | | PiperOrigin-RevId: 199533243
* Automated g4 rollback of changelist 198815200Gravatar Rachel Lim2018-06-01
| | | | PiperOrigin-RevId: 198878259
* Automated g4 rollback of changelist 198812512Gravatar A. Unique TensorFlower2018-05-31
| | | | PiperOrigin-RevId: 198815200
* [tf.data] Changed parsing logic for CsvDataset for better performance and ↵Gravatar Rachel Lim2018-05-31
| | | | | | correctness PiperOrigin-RevId: 198812512