Tfx-bsl

Major Features and Improvements

* Added SequenceExamplesToRecordBatchDecoder.
* Added a TFXIO implementation for SequenceExmaples on TFRecord.
* Added support for TensorAdapter to output tf.RaggedTensors.
* Improved performance of tf.Example and tf.SequenceExample coders.

Bug Fixes and Other Changes

* Depends on `pandas>=0.24,<2`.
* Depends on `tensorflow>=1.15,!=2.0.*,<3`.
* Depends on `tensorflow-metadata>=0.22.2,<0.23`.
* Removed tensor_to_arrow_test for TF 1.x as it does not support TF 1.x.

Breaking changes

Deprecations
* Removed `arrow.table_util.SliceTableByRowIndices` (in favor of
`RecordBatchTake`)
* Removed `arrow.table_util.MergeTables` (in favor of `MergeRecordBatches`)

Major Features and Improvements

* Moved RunInference API and related protos to tfx_bsl/public directory.
* CSV coder support for multivalent columns.
* tf.Exmaple coder support for producing large types (LargeList, LargeBinary).
* Added TFXIO for CSV

Bug Fixes and Other Changes

* Depends on `apache-beam[gcp]>=2.20,<3`.
* Depends on `pyarrow>=0.16,<0.17`
* Depends on `tensorflow-metadata>=0.22,<0.23`

Breaking Changes

* Renamed ModelEndpointSpec to AIPlatformPredictionModelSpec to specify remote
model endpoint on Google Cloud Platform.
* Renamed InferenceEndpoint to InferenceSpecType.

Deprecations

Major Features and Improvements

* Added a tfxio.telemetry.ProfileRecordBatches, a PTransform to collect
telemetry from Arrow RecordBatches.
* Added remote model inference on Google Cloud Platform.

Bug Fixes and Other Changes

* Added `arrow.table_util.MergeRecordBatches`: similar to `MergeTables` but
operates against `pa.RecordBatch`es.
* Added `arrow.table_util.RecordBatchTake`: similar to
`SliceTableByRowIndices` but operates against a `pa.RecordBatch`.
* Requires `apache-beam>=2.17,<3`
* Only requires `avro-python3>=1.8.1,!=1.9.2.*,<2.0.0` on Python 3.5 + MacOS
* Requires `google-api-python-client>=1.7.11,<2`

Breaking Changes

Deprecations

Major Features and Improvements

Bug Fixes and Other Changes

* Requires `apache-beam>=2.17,<2.18`

Breaking Changes

Deprecations

Major Features and Improvements

Bug Fixes and Other Changes
* Fixed a bug in tfx_bsl.arrow.array_util.GetFlattenedArrayParentIndices that
could cause memory corruption.

Breaking Changes

Deprecations

Major Features and Improvements
* Defined an abstract subclass of `TFXIO`, `RecordBasedTFXIO` to model record
based file formats.

Bug Fixes and Other Changes

* Utilities in `tfx_bsl.arrow.array_util` that:

* previously takes `ListArray` now can also accept `LargeListArray`.
* previously takes StringArray/BinaryArray now can also accept
LargeStringArray and LargeBinaryArray.

As a result: `GetElementLengths` now returns an `Int64Array`.
`GetFlattenedArrayParentIndices` may return an `Int64Array` or an
`Int32Array` depending on the input type.

Breaking Changes

Deprecations