Tensorflow-data-validation

Major Features and Improvements

* N/A

Bug Fixes and Other Changes

* Skew pipeline supports counting pairs of feature values in base/test.
* Depends on `apache-beam[gcp]>=2.40,<3`.
* Depends on `pyarrow>=6,<7`.
* Depends on `tfx-bsl>=1.10.1,<1.11.0`.
* Depends on `tensorflow-metadata>=1.10.0,<1.11.0`.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A

Major Features and Improvements

* N/A

Bug Fixes and Other Changes

* Depends on `tensorflow>=1.15.5,<2` or `tensorflow>=2.9,<3`
* Depends on `tfx-bsl>=1.9.0,<1.10.0`.
* Depends on `tensorflow-metadata>=1.9.0,<1.10.0`.

Known Issues

* N/A

Breaking Changes

* Some fields in feature skew results proto changed names to be more generic.
* Removes the unused skew_config.proto

Deprecations

* N/A

Major Features and Improvements

* From this version we will be releasing python 3.9 wheels.

Bug Fixes and Other Changes

* Adds `get_statistics_html` to the public API.
* Fixes several incorrect type annotations.
* Schema inference handles derived features.
* `StatsOptions.to_json` now raises an error if it encounters unsupported
options.
* Depends on `apache-beam[gcp]>=2.38,<3`.
* Depends on `tensorflow-metadata>=1.8.0,<1.9.0`.
* Depends on `tfx-bsl>=1.8.0,<1.9.0`.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A

Major Features and Improvements

* Adds the `DetectFeatureSkew` PTransform to the public API, which can be used
to detect feature skew between training and serving examples.
* Uses sketch-based top-k/uniques in TFDV inmemory mode.

Bug Fixes and Other Changes

* Fixes a bug in load_statistics that would cause failure when reading binary
protos.
* Depends on `pyfarmhash>=0.2,<0.4`.
* Depends on
`tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,<3`.
* Depends on `tensorflow-metadata>=1.7.0,<1.8.0`.
* Depends on `tfx-bsl>=1.7.0,<1.8.0`.
* Depends on `apache-beam[gcp]>=2.36,<3`.
* Updated the documentation for CombinerStatsGenerator to clarify that the
first accumulator passed to merge_accumulators may be modified.
* Added compression type detection when reading csv header.
* Detection of invalid utf8 strings now works regardless of relative frequency.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A

Major Features and Improvements

* Introduces a convenience wrapper for handling indexed access to statistics
protos.
* String features are checked for UTF-8 validity, and the number of invalid
strings is reported as invalid_utf8_count.

Bug Fixes and Other Changes

* Depends on `numpy>=1.16,<2`.
* Depends on `absl-py>=0.9,<2.0.0`.
* Depends on
`tensorflow>=1.15.5,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,<3`.
* Depends on `tensorflow-metadata>=1.6.0,<1.7.0`.
* Depends on `tfx-bsl>=1.6.0,<1.7.0`.
* Depends on `apache-beam[gcp]>=2.35,<3`.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A

Major Features and Improvements

Bug Fixes and Other Changes

* BasicStatsGenerator is now responsible for setting the global num_examples.
This field will no longer be populated at the DatasetFeatureStatistics level
if default generators are disabled.
* Depends on `apache-beam[gcp]>=2.34,<3`.
* Depends on
`tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,<3`.
* Depends on `tensorflow-metadata>=1.5.0,<1.6.0`.
* Depends on `tfx-bsl>=1.5.0,<1.6.0`.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A