Tensorflow-federated

Major Features and Improvements

* Implemented divisive split logic needed by DistributeAggregateForm, which is
currently under development and will replace MapReduceForm and BroadcastForm
in the future.

Breaking Changes

* Renamed the `cpp_execution_context.(create|set)_local_cpp_execution_context`
function to match the name of
`execution_context.(create|set)_(sync|async)_local_cpp_execution_context`.
* Deleted the sizing Python execution context and executor.
* Deleted the thread debugging Python execution context and executor.
* Removed `ExecutorService` from the public API.
* Deleted the local async python execution context.

Bug Fixes

* Enabled and fixed python type annotations in some modules in the
`executors`, `types`, and `core` package.

Major Features and Improvements

* Added a `LayoutMap` message in the computation proto for TensorFlow
`DTensor` based execution.

Breaking Changes

* Removed the `compiler_fn` parameter from the high level
`*_mergeable_execution_context` functions.

Bug Fixes

* Aligned the context types allowed by the
`tff.program.NativeFederatedContext` and the
`tff.program.PrefetchingDataSource`.
* Updated `build_functional_model_delta_update` to use `ReduceDataset` ops to
rely on MLIR Bridge for XLA compilation and TPU usage.

Major Features and Improvements

* Added parameter and implementation for C++ remote executor to stream the
values in a structure across the gRPC interface.
* Added `tff.backends.native.desugar_and_transform_to_native` to the public
API.
* Replaced `GroupNorm` implementation with implementation from Keras.
* Added `tff.simulations.datasets.flair` APIs for the FLAIR dataset.

Breaking Changes

* Removed file extension for `model_output_manager` used in
`tff.learning.programs`

Bug Fixes

* Enabled and fixed python type annotations in some modules.
* Changed `tff.learning.algorithms.build_weighted_fed_prox` parameter
validation to allow `proximal_strength = 0.0`, matching the pydoc.

Major Features and Improvements

* Integrated the `CppToPythonExecutorBridge` into the `CPPExecutorFactory`.
* Changed Python Remote Executor to decompose and stream structures in Compute
and CreateValue when _stream_structs is true. Added a bool parameter
`stream_structs` to
`tff.backends.native.set_localhost_cpp_execution_context()` API.

Breaking Changes

* Renamed `tff.backends.native.set_localhost_cpp_execution_context()` to
`backends.native.set_sync_local_cpp_execution_context()`.
* Renamed `tff.framework.ExecutionContext` to
`tff.framework.SyncExecutionContext` to be consistent with
`tff.framework.AsyncExecutionContext`.
* Removed the `SyncSerializeAndExecuteCPPContext` and
`AsyncSerializeAndExecuteCPPContext` classes.

Bug Fixes

* Fixed usage of `typing.Generic` in the learning package.
* Enabled pytype analysis for some modules.
* Fixed lint and formatting issues for some modules.

Major Features and Improvements

* Improved the Python type annotations for `tff.program` API.
* Extended the metrics interface on FunctionalModel to accept the entire
`BatchOutput` structure from the model `forward_pass` (not just the
predictions).
* Introduced a DTensor Executor.

Bug Fixes

* Fixed async RuntimeWarning in the `tff.program.NativeFederatedContext`.

Major Features and Improvements

* Improve serialization method to allow structures larger than 2 GiB (~500
million model parameters):
* `tff.learning.models.FunctionalModel`
* `tff.programs.FileProgramStateManager`

Bug Fixes

* Fix a bug using `copy.deepcopy` for structures of awaitables (non-pickable)
in `tff.learning.programs`.
* Fix a bug when resuming an evaluation in
`tff.learning.programs.EvaluationManager` where the restarted evaluation
would overwrite released metrics.