Datacube

The previous two releases had a serious bug in the new Transaction API that resulted in parallel writes to the database being highly likely to fail. This release is mostly to provide a fix for this issue.

Full list of changes:

- Rename Geometry `type` attribute to `geom_type`, to align with Shapely 2.0 (1402)
- Remove some deprecated SQLAlchemy usages (1403, 1407)
- Fix RTD docs build (1399)
- Minor Documentation fixes (1409, 1413)
- Bug-fix and code cleanup in virtual products (1410)
- Reduce transaction isolation level to improve database write concurrency (1414)
- Update dependency versions and whats_new.rst for release (1415)

Includes contributions from SpacemanPaul, emmaai, Ariana-B, omad, and first-time contributor charalamm.

Special thanks to alexgleith for reporting the Transaction API bug and working with us to test the fix.

Administrative release to address two technical issues in release 1.8.10:

1) 1.8.10 attempted to improve compatibility with recent versions of xarray, however further work was needed to fully achieve that compatibility.
2) 1.8.10 was released with dependency discrepancies between `setup.py` (pip), `conda-environment.yml` (conda) and `constrains.in` (Docker).

Full list of changes:

- Simplify Github actions (1393)
- Update conda create environment README (1394)
- Update conda environment file and add notes to release process to ensure pip and conda
dependencies are in sync and up-to-date. (1395)
- Update docker constraints (1396)
- Compatible with the changes w.r.t. `MultiIndex` and `coord/dims` introduced since `xarray>2022.3.0` (1397)
- Final sync of conda/pip dependencies and update release notes. (1398)

Includes contributions from SpacemanPaul, pindge, Ariana-B, emmaai and omad.

Bug fixes, enhancements, and updates to work with newer versions of upstream libraries.

Notes

1. The new APIs for bulk-reads, bulk-writes and index cloning should be considered unstable and may change in subsequent releases.
2. Recent refactoring in the XArray library has lead to changes in behaviour that affect some ODC operations and are unlikely to be addressed by the XArray team. This release includes changes in the way the ODC works with XArray to circumvent these issues. If you experience Xarray issues with this ODC release, please raise an issue on Github and we will try to address them before the next release.

Full list of changes:

- Add `grid_spec` to `list_products` (1357)
- Add database relationship diagram to doc (1350)
- Maintain search field index tables, and use them for dataset queries (1360)
- Change Github lint action to use ``conda`` and remove ``flake8`` from action (1361)
- Fix database relationship diagram instruction for docker (1362)
- Document ``group_by`` for ``dataset.load`` (1364)
- Add search_by_metadata facility for products (1366)
- Postgis driver cleanup - remove faux support for lineage (1368)
- Add support for nested database transactions (1369)
- Fix Github doc lint action (1370)
- Tighten EO3 enforcement in postgis driver, refactor tests, and rename Dataset.type to Dataset.product
(with type alias for compatibility) (1372)
- Fix deprecation message due to distutils Version classes (1375)
- Postgresql drivers cleanup - consolidate split_uri into utils and removed unused constants (1378)
- Postgresql drivers cleanup - Handle NaNs in search fields and allow caching in sanitise_extent (1379)
- Fix example product yaml documentation (1384)
- Bulk read/write API methods and fast whole-index cloning. Cloning does NOT include lineage information yet,
and new API methods may be subject to change. (1381)
- Documentation update. (1385)
- Clean up datetime functions (1387)
- Dependency updates (1388, 1391)
- Upgrades for compatibility with newer versions of Shapely and Xarray. (1389)
- Finalise release notes for 1.8.10 release (1392)

Includes contributions from: pindge, omad, Ariana-B, sanjeev0210 and SpacemanPaul

Most notable changes:

1. `patch_url` argument to `dc.load()` and `dc.load_data()` (introduced in v1.8.8) is now also supported for Dask loading.
2. Fixed a day-zero bug affecting search over range-type search fields where the target and search field value is of zero-width.
3. Performance improvements to CRS geometry class.
4. Numerous improvements to documentation and github actions.

Full list of changes:

* Performance improvements to CRS geometry class (1322)
* Extend `patch_url` argument to `dc.load()` and `dc.load_data()` to Dask loading. (1323)
* Add `sphinx.ext.autoselectionlabel` extension to readthedoc conf to support `:ref:` command (1325)
* Add `pyspellcheck` for `.rst` documentation files and fix typos (1327)
* Add `rst` documentation lint github action and apply best practices (1328)
* Follow PEP561_ to make type hints available to other packages (1331)
* Updated GitHub actions config to remove deprecated `set-output` (1333)
* Add what's new page link to menu and general doc fixes (1335)
* Add `search_fields` to required for metadata type schema and update doc (1339)
* Fix typo and update metadata documentation (1340)
* Add readthedoc preview github action (1344)
* Update `nodata` in readthedoc for products page (1347)
* Add `eo-datasets` to extensions & related software doc page (1349)
* Fix bug affecting searches against range types of zero width (1352)
* Add 1.8.9 release date and missing PR to `whats_news.rst` (1353)

Includes contributions from SpacemanPaul, omad, pindge, snowman2.

With thanks and appreciation to all contributors, users and supporting organisations, expecially Geoscience Australia.

RC release to facilitate development in downstream packages using the new transaction API.

Most notable new feature is the new database transaction API, as discussed in [ODC-EP07 Database Transaction API](EP07-Database-transaction-API). API Example:


with dc.index.transaction() as trans:
Archive old datasets and add new ones in single transaction
dc.index.datasets.archive([old_ds1.id, old_ds2.id])
dc.index.datasets.add(ds1)
dc.index.datasets.add(ds2)

If execution gets to here, the transaction is committed.
If an exception was raised by any of the above methods, the transaction is rolled back.


Also includes an update of the main test docker build to Ubuntu 22.04 and Python 3.10, and significant progress on the new postgis index driver.

Please note that the postgis index driver is still flagged as "experimental" and is missing several key features.