Datacube

Transitional Release

1.8.18 contains bugfixes, as well as enhancements and changes to help prepare for the migration to Open Data Cube 1.9.x. This release likely contains the last significant enhancements to the 1.8.x series. The first 1.9 series release candidate will be published imminently. Future development will focus on the 1.9.x series, although 1.8.x series maintenance and bugfix releases will continue for the forseeable future.

- Add dataset cli tool `find-duplicates` to identify duplicate indexed datasets (1517)
- Make solar_day() timezone aware (1521)
- Warn if non-eo3 dataset has eo3 metadata type (1523)
- Update pandas version in docker image to be consistent with conda environment and default to stdlib
timezone instead of pytz when converting timestamps; automatically update copyright years (1527)
- Update github-Dockerhub credential-passing mechanism. (1528)
- Tweak `list_products` logic for getting crs and resolution values (1535)
- Add new ODC Cheatsheet reference doc to Data Access & Analysis documentation page (1543)
- Compatibility fix to allow users to supply `odc.geo`-style GeoBoxes to `dc.load(like=...)` (1551)
- Fix broken codecov github action. (1554)
- Update documentation links to DEA Knowledge Hub (1559)
- Throw error if ``time`` dimension is provided as an int or float to Query construction
instead of assuming it to be seconds since epoch (1561)
- Add generic NOT operator and for ODC queries and ``Not`` type wrapper (1563)
- Update whats_new.rst for release (1568)

Includes contributions from robbibt, Ariana-B, benji-glitsos-ga and SpacemanPaul

- Fix database permission-handling bug affecting `datacube system init --no-init-users` for the `postgres` index driver (1504).
- Switch to new `jsonschema` "referencing" API, and pin `jsonschema>=4.18` (1477)
- Update `whats_new.rst` for 1.8.17 release (1510)

With contributions from Ariana-B and SpacemanPaul. Thanks to omad and emmaai for identifying the issues.

Maintenance release

Various bug fixes and updates.

Previous releases of the ODC have supported Python 3.8+. With Python 3.8 now at end-of-life, and recent releases of key datacube dependencies (e.g. Xarray and PyProj) already requiring Python 3.9, this release officially drops support for Python 3.8.

Full list of changes:

- Improve error message for mismatch between dataset metadata and product signature 1472
- Mark ``--confirm-ignore-lineage``, ``--auto-add-lineage``, and ``--verify-lineage`` as deprecated
or to be deprecated 1472
- Default delta values in ``archive_less_mature`` and ``find_less_mature`` 1472
- Fix SQLAlchemy calls and pin jsonschema version to suppress deprecation warnings 1476
- Throw a better error if a dataset is not compatible with ``archive_less_mature`` logic 1491
- Fix broken Github action workflow 1496
- Support ``like=<GeoBox>`` in virtual product ``load`` 1497
- Don't archive less mature if archive_less_mature is provided as `False` instead of `None` 1498
- Raise minimum supported Python version to 3.9 1500
- Manually apply Dependabot updates, and update whats_new.rst for 1.8.16 release 1501

With contributions from SpacemanPaul Ariana-B and uchchwhash

Special thanks to all supporting organisations, especially Geoscience Australia.

The previous release of the Open Data Cube (1.8.14) replaced a deprecated import API for driver loading. Unfortunately the new API used is only supported by Python>=3.10. This means that v1.8.14 was not compatible with Python 3.8 and 3.9.

The Open Data Cube aims to support Python >= 3.8 and we apologise to the community for this oversight.

This v1.8.15 release replaces the problematic API with one that is supported by Python 3.8 and 3.9 (1469), and updates `whats_new.rst` (1470). There are no other changes in this release.

Thanks to emmaai for identifying the issue and Ariana-B for fixing it.

Major changes in this release:

1) The attempted fix to the projection bug in the previous release turned out to be inadequate, this release contains a fix for the bug fix.
2) The behaviour of the `archive-less-mature` option on dataset-add has been enhanced (default time leniency increased to +/-500ms, with the option for the user to set their own leniency threshold.
3) Several old and poorly maintained APIs have been formally deprecated in this release, and will be removed from datacube-core in the `1.9.0` release: ingestion (which the documentation has recommended against using for many years), executors and grid workflow. If you still use any of these APIs, you can continue to use them in this release (and will still be able to use them in all future `1.8.x` releases) by simply ignoring the deprecation warnings. If you have workflows that still depend on these APIs, please raise your requirements on the ODC Slack community so we can help you identify alternative approaches. There is no planned release date for v1.9.0 at this stage.

Full list of changes in this release:

- Second attempt to address unexpected handling of image aspect ratios in rasterio and GDAL. (1457)
- Fix broken PyPI publishing Github action (1454)
- Documentation improvements (1455)
- Increase default maturity leniency to +-500ms (1458)
- Add option to specify maturity timedelta when using `--archive-less-mature` option (1460)
- Mark executors as deprecated (1461)
- Mark ingestion as deprecated (1463)
- Replace deprecated `pkg_resources` with `importlib.resources` and `importlib.metadata` (1466)
- Update whats_new.rst for release (1467)

Includes code contributions from SpacemanPaul and Ariana-B.

With thanks to Kirill888, robbibt and snowman2 for their help in identifying and finding a viable fix for the projection bug and to Geoscience Australia for their continuing support of ODC development and maintenance.

Key improvements this release:

1) Fix for the upstream reprojection bug identified by robbibt
2) Implementation of "archive less mature" functionality in `datacube dataset add`.

Full list of changes:

- Fix broken Github action workflows (1425, 1427, 1433)
- Setup Dependabot, and Dependabot-generated updates (1416, 1420, 1423, 1428, 1436, 1447)
- Documentation fixes (1417, 1418, 1430)
- `datacube dataset` cli commands print error message if missing argument (1437)
- Add pre-commit hook to verify license headers (1438)
- Support open-ended date ranges in `datacube dataset search`, `dc.load`, and `dc.find_datasets` (1439, 1443)
- Pass Y and Y Scale factors through to rasterio.warp.reproject, to eliminate projection bug affecting
non-square Areas Of Interest (See Issue 1448) (1450)
- Add `archive_less_mature` option to `datacube dataset add` and `datacube dataset update` (1451)
- Allow for +-1ms leniency in finding other maturity versions of a dataset (1452)
- Update whats_new.rst for release (1453)

With contributions from SpacemanPaul, Ariana-B, omad, and MartinPontius

Special thanks to Kirill888 for his assistance with resolving 1448 and thanks to all supporting organisations, especially Geoscience Australia.