Tiledb

Defects removed

* Do not load group metadata when getting it from REST. [4821](https://github.com/TileDB-Inc/TileDB/pull/4821)

Deprecation announcements

* Building with Visual Studio 2019 (MSVC toolchains v14.29 and earlier) will become unsuported in version 2.28, to be released in Q3 2024.
* HDFS support will be removed in version 2.28, to be released in Q3 2024.
* Support for GLIBC 2.17 (manylinux2014, based on CentOS 7) will be removed in TileDB version 2.31, to be released in Q4 2024. It will be replaced by support for GLIBC 2.28 (manylinux_2_28; RHEL8; Rocky Linux 8).

New features

* Add datatypes GEOM_WKB and GEOM_WKT. [4640](https://github.com/TileDB-Inc/TileDB/pull/4640)

TileDB backend API support:

* Query Plan REST support. [4519](https://github.com/TileDB-Inc/TileDB/pull/4519)
* Consolidation Plan REST support. [4537](https://github.com/TileDB-Inc/TileDB/pull/4537)

Improvements

* Optimize sparse reads when full non empty domain is requested. [4710](https://github.com/TileDB-Inc/TileDB/pull/4710)
* Lazily initialize the Azure SDK client. [4703](https://github.com/TileDB-Inc/TileDB/pull/4703)
* Remove QueryCondition requirement for Enumeration values to be valid. [4707](https://github.com/TileDB-Inc/TileDB/pull/4707)
* Convert dimension function pointer members to subclass methods. [4774](https://github.com/TileDB-Inc/TileDB/pull/4774)
* Implement dense dimension aggregates. [4801](https://github.com/TileDB-Inc/TileDB/pull/4801)

Defects removed

* Fix documentation of `Subarray::set_config` to match `tiledb_subarray_set_config`. [4672](https://github.com/TileDB-Inc/TileDB/pull/4672)
* Fix stats bug in StorageManager. [4708](https://github.com/TileDB-Inc/TileDB/pull/4708)
* Add explicit casts to fix compile errors. [4712](https://github.com/TileDB-Inc/TileDB/pull/4712)
* Fix bug with new minio behavior. [4725](https://github.com/TileDB-Inc/TileDB/pull/4725)
* Support reading V1 group details with explicit version in the name. [4744](https://github.com/TileDB-Inc/TileDB/pull/4744)
* Update crop_range to clamp to domain range. [4781](https://github.com/TileDB-Inc/TileDB/pull/4781)
* Fix segfault in ArraySchema::check. [4787](https://github.com/TileDB-Inc/TileDB/pull/4787)
* Fix crash in aggregates on dimensions. [4794](https://github.com/TileDB-Inc/TileDB/pull/4794)
* Fix defects with query channels. [4786](https://github.com/TileDB-Inc/TileDB/pull/4786)
* Remove trailing slash from `rest.server_address` configuration option. [4790](https://github.com/TileDB-Inc/TileDB/pull/4790)
* Provide a clear exception message when performing remote incomplete queries with aggregates. [4798](https://github.com/TileDB-Inc/TileDB/pull/4798)

API changes

C API

* Support VFS `ls_recursive` API for posix filesystem. [4778](https://github.com/TileDB-Inc/TileDB/pull/4778)

Test only changes

* Add unit_vfs to tests for windows/osx/linux. [4748](https://github.com/TileDB-Inc/TileDB/pull/4748)

Build System Changes

* Update vcpkg version baseline to https://github.com/microsoft/vcpkg/commit/72010900b7cee36cea77aebb97695095c9358eaf. [#4553](https://github.com/TileDB-Inc/TileDB/pull/4553)
* Add vcpkg triplets for RelWithDebInfo. [4669](https://github.com/TileDB-Inc/TileDB/pull/4669)
* Reintroduce the `TILEDB_STATIC` option under a deprecation warning. [4732](https://github.com/TileDB-Inc/TileDB/pull/4732)
* Fix linker errors when building with MSVC. [4759](https://github.com/TileDB-Inc/TileDB/pull/4759)
* CPack in Release Workflow. [4694](https://github.com/TileDB-Inc/TileDB/pull/4694)
* Single release CMake file that contains all required links/hashes. [4631](https://github.com/TileDB-Inc/TileDB/pull/4631)
* Improve build performance when GCS is enabled. [4777](https://github.com/TileDB-Inc/TileDB/pull/4777)
* Fix compiling unit tests when HDFS is enabled. [4795](https://github.com/TileDB-Inc/TileDB/pull/4795)
* Add CPack support to CMakeLists.txt. [4645](https://github.com/TileDB-Inc/TileDB/pull/4645)

Defects removed

* Support reading V1 group details with explicit version in the name. [4744](https://github.com/TileDB-Inc/TileDB/pull/4744)

Build System Changes

* Reintroduce the `TILEDB_STATIC` option under a deprecation warning. [4732](https://github.com/TileDB-Inc/TileDB/pull/4732)

Breaking behavior

* The minimum supported macOS version on x64 is 11. [4561](https://github.com/TileDB-Inc/TileDB/pull/4561)

New features

* Add internal definitions for S3 ls recursive [4467](https://github.com/TileDB-Inc/TileDB/pull/4467)
* Add experimental C API for ls_recursive. [4615](https://github.com/TileDB-Inc/TileDB/pull/4615)
* Add experimental CPP API for ls_recursive. [4625](https://github.com/TileDB-Inc/TileDB/pull/4625)

Improvements

* Keep opened array resources alive until query ends. [4601](https://github.com/TileDB-Inc/TileDB/pull/4601)
* Avoid needless buffer reallocations when consolidating fragments. [4614](https://github.com/TileDB-Inc/TileDB/pull/4614)
* Update the AWS SDK to version 1.11.215. [4551](https://github.com/TileDB-Inc/TileDB/pull/4551)
* Fix consolidation plan to print relative paths in output. [4604](https://github.com/TileDB-Inc/TileDB/pull/4604)
* Fix traversal limit in array deserialization. [4606](https://github.com/TileDB-Inc/TileDB/pull/4606)
* Add function random_label to utilize PRNG for random string generation. [4564](https://github.com/TileDB-Inc/TileDB/pull/4564)
* Improve large dense aggregate reads with tile metadata only. [4657](https://github.com/TileDB-Inc/TileDB/pull/4657)

Defects removed

* Fix regression when libraries were sometimes installed in the `lib64` directory. [4562](https://github.com/TileDB-Inc/TileDB/pull/4562)
* Don't segfault in ArraySchema::dump when enums are not loaded. [4583](https://github.com/TileDB-Inc/TileDB/pull/4583)
* Fix out of order consolidation. [4597](https://github.com/TileDB-Inc/TileDB/pull/4597)
* Finalize should error out for remote global order writes. [4600](https://github.com/TileDB-Inc/TileDB/pull/4600)
* Fix aggregate leak when field doesn't exist. [4610](https://github.com/TileDB-Inc/TileDB/pull/4610)
* Fix HTTP requests for AWS assume role not honoring config options. [4616](https://github.com/TileDB-Inc/TileDB/pull/4616)
* Fix recursively dumping a group with a nonexistent subgroup. [4582](https://github.com/TileDB-Inc/TileDB/pull/4582)
* Fix HTTP requests for AWS assume role with web identity not honoring config options. [4641](https://github.com/TileDB-Inc/TileDB/pull/4641)

Build System Changes

* Adds centos stream 9 dockerfile that builds tiledb [4591](https://github.com/TileDB-Inc/TileDB/pull/4591)
* Export a `TileDB::tiledb` CMake target regardless of static or dynamic linkage. [4528](https://github.com/TileDB-Inc/TileDB/pull/4528)
* Add a document with build instructions. [4581](https://github.com/TileDB-Inc/TileDB/pull/4581)
* Remove the `TILEDB_STATIC` option and replace it with `BUILD_SHARED_LIBS`. [4528](https://github.com/TileDB-Inc/TileDB/pull/4528)
* The build system supports building only a static or shared library from the same buildtree. [4528](https://github.com/TileDB-Inc/TileDB/pull/4528)
* `BUILD_SHARED_LIBS` is enabled by default. [4569](https://github.com/TileDB-Inc/TileDB/pull/4569)
* Add packaging tests into linux and mac CI pipelines. [4567](https://github.com/TileDB-Inc/TileDB/pull/4567)
* Add vcpkg triplets for Address Sanitizer. [4515](https://github.com/TileDB-Inc/TileDB/pull/4515)
* Fix regression where release artifacts had 8-digit commit hashes. [4599](https://github.com/TileDB-Inc/TileDB/pull/4599)
* Fix importing TileDB in CMake versions prior to 3.18. [4671](https://github.com/TileDB-Inc/TileDB/pull/4671)

Defects removed

* Fix bug with new minio behavior. [4725](https://github.com/TileDB-Inc/TileDB/pull/4725)
* Support reading V1 group details with explicit version in the name. [4744](https://github.com/TileDB-Inc/TileDB/pull/4744)

Build System Changes

* Fix regression where release artifacts had 8-digit commit hashes. [4599](https://github.com/TileDB-Inc/TileDB/pull/4599)
* Fix linker errors when building with MSVC. [4759](https://github.com/TileDB-Inc/TileDB/pull/4759)

Improvements

* Improve large dense aggregate reads with tile metadata only. [4657](https://github.com/TileDB-Inc/TileDB/pull/4657)

Defects removed

* Fix HTTP requests for AWS assume role with web identity not honoring config options. [4641](https://github.com/TileDB-Inc/TileDB/pull/4641)
* Fix HTTP requests for AWS assume role not honoring config options. [4616](https://github.com/TileDB-Inc/TileDB/pull/4616)