Duckdb

This preview release of DuckDB is named "Falcata" after the Falcated Duck (Mareca falcata). Binary builds are listed below. Feedback is very welcome.

Note: This release introduces a backwards-incompatible change to the on-disk storage format. We suggest you use the EXPORT DATABASE command with the old version followed by IMPORT DATABASE with the new version to migrate your data. See the documentation for details.

Major Changes:

Engine
- 1356: **Incremental Checkpointing**
- 1422: Optimize Top N Implementation

SQL
- 1406, 1372, 1387: Many, many new aggregate functions
- 1460: `QUANTILE` aggregate variant that takes a list of quantiles & 1346: Approximate Quantiles
- 1461: `JACCARD`, 1441 `LEVENSHTEIN` & `HAMMING` distance scalar function
- 1370: `FACTORIAL` scalar function and ! postfix operator
- 1363: `IS (NOT) DISTINCT FROM`
- 1385: `LIST_EXTRACT` to get a single element from a list
- 1361: Aliases in the `HAVING` clause (fixes issue 1358)
- 1355: Limit clause with non constant values

APIs:
- 1430 & 1424: **DuckDB WASM builds**
- 1419: Exporting the appender api to C
- 1408: Add blob support to C API
- 1432, 1459 & 1456: Progress Bar
- 1440: Detailed profiler.

This preview release of DuckDB is named "Jubata" after the [Australian Wood Duck](https://en.wikipedia.org/wiki/Australian_wood_duck) (Chenonetta jubata). Binary builds are listed below. Feedback is very welcome.

Note: This release introduces a backwards-incompatible change to the on-disk storage format. We suggest you use the EXPORT DATABASE command with the old version followed by IMPORT DATABASE with the new version to migrate your data. See the documentation for details.

Major changes:
SQL
- 1231: Full Text Search extension
- 1309: Filter Clause for Aggregates
- 1195: `SAMPLE` Operator
- 1244: `SHOW` select queries
- 1301: `CHR` and `ASCII` functions & 1252: Add `GAMMA` and `LGAMMA` functions

Engine
- 1211: (Mostly) Lock-Free Buffer Manager
- 1325: Unsigned Integer Types Support
- 1229: Filter Pull Up Optimizer
- 1296: Optimizer that removes redundant `DELIM_GET` and `DELIM_JOIN` operators
- 1219: `DATE`, `TIME` and `TIMESTAMP` rework: move to epoch format & microsecond support

Clients
- 1287 and 1275: Improving JDBC compatibility
- 1260: Rework client API and prepared statements, and improve DuckDB -> Pandas conversion
- 1230: Add support for parallel scanning of pandas data frames
- 1256: JNI appender
- 1209: Write shell history to file when added to allow crash recovery, and fix crash when .importing file with invalid
- 1204: Add support for blobs to the R API and 1202: Add blob support to the python api

Parquet
- 1314: Refactor and nested types support for Parquet Reader

This preview release of DuckDB is named "Serrator" after the Red-breasted merganser (Mergus serrator). Binary builds are listed below. Feedback is very welcome.

Note: This release introduces a backwards-incompatible change to the on-disk storage format. We suggest you use the EXPORT DATABASE command with the old version followed by IMPORT DATABASE with the new version to migrate your data. See the documentation for details.

Major changes:

SQL:
- 1179: Interval Cleanup & Extended `INTERVAL` Syntax
- 1147: Add exact `MEDIAN` and `QUANTILE` functions
- 1129: Support scalar functions with `CREATE FUNCTION`
- 1137: Add support for (`NOT`) `ILIKE`, and optimize certain types of `LIKE` expressions

Engine
- 1160: Perfect Aggregate Hash Tables
- 1133: Statistics Rework & Statistics Propagation
- 1144: Common Aggregate Optimizer, 1143: CSE Optimizer and 1135: Optimizing expressions in grouping keys
- 1138: Use predication in filters
- 1071: Removing string null termination requirement

Clients
- 1112: Add DuckDB node.js API
- 1168: Add support for Pandas category types
- 1181: Extend DuckDB::LibraryVersion() to output dev version in format `0.2.3-devXXX` & 1176: Python binding: Add module attributes for introspecting DuckDB version

Parquet Reader:
- 1183: Filter pushdown for Parquet reader
- 1167: Exporting Parquet statistics to DuckDB
- 1162: Add support for compression codec in Parquet writer & 1163: Add ZSTD Compression Code and add ZSTD codec as option for Parquet export
- 1103: Add object cache and Parquet metadata cache

This is a preview release of DuckDB.
Starting from this release, releases get named as well. Names are chosen from species of ducks (of course). We start with "Clypeata".

*Note*: This release introduces a backwards-incompatible change to the on-disk storage format. We suggest you use the `EXPORT DATABASE` command with the old version followed by `IMPORT DATABASE` with the new version to migrate your data. See the [documentation](https://duckdb.org/docs/sql/statements/export) for details.

Binary builds are listed below. Feedback is very welcome. Major changes:

SQL
- 1057: Add PRAGMA for enabling/disabling optimizer & extend output for query graph
- 1048: Allow CTEs in subqueries (including CTEs themselves) and 987: Allow CTEs in CREATE VIEW statements
- 1046: Prettify Explain/Query Profiler output
- 1037: Support FROM clauses in UPDATE statements
- 1006: STRING_SPLIT and STRING_SPLIT_REGEX SQL functions
- 1000: Implement MD5 function
- 936: Add GLOB support to Parquet & CSV readers
- 899: Table functions information_schema_schemata() and information_schema_tables() and 903: Add table function information_schema_columns()

Engine
- 984: Parallel grouped aggregations and 1045: Some performance fixes for aggregate hash table
- 1008: Index Join
- 991: Local Storage Rework: Per-morsel version info and flush intermediate chunks to the base tables
- 906: Parallel scanning of single Parquet files and 982: ZSTD Support in Parquet library
- 883: Unify Table Scans with Table Functions
- 873: TPC-H Extension
- 884: Remove NFC-normalization requirement for all data and add COLLATE NFC

Client
- 1001: Dynamic Syntax Highlighting in Shell
- 933: Upgrade shell.c to 3330000
- 918: Add in support for Python datetime types in bindings
- 950: Support dates and times output into arrow
- 893: Support for Arrow NULL columns

This is a preview release of DuckDB. Binary builds are listed below. Feedback is very welcome. Major changes:

Engine
- 770: Enable Inter-Pipeline Parallelism
- 835: Type system updates with 779: `INTERVAL` Type, 858: Fixed-precision `DECIMAL` types & 819: `HUGEINT` type
- 790: Parquet write support

API
- 866: Initial Arrow support
- 809: Aggregate UDF support with 843: Generic `CreateAggregateFunction()` & 752: `CreateVectorizedFunction()` using only template parameters

SQL
- 824: `strftime` and `strptime`
- 858: `EXPORT DATABASE` and `IMPORT DATABASE`
- 832: read_csv(_auto) improvements: optional parameters, configurable sample size, line number info

This is a preview release of DuckDB. Binary builds are listed below. Feedback is very welcome.

SQL:
- 730: `FULL OUTER JOIN` Support
- 732: Support for `NULLS FIRST`/`NULLS LAST`
- 698: Add implementation of the `LEAST`/`GREATEST` functions
- 772: Implement `TRIM` function and add optional second parameter to `RTRIM`/`LTRIM`/`TRIM`
- 771: Extended Regex Options

Clients:
- Python: 720: Making Pandas optional and add support for PyPy
- C++: 712: C++ UDF API