Pandera

✨ Highlight ✨

Pandera now supports the configuration environment variable `PANDERA_VALIDATION_ENABLED`.
`export PANDERA_VALIDATION_ENABLED=False` now globally deactivates validation.

What's Changed
* Bump urllib3 from 2.0.4 to 2.0.7 by dependabot in https://github.com/unionai-oss/pandera/pull/1383
* Bump urllib3 from 2.0.5 to 2.0.7 in /dev by dependabot in https://github.com/unionai-oss/pandera/pull/1382
* Bump urllib3 from 2.0.4 to 2.0.7 in /ci by dependabot in https://github.com/unionai-oss/pandera/pull/1381
* Bugfix/1278 add_missing_columns assorted bugfixes by derinwalters in https://github.com/unionai-oss/pandera/pull/1372
* Fix lack of support for new TimestampNTZType in Spark 3.4 datatypes by filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1385
* Current `pip-compile` usage does not have `--no-emit-index-url` by filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1390
* Avoid throwing exception on Union types by mjgp2 in https://github.com/unionai-oss/pandera/pull/1378
* Fix optional fields in PySpark SQL by filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1387
* Add support for `unique` validation in PySpark by filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1396
* Enhancement to support GeoDataFrame, Geometry coercion, and CRS (Feature/1108) by derinwalters in https://github.com/unionai-oss/pandera/pull/1392
* fix issue for optional fields by coobas in https://github.com/unionai-oss/pandera/pull/1258
* Fix validating pyspark dataframes with regex columns by lexanth in https://github.com/unionai-oss/pandera/pull/1397
* Bump pyarrow from 13.0.0 to 14.0.1 by dependabot in https://github.com/unionai-oss/pandera/pull/1417
* Bump pyarrow from 13.0.0 to 14.0.1 in /dev by dependabot in https://github.com/unionai-oss/pandera/pull/1416
* Bump pyarrow from 13.0.0 to 14.0.1 in /ci by dependabot in https://github.com/unionai-oss/pandera/pull/1415
* [BUGFIX] [PYSPARK] Avoid running nullable checks if `nullable=True` by filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1403
* Add Date type to pandera.__all__ by diederikperdok in https://github.com/unionai-oss/pandera/pull/1419
* Fix disabling validation for PySpark DataFrame Schemas by maxispeicher in https://github.com/unionai-oss/pandera/pull/1407
* Bump actions/checkout from 3 to 4 by dependabot in https://github.com/unionai-oss/pandera/pull/1361
* [PySpark] Improve validation performance by enabling `cache()`/`unpersist()` toggles by filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1414
* Bump urllib3 from 2.0.5 to 2.0.7 by dependabot in https://github.com/unionai-oss/pandera/pull/1420
* Generate localized timestamps in multiindex examples by rob-sil in https://github.com/unionai-oss/pandera/pull/1426
* feature: support string column validation for pandas 2.1.3 by karlma821 in https://github.com/unionai-oss/pandera/pull/1425
* Add support for `PANDERA_VALIDATION_ENABLED` for pandas and Configuration docs by noklam in https://github.com/unionai-oss/pandera/pull/1354
* update total download badge and fix contributing instructions by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1436
* update cache dataframe config args, fix tests by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1437
* Bump jupyter-server from 2.7.3 to 2.11.2 in /dev by dependabot in https://github.com/unionai-oss/pandera/pull/1440
* Bump cryptography from 41.0.4 to 41.0.6 by dependabot in https://github.com/unionai-oss/pandera/pull/1435
* Bump jupyter-server from 2.7.2 to 2.11.2 by dependabot in https://github.com/unionai-oss/pandera/pull/1441

New Contributors
* filipeo2-mck made their first contribution in https://github.com/unionai-oss/pandera/pull/1385
* mjgp2 made their first contribution in https://github.com/unionai-oss/pandera/pull/1378
* coobas made their first contribution in https://github.com/unionai-oss/pandera/pull/1258
* lexanth made their first contribution in https://github.com/unionai-oss/pandera/pull/1397
* diederikperdok made their first contribution in https://github.com/unionai-oss/pandera/pull/1419
* maxispeicher made their first contribution in https://github.com/unionai-oss/pandera/pull/1407
* rob-sil made their first contribution in https://github.com/unionai-oss/pandera/pull/1426
* karlma821 made their first contribution in https://github.com/unionai-oss/pandera/pull/1425
* noklam made their first contribution in https://github.com/unionai-oss/pandera/pull/1354

**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.17.2...v0.18.0

What's Changed
* improve pydantic model efficiency by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1358


**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.17.1...v0.17.2

What's Changed
* bugfix: empty list/dicts and None values should be handled by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1347
* add unit tests by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1351


**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.17.0...v0.17.1

⭐️ Highlight

This release adds support for [pydantic v2](https://docs.pydantic.dev/latest/). Pydantic < v2 should be supported for the foreseeable future.

What's Changed

* fix: docstrong for to_script by tmcclintock in https://github.com/unionai-oss/pandera/pull/1266
* fix multimethod bug in pyspark by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1260
* Fix CI tests by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1303
* Very minor reworking of error message by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1304
* Fix typo in docs by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1300
* Update drop_invalid_rows.rst by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1277
* CONTRIBUTING.md Typo fixes and Markdown conventions by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1290
* Move black config to pyproject.toml by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1292
* Bugfix: Update drop invalid logic to handle multi-index dfs by kykyi in https://github.com/unionai-oss/pandera/pull/1320
* Use mirrors-mypy for pre-commit by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1291
* Generalize mypy ignore to pass linter CI by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1321
* raise_warning -> new SchemaWarning not UserWarning by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1298
* Doc for coercion behaviour for whole schema by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1289
* support pydantic v2 by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1253
* unpin mypy from requirements, xfail on unstable tests by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1338
* add ci requirements using pip, drop python 3.7 support by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1340

New Contributors
* tmcclintock made their first contribution in https://github.com/unionai-oss/pandera/pull/1266

**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.16.1...v0.17.0

What's Changed
* fix: docstrong for to_script by tmcclintock in https://github.com/unionai-oss/pandera/pull/1266
* fix multimethod bug in pyspark by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1260
* Fix CI tests by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1303
* Very minor reworking of error message by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1304
* Fix typo in docs by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1300
* Update drop_invalid_rows.rst by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1277
* CONTRIBUTING.md Typo fixes and Markdown conventions by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1290
* Move black config to pyproject.toml by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1292
* Bugfix: Update drop invalid logic to handle multi-index dfs by kykyi in https://github.com/unionai-oss/pandera/pull/1320
* Use mirrors-mypy for pre-commit by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1291
* Generalize mypy ignore to pass linter CI by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1321
* raise_warning -> new SchemaWarning not UserWarning by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1298
* Doc for coercion behaviour for whole schema by nathanjmcdougall in https://github.com/unionai-oss/pandera/pull/1289
* support pydantic v2 by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1253
* unpin mypy from requirements, xfail on unstable tests by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1338
* add ci requirements using pip by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1340

New Contributors
* tmcclintock made their first contribution in https://github.com/unionai-oss/pandera/pull/1266

**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.16.1...v0.17.0b0