Prefect

Features

- Add interface for backend key-value metadata store - [4499](https://github.com/PrefectHQ/prefect/pull/4499)

Enhancements

- Keep intermediate docker layers when using Docker Storage to improve caching - [4584](https://github.com/PrefectHQ/prefect/pull/4584)

Fixes

- Fix possible race condition in `LocalResult` directory creation - [4587](https://github.com/PrefectHQ/prefect/pull/4587)
- Use absolute paths when registering flows in `prefect register` - [4593](https://github.com/PrefectHQ/prefect/pull/4593)
- Propagate storage labels (e.g. hostname label on `Local` storage) when registering flows with `prefect register` - [4593](https://github.com/PrefectHQ/prefect/pull/4593)
- Fix small-flow parallelism issues with multiprocess `LocalDaskExecutor` - [4602](https://github.com/PrefectHQ/prefect/pull/4602)
- Cleanly handle unpicklable exceptions in tasks - [4605](https://github.com/PrefectHQ/prefect/pull/4605)

Contributors

- [Tom Forbes](https://github.com/orf)

Released on May 25, 2021.

Enhancements

- Refactor `Agent` base class for readability - [4341](https://github.com/PrefectHQ/prefect/pull/4341)
- Display the agent config id on agent startup if set - [4524](https://github.com/PrefectHQ/prefect/pull/4524)
- Add debug logs during agent auth verification - [4547](https://github.com/PrefectHQ/prefect/pull/4547)
- Sending logs to Cloud can be globally disabled via config in addition to the agent flag - [4487](https://github.com/PrefectHQ/prefect/pull/4487)

Task Library

- Enable sending attachments with emails in the `EmailTask` - [4457](https://github.com/PrefectHQ/prefect/pull/4457)
- Add Google Cloud Platform `GCPSecret` task - [4561](https://github.com/PrefectHQ/prefect/pull/4561)

Fixes

- Fix `import_object` handling of submodules that are not attributes - [4513](https://github.com/PrefectHQ/prefect/pull/4513)
- Fix `DockerStorage` building with python slim image - [4523](https://github.com/PrefectHQ/prefect/pull/4523)
- Gracefully handle events with missing timestamps in K8s agent - [4544](https://github.com/PrefectHQ/prefect/pull/4544)
- Fix bug where agent uses originally scheduled start time instead of latest state time - [4568](https://github.com/PrefectHQ/prefect/pull/4568)

Deprecations

- `logging.log_to_cloud` has been deprecated in favor of `cloud.send_flow_run_logs` - [4487](https://github.com/PrefectHQ/prefect/pull/4487)

Contributors

- [Stéphan Taljaard](https://github.com/taljaards)
- [Thomas Heyenbrock](https://github.com/thomasheyenbrock)

Released on May 11, 2021 as a hotfix for 0.14.18

Fixes

- Fix docker container name error while using docker agents - [4511](https://github.com/PrefectHQ/prefect/pull/4511)

Released on May 11, 2021.

Enhancements

- Add an `image_pull_policy` kwarg to `KubernetesRun` - [4462](https://github.com/PrefectHQ/prefect/pull/4462)
- Allow `prefect build/register --module` to accept full import path to flow - [4468](https://github.com/PrefectHQ/prefect/pull/4468)
- Add `hello world` flow to prefect module - [4470](https://github.com/PrefectHQ/prefect/pull/4470)
- Set docker container names to flow run names when running with the docker agent - [4485](https://github.com/PrefectHQ/prefect/pull/4485)

Task Library

- Add basic implementation of `SendGrid` to Task Library - [4450](https://github.com/PrefectHQ/prefect/pull/4450)
- Log link to flow run in `StartFlowRun` - [4458](https://github.com/PrefectHQ/prefect/pull/4458)
- Allow passing in `io.BytesIO` to `GCSUpload` - [4482](https://github.com/PrefectHQ/prefect/pull/4482)

Fixes

- Fix logging errors within `BigQuery` task - [4419](https://github.com/PrefectHQ/prefect/pull/4419)
- Remove unnecessary docker interface detection in Docker agent - [4446](https://github.com/PrefectHQ/prefect/pull/4446)
- Upgrade `kubernetes` package requirement upper limit - [4452](https://github.com/PrefectHQ/prefect/pull/4452)
- Fix Prefect server startup check for custom server port - [4501](https://github.com/PrefectHQ/prefect/pull/4501)

Contributors

- [Brett Naul](https://github.com/bnaul)
- [Joël Luijmes](https://github.com/joelluijmes)
- [Stéphan Taljaard](https://github.com/taljaards)
- [Zach Schumacher](https://github.com/zschumacher)

Features

- Add git storage - [4418](https://github.com/PrefectHQ/prefect/pull/4418)

Enhancements

- Add test coverage for threaded `LocalDaskExecutor` timeouts - [4217](https://github.com/PrefectHQ/prefect/pull/4217)
- Add environment variable support to UniversalRunConfig - [4383](https://github.com/PrefectHQ/prefect/pull/4383)
- Adds column name fetching to PostgresFetch task - [4414](https://github.com/PrefectHQ/prefect/pull/4414)
- Allow external Postgres with `prefect server start` command - [4424](https://github.com/PrefectHQ/prefect/pull/4424)

Fixes

- Pass reference tasks states instead of task states to terminal_state_handler - [4409](https://github.com/PrefectHQ/prefect/pull/4409)
- Check for AWS_RETRY_MODE variable before setting default in `ECSAgent` - [4417](https://github.com/PrefectHQ/prefect/pull/4417)
- Fixed bug from Flow.copy() not copying the slugs dictionary - [4435](https://github.com/PrefectHQ/prefect/pull/4435)
- Fix compatibility with PyGithub >= 1.55 - [4440](https://github.com/PrefectHQ/prefect/pull/4440)

Contributors

- [Ben Fogelson](https://github.com/benfogelson)
- [Gabriel Montañola](https://github.com/gmontanola)

Changelog

April 14, 2021 <Badge text="beta" type="success" />

Released on April 14, 2021.

Enhancements

- Added support for Bitbucket cloud into Bitbucket storage class [4318](https://github.com/PrefectHQ/prefect/issues/4318)
- Update docs for API keys - [4313](https://github.com/PrefectHQ/prefect/pull/4313)
- Add option to disable the deletion of finished Prefect jobs in the Kubernetes agent - [4351](https://github.com/PrefectHQ/prefect/pull/4351)
- Improve messaging when a flow is skipped during registration - [4373](https://github.com/PrefectHQ/prefect/pull/4373)
- Display a more helpful error when calling a task outside a flow context - [4374](https://github.com/PrefectHQ/prefect/pull/4374)
- Lower required docker-compose version and add note to docs - [4396](https://github.com/PrefectHQ/prefect/pull/4396)
- Increase healthcheck intervals for Prefect Server - [4396](https://github.com/PrefectHQ/prefect/pull/4396)
- Allow the `ShellTask` to be used on win32 - [4397](https://github.com/PrefectHQ/prefect/pull/4397)

Fixes

- Fix ShellTask docstring - [4360](https://github.com/PrefectHQ/prefect/pull/4360)
- Fix incorrect unused task tracking - [4368](https://github.com/PrefectHQ/prefect/pull/4368)
- Add error handling to timeouts that fail during result pickling or passing - [4384](https://github.com/PrefectHQ/prefect/pull/4384)

Contributors

- [Jonathan Wright](https://github.com/wrightjonathan)