Prefect

Released on Apr 14, 2020.

Features

- None

Enhancements

- Task logical operators (e.g. `And`, `Or`, ...) no longer implicitly cast to `bool` - [2303](https://github.com/PrefectHQ/prefect/pull/2303)
- Allow for dynamically changing secret names at runtime - [2302](https://github.com/PrefectHQ/prefect/pull/2302)
- Update `ifelse` and `switch` to return tasks representing the output of the run branch - [2310](https://github.com/PrefectHQ/prefect/pull/2310)

Task Library

- Rename the base secret tasks for clarity - [2302](https://github.com/PrefectHQ/prefect/pull/2302)

Fixes

- Fix possible subprocess deadlocks when sending stdout to `subprocess.PIPE` - [2293](https://github.com/PrefectHQ/prefect/pull/2293), [#2295](https://github.com/PrefectHQ/prefect/pull/2295)
- Fix issue with Flow registration to non-standard Cloud backends - [2292](https://github.com/PrefectHQ/prefect/pull/2292)
- Fix issue with registering Flows with Server that have required scheduled Parameters - [2296](https://github.com/PrefectHQ/prefect/issues/2296)
- Fix interpolation of config for dev services CLI for Apollo - [2299](https://github.com/PrefectHQ/prefect/pull/2299)
- Fix pytest Cloud and Core server backend fixtures - [2319](https://github.com/PrefectHQ/prefect/issues/2319)
- Fix `AzureResultHandler` choosing an empty Secret over provided connection string - [2316](https://github.com/PrefectHQ/prefect/issues/2316)
- Fix containers created by Docker agent on Linux not being able to reach out to host API - [2324](https://github.com/PrefectHQ/prefect/issues/2324)

Deprecations

- None

Breaking Changes

- Remove `env_var` initialization from `EnvVarSecret` in favor of `name` - [2302](https://github.com/PrefectHQ/prefect/pull/2302)

Contributors

- [Brad McElroy](https://github.com/limx0)

Released on Apr 7, 2020.

Features

- CI build for prefect server images - [2229](https://github.com/PrefectHQ/prefect/pull/2229), [#2275](https://github.com/PrefectHQ/prefect/issues/2275)
- Allow kwargs to boto3 in S3ResultHandler - [2240](https://github.com/PrefectHQ/prefect/issues/2240)

Enhancements

- Add flags to `prefect server start` for disabling service port mapping - [2228](https://github.com/PrefectHQ/prefect/pull/2228)
- Add options to `prefect server start` for mapping to host ports - [2228](https://github.com/PrefectHQ/prefect/pull/2228)
- Return `flow_run_id` from CLI `run` methods for programmatic use - [2242](https://github.com/PrefectHQ/prefect/pull/2242)
- Add JSON output option to `describe` CLI commands - [1813](https://github.com/PrefectHQ/prefect/issues/1813)
- Add ConstantResult for eventually replacing ConstantResultHandler - [2145](https://github.com/PrefectHQ/prefect/issues/2145)
- Add new `diagnostics` mode for timing requests made to Cloud - [2283](https://github.com/PrefectHQ/prefect/pull/2283)

Task Library

- Make `project_name` optional for `FlowRunTask` to allow for use with Prefect Core's server - [2266](https://github.com/PrefectHQ/prefect/pull/2266)
- Adds `prefect.tasks.docker.container.RemoveContainer`

Fixes

- Fix `S3ResultHandler` safe retrieval of `_client` attribute - [2232](https://github.com/PrefectHQ/prefect/issues/2232)
- Change default log `timestamp` value in database to be identical to other tables instead of a hard coded value - [2230](https://github.com/PrefectHQ/prefect/pull/2230)

Deprecations

- None

Breaking Changes

- None

Contributors

- [Manuel Aristarán](https://github.com/jazzido)
- [szelenka](https://github.com/szelenka)
- [Aditya Bhumbla](https://github.com/abhumbla)
- [Alex Cano](https://github.com/alexisprince1994)

Released on Mar 29, 2020.

Features

- Open source database backend, GraphQL API and UI - [2218](https://github.com/PrefectHQ/prefect/pull/2218)
- Add `prefect server start` CLI command for spinning up database and UI - [2214](https://github.com/PrefectHQ/prefect/pull/2214)

Enhancements

- Add ValidationFailed state and signal in anticipation of validating task outputs - [2143](https://github.com/PrefectHQ/prefect/issues/2143)
- Add max polling option to all agents - [2037](https://github.com/PrefectHQ/prefect/issues/2037)
- Add GCSResult type [2141](https://github.com/PrefectHQ/prefect/issues/2141)
- Add Result.validate method that runs validator functions initialized on Result [2144](https://github.com/PrefectHQ/prefect/issues/2144)
- Convert all GraphQL calls to have consistent casing - [2185](https://github.com/PrefectHQ/prefect/pull/2185) [#2198](https://github.com/PrefectHQ/prefect/pull/2198)
- Add `prefect backend` CLI command for switching between Prefect Core server and Prefect Cloud - [2203](https://github.com/PrefectHQ/prefect/pull/2203)
- Add `prefect run server` CLI command for starting flow runs without use of project name - [2203](https://github.com/PrefectHQ/prefect/pull/2203)
- Make `project_name` optional during flow registration to support Prefect Core's server - [2203](https://github.com/PrefectHQ/prefect/pull/2203)
- Send flow run and task run heartbeat at beginning of run time - [2203](https://github.com/PrefectHQ/prefect/pull/2203)

Task Library

- None

Fixes

- Fix issue with heartbeat failing if any Cloud config var is not present - [2190](https://github.com/PrefectHQ/prefect/issues/2190)
- Fix issue where `run cloud` CLI command would pull final state before last batch of logs - [2192](https://github.com/PrefectHQ/prefect/pull/2192)
- Fix issue where the `S3ResultHandler` would attempt to access uninitialized attribute - [2204](https://github.com/PrefectHQ/prefect/issues/2204)

Deprecations

- None

Breaking Changes

- Drop support for Python 3.5 - [2191](https://github.com/PrefectHQ/prefect/pull/2191)
- Remove `Client.write_run_log` - [2184](https://github.com/PrefectHQ/prefect/issues/2184)
- Remove `Client.deploy` and `flow.deploy` - [2183](https://github.com/PrefectHQ/prefect/issues/2183)

Contributors

- None

Released on Mar 18, 2020.

Features

- None

Enhancements

- Update Cloud config name for heartbeat settings - [2081](https://github.com/PrefectHQ/prefect/pull/2081)
- Add examples to Interactive API Docs - [2122](https://github.com/PrefectHQ/prefect/pull/2122)
- Allow users to skip Docker healthchecks - [2150](https://github.com/PrefectHQ/prefect/pull/2150)
- Add exists, read, and write interfaces to Result [2139](https://github.com/PrefectHQ/prefect/issues/2139)
- Add Cloud UI links to Slack Notifications - [2112](https://github.com/PrefectHQ/prefect/issues/2112)

Task Library

- None

Fixes

- Fix S3ResultHandler use of a new boto3 session per thread - [2108](https://github.com/PrefectHQ/prefect/issues/2108)
- Fix issue with stateful function reference deserialization logic mutating state - [2159](https://github.com/PrefectHQ/prefect/pull/2159)
- Fix issue with `DateClock` serializer - [2166](https://github.com/PrefectHQ/prefect/issues/2166)
- Fix issue with scheduling required parameters - [2166](https://github.com/PrefectHQ/prefect/issues/2166)

Deprecations

- Deprecate cache\_\* and result_handler options on Task and Flow objects [2140](https://github.com/PrefectHQ/prefect/issues/2140)

Breaking Changes

- None

Contributors

- [alexisprince1994](https://github.com/alexisprince1994)

Released on Mar 4, 2020.

Fixes

- Change `task.log_stdout` retrieval from task runner to `getattr` in order to preserve running flows of older `0.9.x` versions - [2120](https://github.com/PrefectHQ/prefect/pull/2120)

Released on Mar 4, 2020.

Features

- Add new diagnostics utility to assist in troubleshooting issues - [2062](https://github.com/PrefectHQ/prefect/pull/2062)
- Add a jira_notification state handler to create jira tickets for failed tasks or flows - [1861](https://github.com/PrefectHQ/prefect/pull/1861)
- Add support for Python 3.8 - [2080](https://github.com/PrefectHQ/prefect/pull/2080)

Enhancements

- Add PIN 15 (skip refactor) - [2070](https://github.com/PrefectHQ/prefect/issues/2070)
- Update docs and docstrings related to Result Handlers - [1792](https://github.com/PrefectHQ/prefect/issues/1792)
- Add volume option to Docker Agent - [2013](https://github.com/PrefectHQ/prefect/issues/2013)
- `DaskKubernetesEnvironment` now elevates important autoscaling logs as well as possible Kubernetes issues - [2089](https://github.com/PrefectHQ/prefect/pull/2089)
- Add optional `scheduler_logs` kwarg to the`DaskKubernetesEnvironment` - [2089](https://github.com/PrefectHQ/prefect/pull/2089)
- Add ERROR log if heartbeat process dies - [2097](https://github.com/PrefectHQ/prefect/issues/2097)
- Enable stdout logging from inside a task with the kwarg `log_stdout=True` - [2092](https://github.com/PrefectHQ/prefect/pull/2092)
- Direct links to Cloud flows and flow runs now shown on creation time - [2109](https://github.com/PrefectHQ/prefect/pull/2109)
- Update docs related to using Context - [2077](https://github.com/PrefectHQ/prefect/issues/2077)

Task Library

- Fix expanding of `V1DeleteOptions` kwargs for Kubernetes tasks - [2083](https://github.com/PrefectHQ/prefect/pull/2083)

Fixes

- Fix `extra_loggers` config variable not being able to be set via environment variable - [2089](https://github.com/PrefectHQ/prefect/pull/2089)
- Fix environments not passing down their `extra_loggers` to any created infrastructure - [2089](https://github.com/PrefectHQ/prefect/pull/2089)
- Don't mutate data when serializing or deserializing - [2098](https://github.com/PrefectHQ/prefect/issues/2098)

Deprecations

- None

Breaking Changes

- None

Contributors

- [Romain Thalineau](https://github.com/romaintha)