- Adds on_fail functionality to tasks allowing children to run when parent tasks fail - Improvements to cli to allow lists with a single -t or -x flag
0.5.7
Changed
- Adds support for renaming columns on copy tasks - Improvements to BigQuery data load of nested fields
0.5.6
Changed
- Adds staging area based batch copy for snowflake - Returns number of records loaded in load_data - Adds support for copy to merge frequently to target table
Fixed
- Fixes to columns without names in ddl - Adds sorting to copy's get_data_query
0.5.5
Changed
- Refactoring of database code to improve performance by adding introspection after all tasks have been setup - Improvements to BigQuery process - Adds support for testing all databases - Adds support for environment variables specified in YAML (JSON still supported as well)