Cwl-airflow

Latest version: v1.2.9

Safety actively analyzes 620930 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 6

1.10.3

1.2.9

* Updated to Airflow 2.0.0
* Fixed bug in triggering DAGs from API
* Added DAG to optionally resend all undelivered progress reports and results

1.2.8

- Added docker-compose with LocalExecutor
- Switched from `zlib` to `gzip` for workflow compressing/decompressing (not breaking changes)
- Updated packaging script for portable version for Ubuntu (runs LocalExecutor with PostgreSQL)

1.2.7

- Added API endpoint to create and trigger DAGs in the same call
- Added error categories reports
- Updated macOS packaging script to use Python 3.8 by default
- Updated `clean_dag_run.py` to remove outdated DAGs
> removes the DAGs for the previous versions of the same workflows if they are not any running DagRuns
- Updated docker-compose (work in progress)
> use latest ubuntu 20.04 and Python 3.8
> add `cwl_inputs_folder` volume mapping to the docker-compose
> start services in the order that guaranties all databases and tables are available

All tar.gz are built from the master branch (https://github.com/Barski-lab/cwl-airflow/tree/0a80928daf55ba306805ff2f3e8eaad5e6c7397c)

1.2.6

Fixed bugs:
- broken dependencies (add `--constraint` parameter for installation)
- workflow fails to execute if section `in` of the workflow step is empty
- workflow fails to execute if workflow input has `loadListing` section
- API fails to trigger multiple DAG-runs when POSTing multiple requests a once
- `init` command fails to patch Airflow config file if the path to it includes spaces

Other changes:
- refactored progress reports posting
- added crypto installation dependency

All tar.gz are built from master (https://github.com/Barski-lab/cwl-airflow/tree/a2b9512cb3480ab005a63efc23c0421c9537915e)

1.2.5

Updates:
- uses apache-airflow==1.10.12 & cwltool==3.0.20200710214758
- outputs CWL related logs into separate files
- supports simple scatter
- supports literal file inputs

Tested on [cwl-v1.1](https://github.com/common-workflow-language/cwl-v1.1/tree/be5ee84de20d41b6d7d94b3d2a71ddd591d1bf73) conformance test from Oct 7, 2020
- total: 253
- excluded: 2 (due to https://github.com/common-workflow-language/cwl-v1.2/issues/51)
- failed with known reason:
* 2 (due to https://github.com/common-workflow-language/cwl-v1.2/issues/52)
* 5 (due to https://github.com/Barski-lab/cwl-airflow/issues/43)
* 12 (due to https://github.com/Barski-lab/cwl-airflow/issues/44)
- success rate: 90%

*Reference: SDDA Sprint 1*

Page 1 of 6

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.