Cwl-airflow

Latest version: v1.2.9

Safety actively analyzes 631322 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 6

1.2.2

- Add `extras_require` into `setup.py` for `mysql`, `statsd`, `celery` dependencies
- Support workflow parameter as zlib compressed base64 encoded string
- Update `api` and `test` to support embedded in DAG zlib compressed workflows
- Add `--upgrade` argument to `init` command to update old formatted dags
- Update `on_kill` function of `CWLStepOperator` to stop running docker container

1.2.1

1. Faster CWL parsing and validation
2. Simplified syntax for new DAG creation

python
!/usr/bin/env python3
from cwl_airflow.extensions.cwldag import CWLDAG
dag = CWLDAG(workflow="my_workflow.cwl", dag_id="my_dag")

1.2.0

1. Faster CWL parsing and validation
2. Simplified syntax for new DAG creation

python
!/usr/bin/env python3
from cwl_airflow.extensions.cwldag import CWLDAG
dag = CWLDAG(workflow="my_workflow.cwl", dag_id="my_dag")

1.1.12

1.1.12.dev1

Test the latest `cwltool==2.0.20200224214940` and `airflow==1.10.9`

To avoid frequent releases on every not critical bug fix, files prefixed with `master` will correspond to the latest build from the `master` branch. Other files are built at the time of release.

1.1.11

**Some new features**
- Use Singularity instead of Docker (default: False). Update `airflow.cfg` with

[cwl]
singularity = True

- Force to use container (default: true). Update `airflow.cfg` with

[cwl]
use_container = True


**Launching MacOs App from the console:**
1. Set `AIRFLOW_HOME` environment variable to use a custom location for Airflow home directory
2. Run configuration script (do it every time you change `AIRFLOW_HOME`)
`cwl-airflow.app/Contents/MacOS/init`
Script will run `airflow initdb`, update `airflow.cfg`, copy DAGs and create required connections
3. Run scheduler
`cwl-airflow.app/Contents/MacOS/airflow scheduler`
4. Run API server (use `-h` to see additional parameters)
`cwl-airflow.app/Contents/MacOS/apiserver`

**Launching MacOs App from a Finder:**
NOTE: the default location for `AIRFLOW_HOME` will be used `~/airflow`
1. Double click on `cwl-airflow.app`
Script will create three services in `~/Library/LaunchAgents`
`com.biowardrobe.airflow-scheduler.plist`
`com.biowardrobe.airflow-webserver.plist`
`com.biowardrobe.airflow-apiserver.plist`
2. Use `Load` and `Unload` buttons to start and stop services.
3. If `cwl-airflow.app` is moved to another location, make sure to manually remove abovementioned `plist` files

**Launching portable Ubuntu 18.04 cwl-airflow version from the console:**
1. Set `AIRFLOW_HOME` environment variable to use a custom location for Airflow home directory
2. Run scheduler
`cwl-airflow/bin_portable/airflow scheduler`
3. Run API server (use `-h` to see additional parameters)
`cwl-airflow/bin_portable/apiserver`

Page 2 of 6

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.