Sparksteps

Latest version: v3.0.1

Safety actively analyzes 619181 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

3.0.1

~~~~~~~~~~~~~~~~~~~

* Fixed an issue where `get_bid_price` would always base the instance bid price on the zone with the lowest current instance price, even though the cluster may not be launched in that AZ.

3.0.0

~~~~~~~~~~~~~~~~~~~

* Fix `determine_best_price` returning a spot price that would be below the current spot price in some conditions.
* Dropped support for Python 3.5.

2.2.1

~~~~~~~~~~~~~~~~~~~

* Fix `get_demand_price` returning 0.00 for various instance types.

2.2.0

~~~~~~~~~~~~~~~~~~~

* Support S3 paths in the `uploads` CLI option. A copy step will be added to the EMR cluster which will copy into /home/hadoop from the provided remote path.
* Add option `--service-role` to configure EMR service role beyond the default `EMR_DefaultRole`.

2.1.0

~~~~~~~~~~~~~~~~~~~

* Add `wait` CLI option. When `--wait` is passed, waits for EMR cluster steps to complete before application exits, sleeping 150 seconds (default) between each poll attempt. An optional integer value can be passed to specify the polling interval to use, in seconds.

2.0.0

~~~~~~~~~~~~~~~~~~~

* Add `s3-path` CLI argument to optionally configure the path prefix used when writing sparksteps related assets such as sources (file uploads) and logs.

**NOTE:** This is a backwards incompatible change as `sources/` and `logs/` are now written to the location specified by the `s3-path` argument.
Prior to this change logs were written to `s3://S3_BUCKET/logs/sparksteps` and uploads to `s3://S3_BUCKET/sparksteps/sources`.

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.