Starcluster

fixes. This release has support for Amazon's `Virtual Private Cloud (VPC)
<http://aws.amazon.com/vpc/>`_. See :ref:`using-vpc` for details on using
StarCluster with VPC. This release comes with new Ubuntu 13.04 AMIs for 32bit
and 64bit platforms as well as an HVM AMI that comes with drivers for GPU and
enhanced networking. The HVM AMI also comes with the CUDA toolkit, PyCuda,
MAGMA, and OGS GPU sensor. These new AMIs are available in all AWS regions.
Please use the **listpublic** command to find them::

$ starcluster listpublic

The sections below list the full set of features, enhancements, and bug fixes
for this release. Please note that this version is *not* compatible with
clusters started with older versions of StarCluster. Please terminate all
clusters before upgrading to 0.95.

.. _v095-features:

Features
--------
* **Add Virtual Private Cloud (VPC) support**
* **Update base StarCluster AMI ids to 13.04**
* Add support for new C3 instance types
* Add support for new GRID GPU g2.2xlarge (non-GPGPU) instance type
* Add support for m3.{medium,large} instance types
* Add support for new I2 instance family
* start: add ``--subnet`` (``-N``) and ``--no-public-ips option`` (VPC-only)
* start: add ``--dns-prefix`` (``-P``) option to prefix hostnames with the
cluster tag
* removenode: added ``--force`` (``-f``) option to removenode
* removenode: prompt for confirmation and add ``--confirm`` (``-c``) option
* sshmaster, sshnode: add ``--pseudo-tty`` (``-t``) option
* createkey: add ``--import-key`` (``-i``) option
* cluster: validate imported keypair fingerprints
* spothistory: add ``--vpc`` and ``--classic`` options
* spothistory: use classic or vpc prices based on default vpc
* hadoop: tune number of map/reduce tasks to number of CPUs
* hadoop: document all advanced settings
* listclusters, listinstances: show vpc and subnet ids

.. _v095-enhancements:

Enhancements
------------
* removenode: update usage to mimic addnode (ie added ``-n`` and ``-a``
options similar to addnode) - old usage works but is deprecated
* Removed internal scp module in favor of jbardin's scp module
* awsutils: wait for placement and security group deletion propagation in
ec2.delete_group
* node: don't force NFSv3 - use OS default (NFSv4 on recent AMIs)
* ebsimage: reduce rsync output by switching -v to -q (s3->ebs)
* ebsimage: log the ebs volume formatting step
* volume: log the exception when volume creation fails
* loadbalance: set UTC tzinfo in all datetime objects
* utils: use UTC timezone for all datetime objects
* cluster: deprecated all get_node_by* calls in favor of cluster.get_node
* awsutils: raise exc in EasyEC2.wait_for_propagation after max_retries
* Use pytest to run tests

.. _v095-fixes:

Bug Fixes
---------
* node: fix stale NFS entries from force-terminated spot nodes
* node: remove 'user' setting from NFS mount options
* node: add work-around for bug in debian nfs-kernel-server init script in
Ubuntu 13.04+
* node: use apt-get instead of apt in package_provider property
* node: run apt-get update before install in apt_install
* cluster: always use master's zone if not specified
* cluster: store availability_zone in core cluster settings tag
* cluster: raise error if MOUNT_PATH=/
* cluster: retry deleting placement group until successful
* cluster: check for master in remove_nodes prior to removing any nodes
* loadbalance: add nodes when below minimum
* loadbalance: raise an exception if min_nodes > max_nodes in loadbalancer
* loadbalance: fix crash in get_all_stats() when arr is empty
* ebsimage: set fs label = / on root vol when converting s3->ebs
* ebsimage: fix for bmap when converting s3->ebs
* ebsimage: only set 1 ephemeral drive when converting s3->ebs
* volume: only detach if vol != available in _delete_new_volume
* volume: remove duplicates from volume hosts list
* spothistory: improve accuracy by not using a possibly out-of-sync local time
stamp for the end date as long as -e is not specified
* spothistory: set UTC tzinfo on all datetime objects
* awsutils: raise exception if keypair exists in create_keypair
* awsutils: use instance store bmap for 32bit m1.small
* awsutils: dont specify ephemeral drives w/ t1.micro
* cli: raise parser error if tag is incorrectly specified
* condor: fetch & create condor dirs from config
* condor: set SCHEDD_NAME on each host
* condor: improve dedicated scheduler config

.. _version-0.94.3:

sections below for details. In general it's recommended to terminate all
clusters before upgrading to new versions of StarCluster although this is not
always strictly required.

.. _v0943-fixes:

Bug Fixes
---------
* Fixed 'InvalidSnapshot.NotFound' errors on cluster launch
* Fixed issue with Server.InternalError: Internal error on launch when using
m1.small instance type with a 32bit AMI.
* Updated default AMIs in config template to 64bit AMIs

.. _version-0.94.2:

sections below for details. In general it's recommended to terminate all
clusters before upgrading to new versions of StarCluster although this is not
always strictly required.

.. _v0942-fixes:

Bug Fixes
---------
* node: fixed regression where the instance's connection object was not being
reused which was causing issues for folks using regions other than the default
us-east-1.

.. _version-0.94.1:

"Bug Fixes" sections below for details. In general it's recommended to
terminate all clusters before upgrading to new versions of StarCluster
although this is not always strictly required.

.. _v0941-features:

Features
--------
* restart: add ``--reboot-only`` option
* awsutils: force ``delete_on_termation`` on root volume when launching
instances
* delay using optional imports in starcluster.utils until needed (reduces the
time it takes to load StarCluster)

.. _v0941-fixes:

Bug Fixes
---------
* cluster: wait for all instance and spot requests to propagate (fixes
'instance not found' errors and 'missing' spot requests when waiting for
cluster to come up)
* cluster: terminate any instance that's been pending for more than 15 minutes
(fixes infinite wait due to a forever pending node)
* s3image: fix block device map issue when host instance is EBS-backed
* awsutils: fix custom block device map for S3 instances/AMIs
* sshnode: fix keypair validation bug
* node: fix for duplicate entries in known_hosts file
* node: fix bug where credentials attributes were missing from node.ec2 object
* loadbalancer: always pass ``--utc`` when calling date command
* loadbalancer: set matplotlib backend to Agg - allows ``--plot`` option to
work without a display
* config: convert ``EC2_CERT`` and ``EC2_PRIVATE_KEY`` in ``[aws]`` section to
absolute path
* config: fix typo in config template (``PROTOCOL`` -> ``IP_PROTOCOL``)
* tmux plugin: fix race condition where ``new-window -t`` is called before
``new-session`` has finished
* spothistory: update help docs for ``--plot`` option

.. _version-0.94:

the "Features" and "Bug Fixes" sections below for details. This release is
not compatible with any active clusters that were created using any previous
version of StarCluster. Please terminate all existing clusters before
upgrading to 0.94.

.. _v094-features:

Features
--------
* Support for hs1.8xlarge, hi1.4xlarge, and m3 instance types
* Added support for userdata scripts (new cluster setting: userdata_scripts)
* Add *all* ephemeral drives for any instance type when launching instances
* Updated base AMIs to latest 12.04 versions
* OGS (formerly SGE): set default parallel environment allocation_rule to $fill_up
* Added authentication agent forwarding to sshmaster, sshnode, and sshinstance
* Support for loading config based on ``$STARCLUSTER_CONFIG`` environment
variable
* New plugin to install python packages with pip (pypkginstaller plugin)
* New plugin that either copies or autogenerates a boto config for the cluster
user
* Added ``--force`` option to terminate/stop commands
* Add tags and virtualization type to listinstance output
* Add ``--zone`` (``-z``) option to spothistory command

.. _v094-fixes:

Bug Fixes
---------
* sshutils: source /etc/profile by default
* awsutils: validate AWS SSL certificates by default
* awsutils: refetch group before calling authorize
* awsutils: use 3 decimal places in spot history prices
* cluster: fix thread leak when running plugins
* cluster: store cluster metadata in userdata/tags
* cluster: dont launch master as spot when ``CLUSTER_SIZE=1``
* cluster: reraise uncaught exceptions in run_plugins
* cluster: fix instance filtering for default VPC
* cluster: only clean-up placement groups in supported regions
* clustersetup: ebs volume mounting improvements
* clustersetup: raise exception if user's ``$HOME`` is owned by root
* improve ebs volume device and partition detection
* config: allow inline comments in the config file
* config: support ``[vol]`` shortcut in config
* config: document/warn where/when env overrides cfg
* threadpool: clear the exceptions queue in wait()
* node: fix Node.root_device_name for misconfigured AMIs
* node: fix ~/.ssh ownership in generate_key_for_user
* sge: Export ``$DRMAA_LIBRARY_PATH`` for Python DRMAA
* cli: use logging module to log/show exceptions
* cli: write header to sys.stderr
* logger: move console logs from stderr to stdout
* logger: output error messages to stderr
* logger: remove in-memory log handler (memory-leak fix)
* fix for DependencyViolation when deleting security group
* replace group-name filter with instance.group-name
* spothistory: show *current* spot price instead of oldest

**resizevol/createvol**:

* call e2fsck before resize2fs if needed
* cleanup vol on failure in resize()
* fix bug in _warn_about_volume_hosts
* fix bug in sfdisk repartitioning
* set default instance type to t1.micro for volume hosts
* fix bug when cleaning up failed volumes
* use force_spot_master when launching cluster

**ebsimage/s3image**:

* fetch root device from instance metadata
* only wait for snapshot if root device is in bmap
* show progress bar for CreateImage snapshot
* remove ssh host keys in clean_private_data
* use ec2.get_snapshot to fetch snapshots

**loadbalance**:

* collect all queue info from qstat
* fix logic in SGEStats._count_tasks
* fix node count in _eval_remove_node
* get slot calculations from all.q
* handle qacct error on fresh SGE install
* improve qstat parsing
* maintain a single instance of SGEStats
* move static settings to __init__
* remove bounds on interval and wait_time
* remove estimated time to completion calcs
* replace 'qlen > ts' condition in _eval_add_node
* require positive ints for numeric options
* take slots into account in _eval_add_node
* update sge tests for latest parser changes
* use of nodes for max_nodes check (not exec hosts)
* don't wait for cluster to stabilize to add a node when there are no slots
* immediately add a node when jobs are in the queue and no slots exists

**IPython plugin**:

* Add section on engine restart + note on growing new engines
* ipcluster: raise exception if IPython isnt installed
* Better docstrings for the stop and restart plugins
* Better packer configuration support + updated doc
* Make it possible to configure a custom notebook folder
* Make it possible to restart engine, better logs, make msgpack setup explicit
* Open the controller ports for IPython 0.13.1
* Use the cluster thread pool to start the engines on the nodes
* Update the documentation according to tests done on 0.13.1

.. _version-0.93.3:

the "Bug Fixes" section below for details.

* Bumped boto dep to 2.3.0
* Updated and improved default config template

.. _v0933-fixes:

Bug Fixes
---------
* sge: fix bug where master could never be an exec host even when toggling the
``master_is_exec_host`` plugin setting (issue 89)
* fix bug when setting custom SSH permission without ``cidr_ip`` (issue 91)
* start-cmd: fix bug where ``refresh_interval`` is always ``None`` if
``[global]`` is not defined in the config (issue 90)
* dont allow ``cluster_user=root`` when validating cluster settings (issue 92)
* fix another textwrap error with python 2.5

.. _version-0.93.2: