Gsutil

=======================================

New Features
------------

- Added support for new Object Change Notifications feature.

Bug Fixes
---------

- Fixed problem where gsutil update command didn’t take default action.
- Fixed a problem with the update command sometimes triggering an additional
update command.

Other Changes
-------------

- Add packaging information to version output.
- Removed fancy_urllib, since it is no longer used.
- Changed num_retries default for resumable downloads to 6.
- Don’t check for newer software version if gs_host is specified in boto
config file.
- Modified oauth2client logging behavior to be consistent with gsutil.
- Added gs_port configuration option.
- Skip update tests when SSL is disabled.

=======================================

New Features
------------

- Added a human readable option (-h) to ls command.
- Changed WildcardIterator not to materialize list of all matching files from
directory listing (so works faster when walking over large directories)
- Added -f option to setacl command to allow command to continue after errors
encountered.
- Add manifest log support for the cp command.
- Added never option for check_hashes_config; fixed bug that assumes an ETag
is always returned from server.
- Made gsutil provide friendlier error message if attempting non-public data
access with missing credentials.
- Set 70 second default socket timeout for httplib.
- Add ability to run a single test class or function with the test command.

Bug Fixes
---------

- Don't check for updates if the user has no credentials configured. This
fixes a bug for users without credentials trying to use gsutil for first
time.
- Fixed case where chacl command incorrectly recognized an email address as a
domain.
- Fix setmeta command for S3 objects.
- Fixed bug where wildcarded dest URI attempted string op on Key object.
- Fixed case where gsutil -q outputted progress output when doing a streaming
upload.
- Error handling for out of space during downloads.
- Include ISO 8601-required "Z" at end of timestamp string for gsutil ls -l,
to be spec-compliant.
- Removed deprecated setmeta syntax and fixed unicode issues.
- Changed update command not to suggest running sudo if running under Cygwin.
- Removed references to deprecated gs-discussion forum from gsutil built-in
help.
- Add literal quotes around CORS config example URL in gsutil setcors help to
avoid having example URL turn into an HREF in auto-generated doc.

Other Changes
-------------

- Added proper setup.py to make gsutil installable via PyPi.
- Added warning to gsutil built-in help that delete operations cannot be
undone.
- Replaced gsutil's OAuth2 client implementation with oauth2client.
- Updates to perfdiag.
- Updated config help about currently supported settings.
- Fixes to setup.py and modified version command.
- Move gslib/commands/cred_types.py to gslib, so only Command subclasses live
in gslib/commands.
- Updated gsutil setmeta help no longer to warn that setmeta with versioning
enabled creates a new object.

=======================================

New Features
------------

- Added support for object composition.
- Added support for external service accounts.
- Changed gsutil to check for available updates periodically (only while
stdin, stderr, stdout are connected to a TTY, so as not to interfere with
cron jobs).
- Added chdefacl command.
- Made gsutil built-in help available under
https://developers.google.com/storage/docs/gsutil
- Add a command suggestion when the command name is not found.
- Added byte suffix parsing to the -s parameter of perfdiag.
- Added --help support to subcommands. Fixes 96.
- Updated perfdiag command to track availability and record TCP settings.
- Added metadata parameter to perfdiag command.
- Added support for specifying byte range to cat command.
- Output more bucket metadata on ls -Lb.
- Implemented gsutil -q (global quiet) option (fixes issue 130). Also changed
gsutil to output all progress indicators using logging levels. Also changed
help command not to output bold escape sequences and not use PAGER if stdout
is not a tty, which also fixes bug that caused gsutil help test to fail.
- Plumbed https_validate_certificates through to OAuth2 plugin handler,
allowing control over cert validation for OAuth2 requests
- Fixed ISO 639.1 ref in config command help text

Bug Fixes
---------

- Fixed bug where gsutil cp -D didn't preserve metadata
- Fixed problem where gsutil -m is hard to interrupt (partial fix for issue
99 - only for Linux/MacOS; problem still exists for Windows).
- Fixed broken reference to boto_lib_dir in update command.
- Made changing ACL not retry on 400 error.
- Fixed name expansion bug for case where uri_strs is itself an iterator
(issue 131); implemented additional naming unit test for this case.
- Fixed flaky gsutil rm test
- Fixed a bug in the chacl command that made it so you couldn't delete the
AllAuthenticatedUsers group from an ACL.

Other Changes
-------------

- Refactored gsutil main function into gslib, with gsutil being a thin
wrapper.
- Added a test for the update command.
- Renamed gsutil meta_generation params to metageneration, for consistency
with GCS docs.
- Removed .pyc files from tarball/zipfile.
- Added new root certs to cacerts.txt, to provide additional flexibility
in the future.

=======================================

Bug Fixes
---------

- Fixed two version-specific URI bugs:
1. gsutil cp -r gs://bucket1 gs://bucket2 would create objects in bucket2
with names corresponding to version-specific URIs in bucket1 (e.g.,
gs://bucket2/obj1361417568482000, where the "1361417568482000" part was
part of the object name, not the object's generation).

This problem similarly caused gsutil cp -r gs://bucket1 ./dir to create
files names corresponding to version-specific URIs in bucket1.
2. gsutil rm -a gs://bucket/obj would attempt to delete the same object
twice, getting a NoSuchKey error on the second attempt.

=======================================

Bug Fixes
---------

- Fixed bug that caused attempt to dupe-encode a unicode filename.

Other Changes
-------------

- Refactored retry logic from setmeta and chacl to use Retry decorator.
- Moved Retry decorator to third_party.
- Fixed flaky tests.

=======================================

Bug Fixes
---------

- Make version-specific URI parsing more robust. This fixes a bug where
listing buckets in certain cases would result in the error
'BucketStorageUri' object has no attribute 'version_specific_uri'