Datalad

Requires now GitPython >= 2.1.0

Fixes

- [save][]
- to not save staged files if explicit paths were provided
- improved (but not yet complete) support for direct mode
- [update][] to not crash if some sub-datasets are not installed
- do not log calls to `git config` to avoid leakage of possibly
sensitive settings to the logs

Enhancements and new features

- New [rfc822-compliant metadata][] format
- [save][]
- -S to save the change also within all super-datasets
- [add][] now has progress-bar reporting
- [create-sibling-github][] to create a :term:`sibling` of a dataset on
github
- [OpenfMRI][] crawler and datasets were enriched with URLs to separate
files where also available from openfmri s3 bucket
(if upgrading your datalad datasets, you might need to run
`git annex enableremote datalad` to make them available)
- various enhancements to log messages
- web interface
- populates "install" box first thus making UX better over slower
connections

Primarily it is a bugfix release but because of significant refactoring
of the [install][] and [get][] implementation, it gets a new minor release.

Fixes

- be able to [get][] or [install][] while providing paths while being
outside of a dataset
- remote annex datasets get properly initialized
- robust detection of outdated [git-annex][]

Enhancements and new features

- interface changes
- [get][] `--recursion-limit=existing` to not recurse into not-installed
subdatasets
- [get][] `-n` to possibly install sub-datasets without getting any data
- [install][] `--jobs|-J` to specify number of parallel jobs for annex
[get][] call could use (ATM would not work when data comes from archives)
- more (unit-)testing
- documentation: see http://docs.datalad.org/en/latest/basics.html
for basic principles and useful shortcuts in referring to datasets
- various webface improvements: breadcrumb paths, instructions how
to install dataset, show version from the tags, etc.

Primarily bugfixes but also a number of enhancements and core
refactorings

Fixes

- do not build manpages and examples during installation to avoid
problems with possibly previously outdated dependencies
- [install][] can be called on already installed dataset (with `-r` or
`-g`)

Enhancements and new features

- complete overhaul of datalad configuration settings handling
(see [Configuration documentation][]), so majority of the environment.
Now uses git format and stores persistent configuration settings under
`.datalad/config` and local within `.git/config`
variables we have used were renamed to match configuration names
- [create-sibling][] does not now by default upload web front-end
- [export][] command with a plug-in interface and `tarball` plugin to export
datasets
- in Python, `.api` functions with rendering of results in command line
got a _-suffixed sibling, which would render results as well in Python
as well (e.g., using `search_` instead of `search` would also render
results, not only output them back as Python objects)
- [get][]
- `--jobs` option (passed to `annex get`) for parallel downloads
- total and per-download (with git-annex >= 6.20160923) progress bars
(note that if content is to be obtained from an archive, no progress
will be reported yet)
- [install][] `--reckless` mode option
- [search][]
- highlights locations and fieldmaps for better readability
- supports `-d^` or `-d///` to point to top-most or centrally
installed meta-datasets
- "complete" paths to the datasets are reported now
- `-s` option to specify which fields (only) to search
- various enhancements and small fixes to [meta-data][] handling, [ls][],
custom remotes, code-base formatting, downloaders, etc
- completely switched to `tqdm` library (`progressbar` is no longer
used/supported)

Lots of everything, including but not limited to

- enhanced index viewer, as the one on http://datasets.datalad.org
- initial new data providers support: [Kaggle][], [BALSA][], [NDA][], [NITRC][]
- initial [meta-data support and management][]
- new and/or improved crawler pipelines for [BALSA][], [CRCNS][], [OpenfMRI][]
- refactored [install][] command, now with separate [get][]
- some other commands renaming/refactoring (e.g., [create-sibling][])
- datalad [search][] would give you an option to install datalad's
super-dataset under ~/datalad if ran outside of a dataset

New features and bugfix release

- support of /// urls to point to http://datasets.datalad.org
- variety of fixes and enhancements throughout

New feature and bugfix release

- greately improved documentation
- publish command API RFing allows for custom options to annex, and uses
--to REMOTE for consistent with annex invocation
- variety of fixes and enhancements throughout