Datalad

Latest version: v1.0.2

Safety actively analyzes 629678 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 15

0.18.3

๐Ÿ› Bug Fixes

- Fixed that the `get` command would fail, when subdataset source-candidate-templates where using the `path` property from `.gitmodules`.
Also enhance the respective documentation for the `get` command.
Fixes [7274](https://github.com/datalad/datalad/issues/7274) via
[PR 7280](https://github.com/datalad/datalad/pull/7280)
(by [bpoldrack](https://github.com/bpoldrack))

- Improve up-to-dateness of config reports across manager instances. Fixes [7299](https://github.com/datalad/datalad/issues/7299) via [PR #7301](https://github.com/datalad/datalad/pull/7301) (by [mih](https://github.com/mih))

- BF: GitRepo.merge do not allow merging unrelated unconditionally. [PR 7312](https://github.com/datalad/datalad/pull/7312) (by [yarikoptic](https://github.com/yarikoptic))

- Do not render (empty) WTF report on other records. [PR 7322](https://github.com/datalad/datalad/pull/7322) (by [yarikoptic](https://github.com/yarikoptic))

- Fixed a bug where changing DataLad's log level could lead to failing git-annex calls.
Fixes [7328](https://github.com/datalad/datalad/issues/7328) via
[PR 7329](https://github.com/datalad/datalad/pull/7329)
(by [bpoldrack](https://github.com/bpoldrack))

- Fix an issue with uninformative error reporting by the datalad special remote.
Fixes [7332](https://github.com/datalad/datalad/issues/7332) via
[PR 7333](https://github.com/datalad/datalad/pull/7333)
(by [bpoldrack](https://github.com/bpoldrack))

- Fix save to not force committing into git if reference dataset is pure git (not git-annex). Fixes [7351](https://github.com/datalad/datalad/issues/7351) via [PR #7355](https://github.com/datalad/datalad/pull/7355) (by [yarikoptic](https://github.com/yarikoptic))

๐Ÿ“ Documentation

- Include a few previously missing commands in html API docs.
Fixes [7288](https://github.com/datalad/datalad/issues/7288) via
[PR 7289](https://github.com/datalad/datalad/pull/7289)
(by [mslw](https://github.com/mslw))

๐Ÿ  Internal

- Type-annotate almost all of `datalad/utils.py`; add `datalad/typing.py`. [PR 7317](https://github.com/datalad/datalad/pull/7317) (by [jwodder](https://github.com/jwodder))

- Type-annotate and fix `datalad/support/strings.py`. [PR 7318](https://github.com/datalad/datalad/pull/7318) (by [jwodder](https://github.com/jwodder))

- Type-annotate `datalad/support/globbedpaths.py`. [PR 7327](https://github.com/datalad/datalad/pull/7327) (by [jwodder](https://github.com/jwodder))

- Extend type-annotations for `datalad/support/path.py`. [PR 7336](https://github.com/datalad/datalad/pull/7336) (by [jwodder](https://github.com/jwodder))

- Type-annotate various things in `datalad/runner/`. [PR 7337](https://github.com/datalad/datalad/pull/7337) (by [jwodder](https://github.com/jwodder))

- Type-annotate some more files in `datalad/support/`. [PR 7339](https://github.com/datalad/datalad/pull/7339) (by [jwodder](https://github.com/jwodder))

๐Ÿงช Tests

- Skip or xfail some currently failing or stalling tests. [PR 7331](https://github.com/datalad/datalad/pull/7331) (by [yarikoptic](https://github.com/yarikoptic))

- Skip with_sameas_remote when rsync and annex are incompatible. Fixes [7320](https://github.com/datalad/datalad/issues/7320) via [PR #7342](https://github.com/datalad/datalad/pull/7342) (by [bpoldrack](https://github.com/bpoldrack))

- Fix testing assumption - do create pure GitRepo superdataset and test against it. [PR 7353](https://github.com/datalad/datalad/pull/7353) (by [yarikoptic](https://github.com/yarikoptic))

<a id='changelog-0.18.2'></a>

0.18.2

๐Ÿ› Bug Fixes

- Fix `create-sibling` for non-English SSH remotes by providing `LC_ALL=C` for the `ls` call. [PR 7265](https://github.com/datalad/datalad/pull/7265) (by [nobodyinperson](https://github.com/nobodyinperson))

- Fix EnsureListOf() and EnsureTupleOf() for string inputs. [PR 7267](https://github.com/datalad/datalad/pull/7267) (by [nobodyinperson](https://github.com/nobodyinperson))

- create-sibling: Use C.UTF-8 locale instead of C on the remote end. [PR 7273](https://github.com/datalad/datalad/pull/7273) (by [nobodyinperson](https://github.com/nobodyinperson))

- Address compatibility with most recent git-annex where info would exit with non-0. [PR 7292](https://github.com/datalad/datalad/pull/7292) (by [yarikoptic](https://github.com/yarikoptic))

๐Ÿ”ฉ Dependencies

- Revert "Revert "Remove chardet version upper limit"". [PR 7263](https://github.com/datalad/datalad/pull/7263) (by [yarikoptic](https://github.com/yarikoptic))

๐Ÿ  Internal

- Codespell more (CHANGELOGs etc) and remove custom CLI options from tox.ini. [PR 7271](https://github.com/datalad/datalad/pull/7271) (by [yarikoptic](https://github.com/yarikoptic))

๐Ÿงช Tests

- Use older python 3.8 in testing nose utils in github-action test-nose. Fixes [7259](https://github.com/datalad/datalad/issues/7259) via [PR #7260](https://github.com/datalad/datalad/pull/7260) (by [yarikoptic](https://github.com/yarikoptic))

<a id='changelog-0.18.1'></a>

0.18.1

๐Ÿ› Bug Fixes

- Fixes crashes on windows where DataLad was mistaking git-annex 10.20221212 for
a not yet released git-annex version and trying to use a new feature.
Fixes [7248](https://github.com/datalad/datalad/issues/7248) via
[PR 7249](https://github.com/datalad/datalad/pull/7249)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿ“ Documentation

- DOC: fix EnsureCallable docstring. [PR 7245](https://github.com/datalad/datalad/pull/7245) (by [matrss](https://github.com/matrss))

๐ŸŽ Performance

- Integrate buffer size optimization from datalad-next, leading to significant
performance improvement for status and diff.
Fixes [7190](https://github.com/datalad/datalad/issues/7190) via
[PR 7250](https://github.com/datalad/datalad/pull/7250)
(by [bpoldrack](https://github.com/bpoldrack))

<a id='changelog-0.18.0'></a>

0.18.0

๐Ÿ’ฅ Breaking Changes

- Move all old-style metadata commands `aggregate_metadata`, `search`, `metadata` and `extract-metadata`, as well as the `cfg_metadatatypes` procedure and the old metadata extractors into the datalad-deprecated extension.
Now recommended way of handling metadata is to install the datalad-metalad extension instead.
Fixes [7012](https://github.com/datalad/datalad/issues/7012) via
[PR 7014](https://github.com/datalad/datalad/pull/7014)

- Automatic reconfiguration of the ORA special remote when cloning from RIA
stores now only applies locally rather than being committed.
[PR 7235](https://github.com/datalad/datalad/pull/7235)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿš€ Enhancements and New Features

- A repository description can be specified with a new `--description`
option when creating siblings using `create-sibling-[gin|gitea|github|gogs]`.
Fixes [6816](https://github.com/datalad/datalad/issues/6816)
via [PR 7109](https://github.com/datalad/datalad/pull/7109)
(by [mslw](https://github.com/mslw))

- Make validation failure of alternative constraints more informative.
Fixes [7092](https://github.com/datalad/datalad/issues/7092) via
[PR 7132](https://github.com/datalad/datalad/pull/7132)
(by [bpoldrack](https://github.com/bpoldrack))

- Saving removed dataset content was sped-up, and reporting of types of removed
content now accurately states `dataset` for added and removed subdatasets,
instead of `file`. Moreover, saving previously staged deletions is now also
reported.
[PR 6784](https://github.com/datalad/datalad/pull/6784) (by [mih](https://github.com/mih))

- `foreach-dataset` command got a new possible value for the --output-streamns|--o-s
option 'relpath' to capture and pass-through prefixing with path to subds. Very
handy for e.g. running `git grep` command across subdatasets.
[PR 7071](https://github.com/datalad/datalad/pull/7071)
(by [yarikoptic](https://github.com/yarikoptic))

- New config `datalad.create-sibling-ghlike.extra-remote-settings.NETLOC.KEY=VALUE` allows to add and/or overwrite local configuration for the created sibling by the commands `create-sibling-<gin|gitea|github|gitlab|gogs>`. [PR 7213](https://github.com/datalad/datalad/pull/7213) (by [matrss](https://github.com/matrss))

- The `siblings` command does not concern the user with messages about
inconsequential failure to annex-enable a remote anymore.
[PR 7217](https://github.com/datalad/datalad/pull/7217)
(by [bpoldrack](https://github.com/bpoldrack))

- ORA special remote now allows to override its configuration locally.
[PR 7235](https://github.com/datalad/datalad/pull/7235)
(by [bpoldrack](https://github.com/bpoldrack))
- Added a 'ria' special remote to provide backwards compatibility with datasets
that were set up with the deprecated [ria-remote](https://github.com/datalad/git-annex-ria-remote).
[PR 7235](https://github.com/datalad/datalad/pull/7235)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿ› Bug Fixes

- When ``create-sibling-ria`` was invoked with a sibling name of a pre-existing sibling, a duplicate key in the result record caused a crashed.
Fixes [6950](https://github.com/datalad/datalad/issues/6950) via
[PR 6952](https://github.com/datalad/datalad/pull/6952) (by [adswa](https://api.github.com/users/adswa))

๐Ÿ“ Documentation

- create-sibling-ria's docstring now defines the schema of RIA URLs and clarifies internal layout of a RIA store.
[PR 6861](https://github.com/datalad/datalad/pull/6861) (by [adswa](https://api.github.com/users/adswa))

- Move maintenance team info from issue to CONTRIBUTING.
[PR 6904](https://github.com/datalad/datalad/pull/6904) (by [adswa](https://api.github.com/users/adswa))

- Describe specifications for a DataLad GitHub Action.
[PR 6931](https://github.com/datalad/datalad/pull/6931) (by [thewtex](https://api.github.com/users/thewtex))

- Fix capitalization of some service names.
[PR 6936](https://github.com/datalad/datalad/pull/6936) (by [aqw](https://api.github.com/users/aqw))

- Command categories in help text are more consistently named.
[PR 7027](https://github.com/datalad/datalad/pull/7027) (by [aqw](https://api.github.com/users/aqw))

- DOC: Add design document on Tests and CI. [PR 7195](https://github.com/datalad/datalad/pull/7195) (by [adswa](https://github.com/adswa))

- CONTRIBUTING.md was extended with up-to-date information on CI logging, changelog and release procedures. [PR 7204](https://github.com/datalad/datalad/pull/7204) (by [yarikoptic](https://github.com/yarikoptic))

๐Ÿ  Internal

- Allow EnsureDataset constraint to handle Path instances.
Fixes [7069](https://github.com/datalad/datalad/issues/7069) via
[PR 7133](https://github.com/datalad/datalad/pull/7133)
(by [bpoldrack](https://github.com/bpoldrack))

- Use `looseversion.LooseVersion` as drop-in replacement for `distutils.version.LooseVersion`
Fixes [6307](https://github.com/datalad/datalad/issues/6307) via
[PR 6839](https://github.com/datalad/datalad/pull/6839)
(by [effigies](https://api.github.com/users/effigies))

- Use --pathspec-from-file where possible instead of passing long lists of paths to git/git-annex calls.
Fixes [6922](https://github.com/datalad/datalad/issues/6922) via
[PR 6932](https://github.com/datalad/datalad/pull/6932) (by [yarikoptic](https://api.github.com/users/yarikoptic))

- Make clone_dataset() better patchable ny extensions and less monolithic.
[PR 7017](https://github.com/datalad/datalad/pull/7017) (by [mih](https://api.github.com/users/mih))

- Remove `simplejson` in favor of using `json`.
Fixes [7034](https://github.com/datalad/datalad/issues/7034) via
[PR 7035](https://github.com/datalad/datalad/pull/7035) (by [christian-monch](https://api.github.com/users/christian-monch))

- Fix an error in the command group names-test.
[PR 7044](https://github.com/datalad/datalad/pull/7044) (by [christian-monch](https://api.github.com/users/christian-monch))

- Move eval_results() into interface.base to simplify imports for command implementations. Deprecate use from interface.utils accordingly. Fixes [6694](https://github.com/datalad/datalad/issues/6694) via [PR #7170](https://github.com/datalad/datalad/pull/7170) (by [adswa](https://github.com/adswa))

๐ŸŽ Performance

- Use regular dicts instead of OrderedDicts for speedier operations. Fixes [6566](https://github.com/datalad/datalad/issues/6566) via [PR #7174](https://github.com/datalad/datalad/pull/7174) (by [adswa](https://github.com/adswa))

- Reimplement `get_submodules_()` without `get_content_info()` for substantial performance boosts especially for large datasets with few subdatasets. Originally proposed in [PR 6942](https://github.com/datalad/datalad/pull/6942) by [mih](https://github.com/mih), fixing [#6940](https://github.com/datalad/datalad/issues/6940). [PR #7189](https://github.com/datalad/datalad/pull/7189) (by [adswa](https://github.com/adswa)). Complemented with [PR #7220](https://github.com/datalad/datalad/pull/7220) (by [yarikoptic](https://github.com/yarikoptic)) to avoid `O(N^2)` (instead of `O(N*log(N))` performance in some cases.

- Use --include=* or --anything instead of --copies 0 to speed up get_content_annexinfo. [PR 7230](https://github.com/datalad/datalad/pull/7230) (by [yarikoptic](https://github.com/yarikoptic))

๐Ÿงช Tests

- Re-enable two now-passing core test on Windows CI.
[PR 7152](https://github.com/datalad/datalad/pull/7152) (by [adswa](https://api.github.com/users/adswa))

- Remove the `with_testrepos` decorator and associated tests for it
Fixes [6752](https://github.com/datalad/datalad/issues/6752) via
[PR 7176](https://github.com/datalad/datalad/pull/7176) (by [adswa](https://api.github.com/users/adswa))

<a id='changelog-0.17.10'></a>

0.17.10

๐Ÿš€ Enhancements and New Features

- Enhance concurrent invocation behavior of `ThreadedRunner.run()`. If possible invocations are serialized instead of raising *re-enter* runtime errors. Deadlock situations are detected and runtime errors are raised instead of deadlocking.
Fixes [7138](https://github.com/datalad/datalad/issues/7138) via
[PR 7201](https://github.com/datalad/datalad/pull/7201)
(by [christian-monch](https://github.com/christian-monch))

- Exceptions bubbling up through CLI are now reported on including their chain
of __cause__.
Fixes [7163](https://github.com/datalad/datalad/issues/7163) via
[PR 7210](https://github.com/datalad/datalad/pull/7210)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿ› Bug Fixes

- BF: read RIA config from stdin instead of temporary file. Fixes [6514](https://github.com/datalad/datalad/issues/6514) via [PR #7147](https://github.com/datalad/datalad/pull/7147) (by [adswa](https://github.com/adswa))

- Prevent doomed annex calls on files we already know are untracked. Fixes [7032](https://github.com/datalad/datalad/issues/7032) via [PR #7166](https://github.com/datalad/datalad/pull/7166) (by [adswa](https://github.com/adswa))

- Comply to Posix-like clone URL formats on Windows. Fixes [7180](https://github.com/datalad/datalad/issues/7180) via [PR #7181](https://github.com/datalad/datalad/pull/7181) (by [adswa](https://github.com/adswa))

- Ensure that paths used in the datalad-url field of .gitmodules are posix. Fixes [7182](https://github.com/datalad/datalad/issues/7182) via [PR #7183](https://github.com/datalad/datalad/pull/7183) (by [adswa](https://github.com/adswa))

- Bandaids for export-to-figshare to restore functionality. [PR 7188](https://github.com/datalad/datalad/pull/7188) (by [adswa](https://github.com/adswa))

- Fixes hanging threads when `close()` or `del` where called in `BatchedCommand` instances. That could lead to hanging tests if the tests used the `serve_path_via_http()`-decorator
Fixes [6804](https://github.com/datalad/datalad/issues/6804) via
[PR 7201](https://github.com/datalad/datalad/pull/7201)
(by [christian-monch](https://github.com/christian-monch))

- Interpret file-URL path components according to the local operating system as described in RFC 8089. With this fix, `datalad.network.RI('file:...').localpath` returns a correct local path on Windows if the RI is constructed with a file-URL.
Fixes [7186](https://github.com/datalad/datalad/issues/7186) via
[PR 7206](https://github.com/datalad/datalad/pull/7206)
(by [christian-monch](https://github.com/christian-monch))

- Fix a bug when retrieving several files from a RIA store via SSH, when the annex key does not contain size information. Fixes [7214](https://github.com/datalad/datalad/issues/7214) via [PR #7215](https://github.com/datalad/datalad/pull/7215) (by [mslw](https://github.com/mslw))

- Interface-specific (python vs CLI) doc generation for commands and their parameters was broken when brackets were used within the interface markups.
Fixes [7225](https://github.com/datalad/datalad/issues/7225) via
[PR 7226](https://github.com/datalad/datalad/pull/7226)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿ“ Documentation

- Fix documentation of `Runner.run()` to not accept strings. Instead, encoding
must be ensured by the caller.
Fixes [7145](https://github.com/datalad/datalad/issues/7145) via
[PR 7155](https://github.com/datalad/datalad/pull/7155)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿ  Internal

- Fix import of the `ls` command from datalad-deprecated for benchmarks.
Fixes [7149](https://github.com/datalad/datalad/issues/7149) via
[PR 7154](https://github.com/datalad/datalad/pull/7154)
(by [bpoldrack](https://github.com/bpoldrack))

- Unify definition of parameter choices with `datalad clean`.
Fixes [7026](https://github.com/datalad/datalad/issues/7026) via
[PR 7161](https://github.com/datalad/datalad/pull/7161)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿงช Tests

- Fix test failure with old annex. Fixes [7157](https://github.com/datalad/datalad/issues/7157) via [PR #7159](https://github.com/datalad/datalad/pull/7159) (by [bpoldrack](https://github.com/bpoldrack))

- Re-enable now passing test_path_diff test on Windows. Fixes [3725](https://github.com/datalad/datalad/issues/3725) via [PR #7194](https://github.com/datalad/datalad/pull/7194) (by [yarikoptic](https://github.com/yarikoptic))

- Use Plaintext keyring backend in tests to avoid the need for (interactive)
authentication to unlock the keyring during (CI-) test runs.
Fixes [6623](https://github.com/datalad/datalad/issues/6623) via
[PR 7209](https://github.com/datalad/datalad/pull/7209)
(by [bpoldrack](https://github.com/bpoldrack))

<a id='changelog-0.17.9'></a>

0.17.9

๐Ÿ› Bug Fixes

- Various small fixups ran after looking post-release and trying to build Debian package. [PR 7112](https://github.com/datalad/datalad/pull/7112) (by [yarikoptic](https://github.com/yarikoptic))

- BF: Fix add-archive-contents try-finally statement by defining variable earlier. [PR 7117](https://github.com/datalad/datalad/pull/7117) (by [adswa](https://github.com/adswa))

- Fix RIA file URL reporting in exception handling. [PR 7123](https://github.com/datalad/datalad/pull/7123) (by [adswa](https://github.com/adswa))

- HTTP download treated '429 - too many requests' as an authentication issue and
was consequently trying to obtain credentials.
Fixes [7129](https://github.com/datalad/datalad/issues/7129) via
[PR 7129](https://github.com/datalad/datalad/pull/7129)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿ”ฉ Dependencies

- Unrestrict pytest and pytest-cov versions. [PR 7125](https://github.com/datalad/datalad/pull/7125) (by [jwodder](https://github.com/jwodder))

- Remove remaining references to `nose` and the implied requirement for building the documentation
Fixes [7100](https://github.com/datalad/datalad/issues/7100) via
[PR 7136](https://github.com/datalad/datalad/pull/7136)
(by [bpoldrack](https://github.com/bpoldrack))

๐Ÿ  Internal

- Use datalad/release-action. Fixes [7110](https://github.com/datalad/datalad/issues/7110). [PR #7111](https://github.com/datalad/datalad/pull/7111) (by [jwodder](https://github.com/jwodder))

- Fix all logging to use %-interpolation and not .format, sort imports in touched files, add pylint-ing for % formatting in log messages to `tox -e lint`. [PR 7118](https://github.com/datalad/datalad/pull/7118) (by [yarikoptic](https://github.com/yarikoptic))

๐Ÿงช Tests

- Increase the upper time limit after which we assume that a process is stalling.
That should reduce false positives from `datalad.support.tests.test_parallel.py::test_stalling`,
without impacting the runtime of passing tests.
[PR 7119](https://github.com/datalad/datalad/pull/7119)
(by [christian-monch](https://github.com/christian-monch))

- XFAIL a check on length of results in test_gracefull_death. [PR 7126](https://github.com/datalad/datalad/pull/7126) (by [yarikoptic](https://github.com/yarikoptic))

- Configure Git to allow for "file" protocol in tests. [PR 7130](https://github.com/datalad/datalad/pull/7130) (by [yarikoptic](https://github.com/yarikoptic))

<a id='changelog-0.17.8'></a>

Page 3 of 15

ยฉ 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.