Dvc

> Refer to https://dvc.org/doc/install for installation instructions.

Changes

💣 Breaking Changes

- exp diff: Remove `--old` option. (6888) daavoo

🚀 New Features and Enhancements

- introduces `exp init` command skshetry
- render: image: make html less ugly (7075) pared
- plots: collect: provide callable for data resolution (6832) pared
- live: Call webbrowser.open (6913) daavoo
- scm: hint to autostage (6985) dberenbaum
- exp show: Add `--only-changed` option (6867) daavoo

🐛 Bug Fixes

- exp: respect repo `hardlink_lock` config for the exp scm lock (7030) kwon-young
- dulwich: fallback to default SSH keys in asyncssh vendor (6983) pmrowla
- plots: special chars handling for vega plots paths (6900) pared
- params: Use `ast.literal_eval` for python params. (6954) daavoo
- push: fix http storage ignoring method setting (6981) ditod
- hardlink: fallback to other link methods if "Function not implemented" is raised (6963) skshetry
- argparse: dont override cmd (6958) pared

🔨 Maintenance

- build(deps): Bump scmrepo from 0.0.1 to 0.0.2 (7055) dependabot
- packages: build binary pkgs with Python 3.9 (7016) skshetry
- dvc.scm: refactor exceptions (7017) skshetry
- build(deps): Bump adlfs from 2021.9.1 to 2021.10.0 (6734) dependabot
- build: bump sshfs from 2021.8.1 to 2021.11.2 (6999) guludo
- build: bump pyinstaller from 4.6 to 4.7 (6960) dependabot
- dvc: get rid of path_info (6946) efiop

Thanks again to daavoo, dberenbaum, dependabot, dependabot[bot], ditod, efiop, guludo, isidentical, karajan1001, kwon-young, pared, pmrowla, pre-commit-ci, pre-commit-ci[bot], skshetry and Dimitar Todorov for the contributions! 🎉

> Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

- machine status: include two new field in the output (6869) karajan1001
- exp init: ask for command before paths (6872) skshetry
- LiveTask: write output path at start/end (6815) daavoo
- transfer: preserve workspace data (6860) efiop
- exp run: add experiment name check. (6848) karajan1001
- fs: transfer: try reflink (6853) efiop

🏇 Optimizations

- output: save: remove redundant changed() call (6887) efiop
- fs: transfer: try reflink (6853) efiop

🐛 Bug Fixes

- webhdfs: expose kerberos and https options (6936) gudmundur-heimisson
- plots: fix resolve template path bug (6866) pared
- plots: Use URI for `--open`. (6845) daavoo
- transfer: preserve workspace data (6860) efiop

🔨 Maintenance

- build(deps-dev): bump gcsfs from 2021.10.1 to 2021.11.0 (6938) dependabot
- deps: bump rich to >=10.13.0 (6937) skshetry
- build(deps): bump actions/checkout from 2.3.5 to 2.4.0 (6921) dependabot
- build: remove numpy restriction (6906) skshetry
- build(deps): bump pyinstaller from 4.5.1 to 4.6 (6897) dependabot
- dependencies: remove python 3.10 restriction for pyarrow (6901) skshetry
- build(deps): update pyparsing requirement from ==2.4.7 to >=2.4.7 (6858) dependabot

Thanks again to daavoo, dberenbaum, dependabot, dependabot[bot], efiop, gudmundur-heimisson, karajan1001, pared, pmrowla, pre-commit-ci, pre-commit-ci[bot] and skshetry for the contributions! 🎉

> Refer to https://dvc.org/doc/install for installation instructions.

Changes

- git: use asyncssh as dulwich SSH vendor (6797) pmrowla
- Dependabot/pip/pylint 2.11.1 (6843) karajan1001
- Revert "build(deps): Bump pylint from 2.9.6 to 2.11.1" (6842) karajan1001
- `dvc machine`: add a new command `rename` to it (6633) karajan1001
- Exp show md (6799) daavoo
- machine: Add a new command `dvc machine status` (6649) karajan1001
- exp/metrics/params diff: Replaced `Old/New` with `a_rev/b_rev` (6814) daavoo
- [pre-commit.ci] pre-commit autoupdate (6829) pre-commit-ci
- Added `test_show_experiments_sort_by` (6798) daavoo

🚀 New Features and Enhancements

- exp run: throw error if new parameters are added by --set-param (6521) mattlbeck
- plots: make generator out of collect (6793) pared
- plots: load templates from package (6550) pared

🐛 Bug Fixes

- dvcfs: handle new workspace subdirectories in walk (6811) eggqq007
- ui: write_json: don't forget json kwargs (6810) efiop
- dvc: add 'repos' list to pre-commit config if it does not exist (6795) mjlbach

🔨 Maintenance

- build(deps): Bump pylint from 2.9.6 to 2.11.1 (6636) dependabot
- move some configs to pyproject.toml (6834) skshetry
- setup: bump fsspec deps to 2021.10.1 (6828) efiop
- Revert "webdav: limit httpx to fix the CI" (6827) skshetry
- build(deps-dev): Bump filelock from 3.3.0 to 3.3.1 (6825) dependabot
- build(deps-dev): Bump types-requests from 2.25.9 to 2.25.11 (6820) dependabot
- build(deps): Bump actions/checkout from 2.3.4 to 2.3.5 (6817) dependabot
- build(deps-dev): Bump types-tabulate from 0.8.2 to 0.8.3 (6790) dependabot
- build(deps-dev): Bump types-toml from 0.10.0 to 0.10.1 (6821) dependabot
- build(deps-dev): Bump dvclive from 0.4.0 to 0.4.1 (6786) dependabot
- build(deps): Update flufl-lock requirement from <4,>=3.2 to >=5 (6576) dependabot
- pathspec 0.9.0 quickfix (6689) endremborza
- webdav: limit httpx to fix the CI (6800) isidentical
- dvc: drop 3.6 support (6792) efiop
- use setuptools_scm and build_requires (6775) skshetry

Thanks again to daavoo, dependabot, dependabot[bot], efiop, eggqq007, endremborza, isidentical, karajan1001, mattlbeck, mjlbach, pared, pmrowla, pre-commit-ci, pre-commit-ci[bot] and skshetry for the contributions! 🎉

> Refer to https://dvc.org/doc/install for installation instructions.

Maintenance

* setup.cfg: use text/x-rst instead of text/rst

> Refer to https://dvc.org/doc/install for installation instructions.

🚀 New Features and Enhancements

- Fix exp show --sort-by issue 6675 (6764) eggqq007
- webhdfs: migrate to fsspec (6662) isidentical
- hdfs: migrate to fsspec (6604) isidentical
- command: Should not consume 'print' to output default remote info (6650) eggqq007
- command: output prettify json in tty (6743) eggqq007
- Run on Python3.10 (6745) skshetry
- http: explicitly retry all http-related errors (6728) isidentical
- exp init: introduce `--with={default,live}` flag (6716) skshetry
- cli: add short alias for --show-{csv,json,md} (6711) skshetry
- command: Show dvc list output in pretty JSON format (6647) eggqq007
- exp init: show heading based on the presence of dvc.yaml file (6701) skshetry
- exp init: support interactive and explicit options (6681) skshetry
- better exception messages for schema errors (6679) skshetry
- ui: support pager universally (6692) skshetry
- add alias ls for dvc list (6683) ap-kulkarni
- remote: add support for Amazon S3 timeout configuration (6634) whysage
- merge yaml parsing and schema validation into one, aka strictyaml.load (6661) skshetry
- exceptional exceptions (6654) skshetry
- Allow user to specify different state and index tmp dir locations (6419) nueschs

🐛 Bug Fixes

- Fix exp show --sort-by issue 6675 (6764) eggqq007
- gs: use 3-char prefixes (6759) isidentical
- Fix dvclive running subdir (6740) daavoo
- build(setup): avoid leaking tests package into site-packages (6585) pwoolvett
- doctor: fixes unknown cache directory error on some windows mapped network shares (6364) anasitomtn
- http: allow reading proxies from the current environment (6688) isidentical
- ssh: fix path normalization on windows (6517) isidentical
- ssh: bundle bcrypt by default (6678) isidentical
- fix dvc[all] (6657) casperdcl
- progress: do not block on async filesystems (6612) isidentical

🔨 Maintenance

- hdfs: enable mocked hdfs tests by default (6766) isidentical
- advertise Python 3.10 support (6772) skshetry
- build(deps): Bump filelock from 3.2.0 to 3.3.0 (6737) dependabot
- build(deps-dev): Bump types-requests from 2.25.6 to 2.25.9 (6770) dependabot
- build(deps-dev): Bump types-paramiko from 0.1.9 to 2.7.1 (6769) dependabot
- build(deps-dev): Bump types-toml from 0.1.5 to 0.10.0 (6768) dependabot
- build(deps): Bump dvclive from 0.3.0 to 0.4.0 (6753) dependabot
- build(deps): Bump jaraco-windows from 5.6.0 to 5.7.0 (6735) dependabot
- build(deps): Bump pytest-cov from 2.12.1 to 3.0.0 (6736) dependabot
- Bump typing_extensions to >=3.7.4 (6732) gcoter
- setup: bump fsspec/s3fs/gcsfs (6727) isidentical
- build(deps): Bump google-cloud-storage from 1.42.2 to 1.42.3 (6722) dependabot
- build(deps): Bump filelock from 3.1.0 to 3.2.0 (6710) dependabot
- build(deps): Bump filelock from 3.0.12 to 3.1.0 (6698) dependabot
- build(deps): Bump pytest-xdist from 2.3.0 to 2.4.0 (6696) dependabot
- build(deps): Bump google-cloud-storage from 1.42.1 to 1.42.2 (6635) dependabot
- system: get rid of speedcopy (6686) efiop
- fix dvc[all] (6657) casperdcl

Thanks again to anasitomtn, ap-kulkarni, casperdcl, daavoo, dependabot, dependabot[bot], efiop, eggqq007, gcoter, isidentical, nueschs, pared, pre-commit-ci, pre-commit-ci[bot], pwoolvett, skshetry and whysage for the contributions! 🎉

> Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

- Force sorted order in plots rendering (6601) daavoo

🐛 Bug Fixes
- gdrive: strip bucket (6618) skshetry
- ssh: ask password before setting it (6615) isidentical
- dvc cli: fixed error in 'dvc config --list' in non repo dir (6587) ap-kulkarni
- output: use remote kwarg instead of odb (6600) efiop

🔨 Maintenance

- build(deps): Bump codecov/codecov-action from 2.0.3 to 2.1.0 (6606) dependabot
- build(deps): Bump mock-ssh-server from 0.9.0 to 0.9.1 (6607) dependabot

Thanks again to ap-kulkarni, daavoo, dependabot, dependabot[bot], efiop, isidentical, karajan1001, nik123, pared and skshetry for the contributions! 🎉