Renku

----------------------------------------------------------------------------------------------------------

Bug Fixes
~~~~~~~~~

- **cli:** Fix Git LFS auto-commit hook not committing new pointer files
(`2139 <https://github.com/SwissDataScienceCenter/renku-python/issues/2139>`__)
(`dca5aa4 <https://github.com/SwissDataScienceCenter/renku-python/commit/dca5aa4b2baa22bbfd708de814a557b644015a77>`__)
- **cli:** prevent –template-ref from being set without –template-source in renku init
(`2146 <https://github.com/SwissDataScienceCenter/renku-python/issues/2146>`__)
(`e687b08 <https://github.com/SwissDataScienceCenter/renku-python/commit/e687b08f8152fac7a6d6eb3389dac054385ea4b9>`__)
- **core:** add url validator utility function to fix an issue with URLs containing
trailing slashes
(`2050 <https://github.com/SwissDataScienceCenter/renku-python/issues/2050>`__)
(`89f1c90 <https://github.com/SwissDataScienceCenter/renku-python/commit/89f1c90c711c2478b6e96d47107baab658242de0>`__),
- **core:** fix checking out template repository by revision
(`2189 <https://github.com/SwissDataScienceCenter/renku-python/issues/2189>`__)
(`2a69aa2 <https://github.com/SwissDataScienceCenter/renku-python/commit/2a69aa2656967f744c10c4beb3931b76d41e0954>`__),
- **core:** fix CWL to work with filenames with spaces
(`2187 <https://github.com/SwissDataScienceCenter/renku-python/issues/2187>`__)
(`634f2b3 <https://github.com/SwissDataScienceCenter/renku-python/commit/634f2b3e6709885639685ac9b989f46456dd8cdf>`__),
- **core:** fix Zenodo dataset import for datasets with schema:image set
(`2142 <https://github.com/SwissDataScienceCenter/renku-python/issues/2142>`__)
(`06d4969 <https://github.com/SwissDataScienceCenter/renku-python/commit/06d4969cc703eaf9ea884df61e51aba9e48b6e85>`__)
- **core:** fix duplicate project version in flattened JSON-LD
(`2087 <https://github.com/SwissDataScienceCenter/renku-python/issues/2087>`__)
(`e28e308 <https://github.com/SwissDataScienceCenter/renku-python/commit/e28e3085f60089d4a8d5d6cb33453322531ae6b8>`__)
- **service:** fix management jobs running into timeouts
(`2127 <https://github.com/SwissDataScienceCenter/renku-python/issues/2127>`__)
(`ab7ca08 <https://github.com/SwissDataScienceCenter/renku-python/commit/ab7ca0801c0e4bc43d5369843b4ee8176d242609>`__)

Features
~~~~~~~~

- **core:** add ``group`` and ``remove`` subcommand to ``graph workflow``
(`2177 <https://github.com/SwissDataScienceCenter/renku-python/issues/2177>`__)
(`221aeba <https://github.com/SwissDataScienceCenter/renku-python/commit/221aebab394ca80dc9320c5c023a2852b0e47006>`__)
- **core:** add renku version as a project template parameter
(`2145 <https://github.com/SwissDataScienceCenter/renku-python/issues/2145>`__)
(`0e9b132 <https://github.com/SwissDataScienceCenter/renku-python/commit/0e9b132858b2de1440b0e7e2b598ba4d63fe002c>`__)
- **core:** git login from CLI
(`2045 <https://github.com/SwissDataScienceCenter/renku-python/issues/2045>`__)
(`1d7147d <https://github.com/SwissDataScienceCenter/renku-python/commit/1d7147df66f245a50a6a9eaa487e2708e7363672>`__)
- **core:** include parameter values in provenance
(`2093 <https://github.com/SwissDataScienceCenter/renku-python/issues/2093>`__)
(`84b6d0f <https://github.com/SwissDataScienceCenter/renku-python/commit/84b6d0f448161f33a3caa1b9631ae47840d648c6>`__)
- **docs:** new design based on `Renku Sphinx Theme <https://github.com/SwissDataScienceCenter/renku-sphinx-theme>`__
(`2204 <https://github.com/SwissDataScienceCenter/renku-python/issues/2204>`__)
(`eaa19f0 <https://github.com/SwissDataScienceCenter/renku-python/commit/eaa19f072d683cc0674fd9233f432cb9b75a2bab>`__)

----------------------------------------------------------------------------------------------------------

Bug Fixes
~~~~~~~~~

- **core:** remove locking from core read operations
(`2099 <https://github.com/SwissDataScienceCenter/renku-python/issues/2099>`__)
(`4407808 <https://github.com/SwissDataScienceCenter/renku-python/commit/440780887983e8f949c6a2d909996f344ef24096>`__)
- **service:** fix service project creation
(`2092 <https://github.com/SwissDataScienceCenter/renku-python/issues/2092>`__)
(`48d518f <https://github.com/SwissDataScienceCenter/renku-python/commit/48d518fda687003991852aad348a7edc99794e74>`__)

----------------------------------------------------------------------------------------------------------

Bug Fixes
~~~~~~~~~

- **core:** Fix annotations serialization in ProvenanceGraph
(`1992 <https://github.com/SwissDataScienceCenter/renku-python/issues/1992>`__)
(`eb3a7ba <https://github.com/SwissDataScienceCenter/renku-python/commit/eb3a7ba600b4b4858df77e1986caea9dc5ba565d>`__),
closes
`1952 <https://github.com/SwissDataScienceCenter/renku-python/issues/1952>`__
- **core:** no failure when processing git history for deleted files
(`2047 <https://github.com/SwissDataScienceCenter/renku-python/issues/2047>`__)
(`d85facd <https://github.com/SwissDataScienceCenter/renku-python/commit/d85facd1b8a1f2c5e8ed874afe0d79063c7dc499>`__)
- **cli:** fix path matching in renku log dot output
(`2070 <https://github.com/SwissDataScienceCenter/renku-python/issues/2070>`__)
(`4a4342b <https://github.com/SwissDataScienceCenter/renku-python/commit/4a4342b6004e9632f38e7eaa13fe6567051c0b72>`__)

Features
~~~~~~~~

- **cli:** improve feedback around files being overwritten by renku
init and add --initial-branch flag
(`1997 <https://github.com/SwissDataScienceCenter/renku-python/issues/1997>`__)
(`50bb67b <https://github.com/SwissDataScienceCenter/renku-python/commit/50bb67b65489bb75be29acb3fb8a3cdec65ad611>`__)
- **cli:** add JSON output format to ‘renku dataset ls’ and ‘renku
dataset ls-files’
(`2084 <https://github.com/SwissDataScienceCenter/renku-python/issues/2084>`__)
(`514f13b <https://github.com/SwissDataScienceCenter/renku-python/commit/514f13b1f34d4d22beb0e69425136670f5c94beb>`__)
- **cli:** add OLOS export and improve import/export provider logic
(`1857 <https://github.com/SwissDataScienceCenter/renku-python/issues/1857>`__)
(`779c481 <https://github.com/SwissDataScienceCenter/renku-python/commit/779c4816a8e994526255a78a7163afb45ea79cd2>`__)
- **cli:** detect filename from content-disposition header when
downloading
(`2020 <https://github.com/SwissDataScienceCenter/renku-python/issues/2020>`__)
(`c79ea14 <https://github.com/SwissDataScienceCenter/renku-python/commit/c79ea148d7f08cd45085b5918144fdff7c3d161b>`__)
- **core:** add default value to all Run parameters
(`2057 <https://github.com/SwissDataScienceCenter/renku-python/issues/2057>`__)
(`3a0321d <https://github.com/SwissDataScienceCenter/renku-python/commit/3a0321d3443c8226abbc534b2ddee0f4f54aa4c0>`__)
- **core:** adds ``node-js`` detection for rerun/update
(`2002 <https://github.com/SwissDataScienceCenter/renku-python/issues/2002>`__)
(`8b9e801 <https://github.com/SwissDataScienceCenter/renku-python/commit/8b9e801718413763d17fbbc4c22212a0f8263013>`__)
- **core:** add renku login command to authenticate with a renku
deployment
(`1864 <https://github.com/SwissDataScienceCenter/renku-python/issues/1864>`__)
(`7f3039f <https://github.com/SwissDataScienceCenter/renku-python/commit/7f3039f470558a157a5c0a8b45fa2dd6b77eb1d3>`__)
- **dataset:** add support to dataset update for detecting changes
to local files
(`2049 <https://github.com/SwissDataScienceCenter/renku-python/issues/2049>`__)
(`71befe0 <https://github.com/SwissDataScienceCenter/renku-python/commit/71befe0303684bd790fb36c0f77630ac262ff05d>`__)
- **service:** pass gitlab token to core-service
(`2062 <https://github.com/SwissDataScienceCenter/renku-python/issues/2062>`__)
(`63c2675 <https://github.com/SwissDataScienceCenter/renku-python/commit/63c2675859ae24eef32afa6f7a267e244000495c>`__)
- **workflow:** add naming metadata for command parameters
(`2071 <https://github.com/SwissDataScienceCenter/renku-python/issues/2071>`__)
(`b1e7a9b <https://github.com/SwissDataScienceCenter/renku-python/commit/b1e7a9b2913883de8c8d4f76a7fbd75a2e036ab5>`__)
- **workflow:** add workflow naming metadata
(`2033 <https://github.com/SwissDataScienceCenter/renku-python/issues/2033>`__)
(`5612199 <https://github.com/SwissDataScienceCenter/renku-python/commit/5612199e5ade9d7a6ea2937f87be8adb7b8de19a>`__)
- **service:** add delayed write operations, i.e. porcelain and better cache management
(`1957 <https://github.com/SwissDataScienceCenter/renku-python/issues/1957>`__)
(`a05b615 <https://github.com/SwissDataScienceCenter/renku-python/commit/a05b6158a79a7ee85828487ae2194746c3409d46>`__)

----------------------------------------------------------------------------------------------------------

Highlights
~~~~~~~~~~

- Ability to update local project from its template and to update the Dockerfile
to install the current version of renku-python using `renku migrate`.
- Support for Unicode paths in `renku run` (including emojis).

Bug Fixes
~~~~~~~~~

- **cli:** fix renku rerun/update with unicode input/output paths
(`1963 <https://github.com/SwissDataScienceCenter/renku-python/issues/1963>`__)
(`9859b62 <https://github.com/SwissDataScienceCenter/renku-python/commit/9859b622e14c74a59964be67f5b2bcbe6e8e35f2>`__)
- **service:** fix project_clone with git ref specified
(`2008 <https://github.com/SwissDataScienceCenter/renku-python/issues/2008>`__)
(`c072286 <https://github.com/SwissDataScienceCenter/renku-python/commit/c072286e029210a881765c686e589984385e4c36>`__)

Features
~~~~~~~~

- **cli:** support template and docker migration
(`2019 <https://github.com/SwissDataScienceCenter/renku-python/issues/2019>`__)
(`ed87770 <https://github.com/SwissDataScienceCenter/renku-python/commit/ed87770eb79c346892a68d0a3b614c5cd597775d>`__)
- **dataset:** support moving files between datasets with renku ``mv``
(`1993 <https://github.com/SwissDataScienceCenter/renku-python/issues/1993>`__)
(`a715b70 <https://github.com/SwissDataScienceCenter/renku-python/commit/a715b709b3b63667963a7726629edb2670f7a13e>`__)

----------------------------------------------------------------------------------------------------------

Bug Fixes
~~~~~~~~~

- **core:** Add error handling if push of temporary branch fails
(`1979 <https://github.com/SwissDataScienceCenter/renku-python/issues/1979>`__)
(`f8d7285 <https://github.com/SwissDataScienceCenter/renku-python/commit/f8d7285ddf45f153785d5a5f552184e045d84006>`__)
- **core:** fix handling of '' in filenames
(`1982 <https://github.com/SwissDataScienceCenter/renku-python/issues/1982>`__)
(`41316b4 <https://github.com/SwissDataScienceCenter/renku-python/commit/41316b477547b5d414e590decd3e2703635730b3>`__)
- **core:** fix template update if same filename was added locally
(`1974 <https://github.com/SwissDataScienceCenter/renku-python/issues/1974>`__)
(`5b47ddc <https://github.com/SwissDataScienceCenter/renku-python/commit/5b47ddc92972baa8f3b295b57b93028cf5ac8af4>`__)
- **core:** fixes save and push to correctly handle merge conflicts
(`1925 <https://github.com/SwissDataScienceCenter/renku-python/issues/1925>`__)
(`fdac171 <https://github.com/SwissDataScienceCenter/renku-python/commit/fdac1711c0aa29d091e947c4d158c25d8b5332ef>`__)
- **service:** sync service cache with remote before operations to prevent
cache getting out of sync
(`1972 <https://github.com/SwissDataScienceCenter/renku-python/issues/1972>`__)
(`34ec5d6 <https://github.com/SwissDataScienceCenter/renku-python/commit/34ec5d6f1098161fc2483c86f4eb6d8d5299a79e>`__)

Features
~~~~~~~~

- **dataset:** dataset import enhancements
(`1970 <https://github.com/SwissDataScienceCenter/renku-python/issues/1970>`__)
(`b3df7b8 <https://github.com/SwissDataScienceCenter/renku-python/commit/b3df7b838ad676176d5da50599a5c6e55622b28f>`__)
- **service:** renku service ``up``/``down``/``ps``/``restart``/``logs`` commands
(`1899 <https://github.com/SwissDataScienceCenter/renku-python/issues/1899>`__)
(`d9e49ae <https://github.com/SwissDataScienceCenter/renku-python/commit/d9e49aee19ce89efacf516b1d6426124c38f6a7b>`__)
- **service:** add support for storing remote dataset images in the repo
(`1878 <https://github.com/SwissDataScienceCenter/renku-python/issues/1878>`__)
(`3862c2e <https://github.com/SwissDataScienceCenter/renku-python/commit/3862c2e5089d6420fc243a1cded3aaa92b72859f>`__)

----------------------------------------------------------------------------------------------------------

Bug Fixes
~~~~~~~~~

- **core:** call git commands for batches of files to prevent hitting argument length limits
(`1893 <https://github.com/SwissDataScienceCenter/renku-python/issues/1893>`__)
(`deaf055 <https://github.com/SwissDataScienceCenter/renku-python/commit/deaf055ced01a3e2d354234336d961b8dc226418>`__)
- **dataset:** change renku dataset import to move temporary files and become more resilient to errors
(`1894 <https://github.com/SwissDataScienceCenter/renku-python/issues/1894>`__)
(`279407e <https://github.com/SwissDataScienceCenter/renku-python/commit/279407e97e9491ba537eb9fe5536897c277cca93>`__)
- **service** correctly address HTTP server errors
(`1872 <https://github.com/SwissDataScienceCenter/renku-python/issues/1872>`__)
(`2fd5052 <https://github.com/SwissDataScienceCenter/renku-python/commit/2fd5052b6c2dd07e644961d6a9384292e0a6e89e>`__)
- **service** correctly handle ref on project.clone
(`1888 <https://github.com/SwissDataScienceCenter/renku-python/issues/1888>`__)
(`7f30404 <https://github.com/SwissDataScienceCenter/renku-python/commit/7f30404979f4a934264c87cc404aa0a7523b8688>`__)
- **service** use project_id as part of project filesystem path
(`1754 <https://github.com/SwissDataScienceCenter/renku-python/issues/1754>`__)
(`391a14a <https://github.com/SwissDataScienceCenter/renku-python/commit/391a14a560f10e232b776e5b310f6608d548168f>`__)

Features
~~~~~~~~

- **cli:** add renku storage migrate command to migrate git files to lfs
(`1869 <https://github.com/SwissDataScienceCenter/renku-python/issues/1869>`__)
(`bed1358 <https://github.com/SwissDataScienceCenter/renku-python/commit/bed1358740531898b0b19aaf9c7f0b7effdd7de6>`__)
- **cli:** add service component management commands
(`1867 <https://github.com/SwissDataScienceCenter/renku-python/issues/1867>`__)
(`928baf9 <https://github.com/SwissDataScienceCenter/renku-python/commit/928baf9a4caa18354917bfc25e7f83d2243b47d8>`__)
- **core:** exclude renku metadata from being added to git lfs
(`1898 <https://github.com/SwissDataScienceCenter/renku-python/issues/1898>`__)
(`8046edb <https://github.com/SwissDataScienceCenter/renku-python/commit/8046edbfa0236a45c9e79e8754dac3014768c41e>`__)
- **core:** add oauth authentication for KG access
(`1881 <https://github.com/SwissDataScienceCenter/renku-python/issues/1881>`__)
(`a568d31 <https://github.com/SwissDataScienceCenter/renku-python/commit/a568d3168b67edabf4632861bf26ca68926accba>`__)
- **dataset:** improve naming for imported datasets
(`1900 <https://github.com/SwissDataScienceCenter/renku-python/issues/1900>`__)
(`9beb654 <https://github.com/SwissDataScienceCenter/renku-python/commit/9beb6549716ca4561ff55d53bec2d7fe4f411ef1>`__)
- **service:** add build graph endpoint
(`1571 <https://github.com/SwissDataScienceCenter/renku-python/issues/1571>`__)
(`a7bfe3d <https://github.com/SwissDataScienceCenter/renku-python/commit/a7bfe3d4b2b34100286fe461830d277ffd13d5e1>`__)
- **service:** add renku config endpoints
(`1834 <https://github.com/SwissDataScienceCenter/renku-python/issues/1834>`__)
(`c09ca6b <https://github.com/SwissDataScienceCenter/renku-python/commit/c09ca6b0f86c32b61a0232a7d69bde1c5c87420d>`__)
- **service:** add helm 3 values schema to chart
(`1835 <https://github.com/SwissDataScienceCenter/renku-python/issues/1835>`__)
(`57f6aee <https://github.com/SwissDataScienceCenter/renku-python/commit/57f6aee24818d9465e5f79ceeb0cecc40df61073>`__)
- **service** add root redirect to swagger docs
(`1871 <https://github.com/SwissDataScienceCenter/renku-python/issues/1871>`__)
(`1abd4f6 <https://github.com/SwissDataScienceCenter/renku-python/commit/1abd4f6e4ee54c52ec16e177e6432e06434f0ac3>`__)
- **service:** add support for adding images to datasets
(`1850 <https://github.com/SwissDataScienceCenter/renku-python/issues/1850>`__)
(`c3caafd <https://github.com/SwissDataScienceCenter/renku-python/commit/c3caafd71c08b36f15de70eb733f20d482e8ad28>`__)