Mlrun

Features / Enhancements
* **Feature Store**: Support controlling whether to update stats, 1486, katyakats
* **Docs**: General updates and fixing formatting, 1495, yaronha
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.9.0-rc2#features-and-enhancements)

Bug fixes
* **System Tests**: Fix args order, 1506, Hedingber
* **Feature Store**: Fix double setting for step context, 1502, yaronha
* **Feature store**: Delete redundant print, 1493, gtopper
* **Serving**: Fix RemoteStep, 1504, gtopper
* **Runtimes**: Properly handle project secrets for `nuclio:mlrun` kind, 1499, theSaarco
* **API**: Fix MySQL initialization from scratch, 1498, Hedingber
* **Datastore**: Enable no credentials for working with GCP workload identity, 1496, theSaarco
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.9.0-rc2#bug-fixes)


Pull requests:
7ad6421f [System Tests] Fix args order (1506)
0f8b4d87 [Feature Store] Fix double setting for step context (1502)
71db2a86 [Feature store] Delete redundant print (1493)
17d48316 [Feature Store] Support controlling whether to update stats (1486)
a4313014 [Serving] Fix RemoteStep (1504)
00165ea6 [Runtimes] Properly handle project secrets for `nuclio:mlrun` kind (1499)
1a66aa6b [API] Fix MySQL initialization from scratch (1498)
32632482 [Docs] General updates and fixing formatting (1495)
351af08b [Datastore] Enable no credentials for working with GCP workload identity (1496)


v0.9.0-test

Features / Enhancements
* **System Tests**: Add test for remote spark ingestion, 1475, urihoenig
* **General**: Improve git ignore, 1485, Hedingber
* **CI**: Improve usability, 1482, Hedingber
* **Requirements**: Bump scikit-learn to 1.x, 1481, Hedingber
* **Requirements**: Support PyArrow 3, 1049, gtopper
* **Datastore**: Improve CSV Source docstring, 1480, katyakats
* **Frameworks**: Support LGBM auto-logging, 1387, AlxZed
* **Requirements**: Bump pip to 21.2.x and python to 3.7.11, 1418, Hedingber
* **Docs**: Add notebook with examples of the code annotations options, 1456, AlonMaor14
* **Model Monitoring**: Add `top_level` and `list_ids` to filters to `list_endpoints`, 1459, katyakats
* **Feature Store**: Add support for incremental ingest with spark engine, 1473, katyakats
* **Docs**: Add sources and targets to docs, 1470, dinal
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.9.0-rc1#features-and-enhancements)

Bug fixes
* **Makefile**: Force sed to use extended regex, 1492, Hedingber
* **Serving**: Fix input/result path handling, 1491, yaronha
* **Serving**: Handle timeouts and retries in remote step, 1476, yaronha
* **Secrets**: Avoid auto-adding internal project secrets + model monitoring access-key changes, 1487, theSaarco
* **Serving**: Fail RemoteStep on bad status code also in async mode, 1474, gtopper
* **Requirements**: Introduce an upper bound for aiohttp version, 1471, gtopper
* **Builder**: Fix to enrich image only when needed, 1472, Hedingber
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.9.0-rc1#bug-fixes)


Pull requests:
fc2532e2 [Makefile] Force sed to use extended regex (1492)
4e931154 [Serving] Fix input/result path handling (1491)
c946ca24 [Serving] Handle timeouts and retries in remote step (1476)
1a9f34a9 [Secrets] Avoid auto-adding internal project secrets + model monitoring access-key changes (1487)
75f2b6de [System Tests] Add test for remote spark ingestion (1475)
493b6cc8 [General] Improve git ignore (1485)
b604a84c [CI] Improve usability (1482)
d33b9938 [Requirements] Bump scikit-learn to 1.x (1481)
a504fe60 [Requirements] Support PyArrow 3 (1049)
2aa1c7df [Datastore] Improve CSV Source docstring (1480)
53eba9f4 [Frameworks] Support LGBM auto-logging (1387)
4c03005f [Requirements] Bump pip to 21.2.x and python to 3.7.11 (1418)
c91efa59 [Serving] Fail RemoteStep on bad status code also in async mode (1474)
01a29354 [Docs] Add notebook with examples of the code annotations options (1456)
ecf773dd [Requirements] Introduce an upper bound for aiohttp version (1471)
96676366 [Model Monitoring] Add `top_level` and `list_ids` to filters to `list_endpoints` (1459)
11ef6d90 [Feature Store] Add support for incremental ingest with spark engine (1473)
47979289 [Docs] Add sources and targets to docs (1470)
1458074c [Builder] Fix to enrich image only when needed (1472)


v0.0.0-test

Main features & enhancements
* **Feature Store**: ingestion of large files + BigQuery source (pandas + spark), yaronha
* **Feature Store**: Add kafka source to ingestion service, dinal
* **Feature Store**: Support partitioning in parquet target in spark, gtopper
* **Feature Store**: Support passing FeatureSet entities as strings, yaronha
* **Datastore**: Support s3 endpoint_url for boto operations, theSaarco
* **Datastore**: Support Google cloud storage, theSaarco
* **Frameworks**: Added ONNX support and IO logging, guy1992l
* **Runtimes**: Infrastructure for performing auto-mount when UI submits jobs, theSaarco
* **Runtimes**: Support Sparkjob monitoring & add new mounts support, urihoenig
* **Runtimes**: Fix and align use of nuclio:mlrun runtime with hyper-params, yaronha
* **Runtimes**: Fix MLClientCtx to persist the job handler, yaronha
* **Runtimes**: Add missing kwargs, Hedingber
* **Builder**: Fix builder pod mount to use request user credentials, Hedingber
* **Builder**: Support providing pip ca file, Hedingber
* **Sparkjob**: Add support for spark operator 3, urihoenig
* **Sparkjob**: Support dynamic allocation & node selector for driver/executor, urihoenig
* **Serving**: Accept model/router class in set_topology() and add_model(), yaronha
* **Serving**: Support for graph step input/result redirection, yaronha
* **Nuclio**: Support env variables from k8s secrets in config spec, AlonMaor14
* **Projects**: Normalize username when adding to project name, Hedingber
* **Model Monitoring**: Delete model endpoints project resources, eyalsol
* **SDK+API**: Enrich runtimes with access key instead of session, Hedingber
* **SDK**: Change to warn on Major mismtach and notify (info) on Minor mismatch, Hedingber
* **API**: Improve data version resolution, quaark
* **API**: Remove projects summary format & optimize counters calculation to happen in parallel, Hedingber
* **API**: Optimize data migrations to happen only once, Hedingber
* **API**: Make data migrations configurable, Hedingber
* **DB**: Only backup database if data/schema migration is needed, quaark
* **DB**: DB Backups and DB Migrations are configurable, quaark
* **DB**: Support using MySQL, quaark
* **CI**: Enable running Kaniko in open source system tests, Hedingber
* **CI**: Trigger build workflow on new version release, Hedingber
* **Makefile**: Add option to disable cache, Hedingber
* **Secrets**: Auto add k8s project secrets, theSaarco
* **Docs**: Document object-storage access and credential passing, theSaarco
* **Docs**: Documenting auto-mount, theSaarco
* **UI**: [Release notes](https://github.com/mlrun/ui/releases/tag/v0.8.0)

More info can be found in the RCs release notes:

Features / Enhancements
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc15#features-and-enhancements)

Bug fixes
* **Serving**: Accept model/router class in set_topology() and add_model(), 1465, yaronha
* **Projects**: Ignore bad `active_branch` in load project (fix gitlab ci), 1468, yaronha
* **Feature Store**: In case of scheduled ingest without new source, save filter start for next run, 1464, katyakats
* **Requirements**: Pin docutils to 0.17.1, 1467, katyakats
* **Runtimes**: Fix MLClientCtx to persist the job handler, 1466, yaronha
* **Frameworks**: Add setter to the ModelHandler model_name argument, 1447, guy1992l
* **Docs**: Update fraud demo and steps doc strings, 1463, yaronha
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc15#bug-fixes)


Pull requests:
3585ff6b [Serving] Accept model/router class in set_topology() and add_model() (1465)
426c9fca [Projects] Ignore bad `active_branch` in load project (fix gitlab ci) (1468)
71a1feb5 [Feature Store] In case of scheduled ingest without new source, save filter start for next run (1464)
5e9125f7 [Requirements] Pin docutils to 0.17.1 (1467)
80c55af3 [Runtimes] Fix MLClientCtx to persist the job handler (1466)
b30c14b5 [Frameworks] Add setter to the ModelHandler model_name argument (1447)
da00acde [Docs] Update fraud demo and steps doc strings (1463)

Features / Enhancements
* **Docs**: Add text with GUI procedure to create new feature set, 1458, jasonnIguazio
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc14#features-and-enhancements)

Bug fixes
* **Builder**: Fix to use base image when not really building (instead of taking runtime default), 1462, Hedingber
* **API**: Fix session reading in frontend spec endpoint, 1461, Hedingber
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc14#bug-fixes)


Pull requests:
dff9ae20 [Builder] Fix to use base image when not really building (instead of taking runtime default) (1462)
40f7ce7d [API] Fix session reading in frontend spec endpoint (1461)
af732535 [Docs] Add text with GUI procedure to create new feature set (1458)

Features / Enhancements
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc13#features-and-enhancements)

Bug fixes
* **API**: Support env var with value from in job submission, 1457, Hedingber
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc13#bug-fixes)


Pull requests:
2e7096d8 [API] Support env var with value from in job submission (1457)