Mlrun

Features / Enhancements
* **Dask**: Add project secrets to Dask cluster on deployment, 1794, theSaarco
* **Spark**: Support auto-add of k8s project secrets, 1790, theSaarco
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.10.1-rc2#features-and-enhancements)

Bug fixes
* **DB**: Add retry on conflict in store_x methods to prevent race condition, 1797, Hedingber
* **Config**: Ignore null base64 string [Backport 0.10.x], 1796, Hedingber
* **Dask**: Fix results & artifacts no being logged when one of the iterations failed, 1795, tankilevitch
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.10.1-rc2#bug-fixes)


Pull requests:
d4871eee [DB] Add retry on conflict in store_x methods to prevent race condition (1797)
20a053b8 [Dask] Fix results & artifacts no being logged when one of the iterations failed (1795)
a168e5de [Config] Ignore null base64 string [Backport 0.10.x] (1796)
2b450a73 [Dask] Add project secrets to Dask cluster on deployment (1794)
a84681ea [Spark] Support auto-add of k8s project secrets (1790)

Features / Enhancements
* **Builder**: Support configuring image name prefix template to enforce [Backport 0.10.x], 1786, Hedingber
* **API**: Set default thread pool max workers to 64, 1780, Hedingber
* **Builder**: Allow to configure whether push/pull registries are insecure, 1751, Hedingber
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.10.1-rc1#features-and-enhancements)


Bug fixes
* **Runtimes**: Fix to enrich KFP and Kaniko pods with the default function node selector [Backport 0.10.x], 1787, Hedingber
* **Runtimes**: Fix issues when running functions on non-k8s installation, 1779, theSaarco
* **Runtimes**: Fix mount modifiers to keep mount path unique, 1781, Hedingber
* **Secrets**: Fixing nuclio remote deploy flow - remove dependency on Secrets crud, 1773, theSaarco
* **Runtimes**: Fix deletion of build image path after runs, 1762, yaronha
* **KFP**: Fix build step `with-mlrun` flag handling, 1758, yaronha
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.10.1-rc1#bug-fixes)


Pull requests:
8f67922b [Runtimes] Fix to enrich KFP and Kaniko pods with the default function node selector [Backport 0.10.x] (1787)
9f705648 [Builder] Support configuring image name prefix template to enforce [Backport 0.10.x] (1786)
14bb45e4 [Runtimes] Fix issues when running functions on non-k8s installation (1779)
703df6ff [API] Set default thread pool max workers to 64 (1780)
fba82822 [Runtimes] Fix mount modifiers to keep mount path unique (1781)
240d5bf8 [Secrets] Fixing nuclio remote deploy flow - remove dependency on Secrets crud (1773)
fa8b4956 [Runtimes] Fix deletion of build image path after runs (1762)
359fd43e [KFP] Fix build step `with-mlrun` flag handling (1758)
2e476f25 [Builder] Allow to configure whether push/pull registries are insecure (1751)

Main features & enhancements
* **General**: Drop support for python 3.6, Hedingber
* **Frameworks**: Redesigned and reimplemented the Machine Learning frameworks and more, guy1992l
* **Frameworks**: Add tests and fixes for all 3 ML frameworks, guy1992l
* **Feature Store**: Add Dask and Spark feature mergers (get_offline_features), yaronha
* **Feature Store**: Support aggregations when ingesting with spark engine, gtopper
* **Feature Store**: Support spark operator ingestion, urihoenig
* **Project**: Optimize project creation/deletion times, tankilevitch
* **Workflows**: Automatically add `{{workflow.uid}}` to artifact path when running workflows, theSaarco
* **Runtimes**: Support running class handlers, imported module handlers/classes and embedded code, yaronha
* **Runtimes**: Change the image tag and package version enrichment to be set from the client version, tankilevitch
* **Serving**: Allow setting trigger args for intermediate stream, yaronha
* **Serving**: Improve handling of KFP PipelineParams in nuclio/serving functions, yaronha
* **Sparkjob**: Support service account, urihoenig
* **Sparkjob**: Support `code_to_function`, urihoenig
* **CLI**: Fix and simplify CLI work in local runs, yaronha
* **API**: Support partitioning in list runs endpoint, Hedingber
* **API**: Add versioning compatibility to server and client, tankilevitch
* **API**: Add convenience methods for reading env and setting secrets from files, yaronha
* **DB**: Bump MySQL to 8.0, Hedingber
* **DB**: Improve backup logic, quaark
* **Images**: Bump CUDA to 11.2.1 in ml-models-gpu image, Hedingber
* **Requirements**: Bump versions to conform to safety checks, Hedingber
* **Requirements**: Bump Tensorflow to 2.7.0 and Horovod to 0.23.0, Hedingber
* **CI**: Add step that runs backward compatibility tests on PRs, tankilevitch
* **System Tests**: Add API backward compatibility tests, tankilevitch
* **Docs**: Remove "beta" from feature store, jillnogold
* **Docs**: New section: Images and their usage in MLRun, jillnogold
* **Docs**: New section Graph high availability configuration, jillnogold
* **UI**: [Release notes](https://github.com/mlrun/ui/releases/tag/v0.10.0)

More info can be found in the RCs release notes:

Features / Enhancements
* **Docs**: Jobs page and drill down into runs, 1731, jillnogold
* **Docs**: New section: Images and their usage in MLRun, 1680, jillnogold
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.10.0-rc9#features-and-enhancements)

Bug fixes
* **Serving**: Avoid corruption of job arguments, 1674, gtopper
* **System Tests**: Fixing OS tests, 1744, Hedingber
* **Project**: Handle None in pipeline args, 1742, yaronha
* **Project**: Fix `run_function()` with local runtime, 1741, yaronha
* **System Tests**: Set the client version to fix image enrichment, 1738, tankilevitch
* **Artifacts**: Fix broken artifact URIs when using run_function(), 1740, yaronha
* **CLI**: Fix and simplify CLI work in local runs, 1733, yaronha
* **Frameworks + Docs**: Fix tutorial notebooks + `apply_mlrun()` register models under the "model" key, 1735, guy1992l
* **Feature Store**: Fail `deploy_ingestion_service` if feature set does not already exist, 1698, gtopper
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.10.0-rc9#bug-fixes)


Pull requests:
558daced [Serving] Avoid corruption of job arguments (1674)
5bbe9990 [System Tests] Fixing OS tests (1744)
35b449fb [Project] Handle None in pipeline args (1742)
eae88863 [Project] Fix `run_function()` with local runtime (1741)
7d2428b1 [System Tests] Set the client version to fix image enrichment (1738)
0d1a48e0 [Artifacts] Fix broken artifact URIs when using run_function() (1740)
5c144ff3 [CLI] Fix and simplify CLI work in local runs (1733)
c112a9a2 [Frameworks + Docs] Fix tutorial notebooks + `apply_mlrun()` register models under the "model" key (1735)
f65cf13e [Feature Store] Fail `deploy_ingestion_service` if feature set does not already exist (1698)
78cc0f0d [Docs] Jobs page and drill down into runs (1731)
b846023a [Docs] New section: Images and their usage in MLRun (1680)

Features / Enhancements
* **Runtimes**: Change the image tag and package version enrichment to be set from the client version for all runtimes, 1722, tankilevitch
* **Sparkjob**: Support service account, 1728, urihoenig
* **Requirements**: Bump storey, 1727, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.10.0-rc8#features-and-enhancements)

Bug fixes
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.10.0-rc8#bug-fixes)


Pull requests:
7c54a695 [Runtimes] Change the image tag and package version enrichment to be set from the client version for all runtimes (1722)
460766cb [Sparkjob] Support service account (1728)
ce87e1be [Requirements] Bump storey (1727)

Features / Enhancements
* **Frameworks**: Small alignments to the old API and eval_mdoel_v2, 1725, guy1992l
* **Serving**: Prevent `push_error` from ever raising an error itself, 1720, gtopper
* **SDK**: Simplify env config usage, 1719, yaronha
* **CLI**: Run/deploy/build project function (from project.yaml), 1718, yaronha
* **DB**: Safer MySQL Backup, 1714, quaark
* **Docs**: New section Graph high availability configuration, 1711, jillnogold
* **Docs**: Improve the installation guide, 1710, Hedingber
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.10.0-rc7#features-and-enhancements)

Bug fixes
* **Builder**: Fix mlrun command install, 1723, tankilevitch
* **Datastore**: Fix data types diffs get stats table, 1688, benbd86
* **Sparkjob**: Fix env parsing, 1724, urihoenig
* **Images**: Remove Jupyter wrong pvc config, 1721, Hedingber
* **Docs**: Repair `MLRUN_ARTIFACT_PATH`, 1717, george0st
* **Frameworks**: Test and import fixes, 1715, guy1992l
* **Runtimes**: Fix view of build logs + store completed logs in files, 1713, yaronha
* **Runtimes**: Fixes in nuclio build status API, 1712, theSaarco
* **Frameworks**: Add tests and fixes for all 3 ML frameworks, 1709, guy1992l
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.10.0-rc7#bug-fixes)


Pull requests:
4eca1c69 [Frameworks] Small alignments to the old API and eval_mdoel_v2 (1725)
c239328a [Builder] Fix mlrun command install (1723)
33aeff57 [Datastore] Fix data types diffs get stats table (1688)
f438f97d [Serving] Prevent `push_error` from ever raising an error itself (1720)
14967262 [Sparkjob] Fix env parsing (1724)
4911b0f0 [Images] Remove Jupyter wrong pvc config (1721)
905383fa [Docs] Repair `MLRUN_ARTIFACT_PATH` (1717)
30bdecdc [SDK] Simplify env config usage (1719)
7821227c [CLI] Run/deploy/build project function (from project.yaml) (1718)
e2eec3ff [Frameworks] Test and import fixes (1715)
b06188ba [Runtimes] Fix view of build logs + store completed logs in files (1713)
e7309242 [DB] Safer MySQL Backup (1714)
2fabd580 [Runtimes] Fixes in nuclio build status API (1712)
ca7409c1 [Frameworks] Add tests and fixes for all 3 ML frameworks (1709)
5f178a6c [Docs] New section Graph high availability configuration (1711)
a4ab7d77 [Docs] Improve the installation guide (1710)