Features / Enhancements
* **Requirments**: Bump storey to v1.3.18, 3436, assaf758
* **CI**: Add freeing up disk space and add more logs to go integration tests, 3434, tankilevitch
* **Spark**: Allow ingesting to a local path, 3432, gtopper
* **Unknown**: Support running most spark system tests locally with `run_local` flag, 3419, gtopper
* **DataStore**: Enrich `v3iodriver` with `mlconf.v3io_api`, 3414, tankilevitch
* **Requirements**: Bump storey to v1.3.17, 3415, assaf758
* **CI**: Add datanode docker images removal command and skip db deletion if db instance is not available, 3404, tankilevitch
* **API**: Reduce spammy logs, 3408, liranbg
* **CI**: Add branch information to the slack message in system tests, 3401, tankilevitch
* **CLI**: Add notifications to project, 2934, GiladShapira94
* **Runtimes**: Adjust `require_build` logic to include new requirements attribute, 3396, tankilevitch
* **CI**: Support multi branch system tests, 3393, tankilevitch
* **Runtime**: Introduce `requirements` attribute in the build spec to provide full separation between commands and requirements, 3385, tankilevitch
* **Requirements**: Arm64 requirements over conda env, 3386, alonmr
* **Spark**: Support more than 2 keys in spark online target ingestion engine, 3322, alxtkr77
* **Tests**: Remove excessive logs in serving tests, 3376, gtopper
* **CI**: Publish tutorials tarball asset on releases, 3369, daniels290813
* **Runtimes**: Avoid hang on large stderr output in `run_exec`, 3364, gtopper
* **Docs**: Repair reference, 3371, george0st
* **Tests**: System test prepare purge db, 3366, alonmr
* **API**: Add marketplace `get_asset` endpoint, 3339, yonishelach
* **Extras**: Add avro for kafka, 3193, george0st
* **API**: Fail `healthz` requests when offline / waiting for chief, 3344, liranbg
* **Docs**: Add stament about which ce/enterprise version gets installed, 3347, jillnogold
* **Docs**: Jobs and workflows, 3353, yevgenykhazan
* **DB**: Remove filedb, 2867, tankilevitch
* **CI**: Trigger ci on pull request against `feature/` branches (3345), 3348, alonmr
* **API**: Reflect correct message wen waiting for chief, 3336, liranbg
* **Model Monitoring**: Support sql store target for model endpoints, 2685, Eyal-Danieli
* **CI**: Security scan github action, 3331, liranbg
* **Model Monitoring**: Adjust grafana dashboards to use v3io datasource instead of mlrun api, 3271, Eyal-Danieli
* **Docs**: Add that api will change in future: feature vector over several feature sets, 3328, jillnogold
* **API**: Update marketplace schema, 3152, yonishelach
* **Project**: Deprecate constructor legacy params, 3269, alonmr
* **Docs**: K8s configuration doc edits, 3165, bcrant
* **Models**: Set cflags before requirements installation, 3318, alonmr
* **Runtimes**: Delete spark 2 support, 3280, gtopper
* **Schedule**: Update type hints for schedulecrontrigger to avoid unexpected pydantic behaviour, 3286, Eyal-Danieli
* **API**: Notification mechanism, 2414, quaark
* **API**: Allow sorting pipelines when specifying project, 3310, alonmr
* **Models**: Add mpi4py requirement, 3303, alonmr
* **Utils**: Clone gitlab with fine-grained access tokens, 3297, alonmr
* **Nuclio**: `with_service_type` sdk, 3296, alonmr
* **CI**: Update release automation script, 3292, liranbg
* **Requirements**: Bump httpx version, 3291, liranbg
* **Spark**: Block pull source at runtime, 3275, alonmr
* **Project**: Remove unused legacy methods, 3268, alonmr
* **Feature Store**: Get_offline_features over relations: add support for spark retrieval engine, 3055, davesh0812
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc1#features-and-enhancements)
Bug fixes
* **Serving**: Graph/step custom error-handler - fix bug and provide cleaner api, 3390, davesh0812
* **Feature Set**: Fix ingest to raise error when user did not provide targets and called set_targets with_default=false, 3420, davesh0812
* **Spark**: Fix redis key generation for single entity, 3425, alxtkr77
* **Tests**: Fix spark system tests, 3418, davesh0812
* **CI**: Set api log level in integration tests to `debug`, 3417, tankilevitch
* **Spark**: Fix udf - remove dependencies, 3403, alxtkr77
* **Builder**: Fix pushing to ecr, 3407, liranbg
* **MLRun**: Fix use of json instead of simplejson, 3405, tankilevitch
* **Tests**: Fix pipeline system tests, 3389, yaelgen
* **Serving**: Fix process executer in parallelrun, 3400, davesh0812
* **System Tests**: Fix run notifications system test, 3397, quaark
* **Builder**: Fix commands and requirements order when creating kaniko dockerfile, 3375, tankilevitch
* **Utils**: Fix multiple logs, 3381, gtopper
* **Datastore**: Fix `mapvalues` spark implementation to account for change of type, 3313, tomerm-iguazio
* **Serving**: Fix 200x logging in ci (and potentially elsewhere), 3377, gtopper
* **Project**: Fix cleanup of downloaded artifact zip on import, 3323, alonmr
* **Features**: Fixing issue when value_type is `valuetype` instance, 3368, davesh0812
* **Tests**: Fix parameter in tests, 3363, gtopper
* **Requirements**: Bump pyarrow upper limitation & fix system test to use parquetdatasetv2, 3321, davesh0812
* **Spark**: Fix resolving code path, 3356, alonmr
* **Model Monitoring**: Update system tests and fix endpoint_type in batch job, 3350, Eyal-Danieli
* **Test**: Fix api states healthz status code, 3358, alonmr
* **Model Monitoring**: Fix monitoring feature set target, 3357, Eyal-Danieli
* **Serving**: Fix initialization of graph steps in error flow, 3337, gtopper
* **Runtimes**: Fix workdir and source target dir, 3334, alonmr
* **Docs**: Fix ce upgrade and slack notification command, 3351, yevgenykhazan
* **Docs**: Fix sqlsource documentation anr remove todataframe from targets table, 3330, george0st
* **Makefile**: Fix compile schemas dockerized dir volume, 3346, alonmr
* **Docs**: Fix mlrun 1.3.0 client installation guide, 3338, alonmr
* **Datastore**: Fix leading zeros in time partition names, 3325, gtopper
* **Docs**: Fix typo in project.md, 3329, alterEgo123
* **Tests**: Fixing spark system test, 3324, davesh0812
* **Notifications**: Fix importing api from client code, 3326, alonmr
* **Project**: Fix function name isn't treated uniformly, 3287, yaelgen
* **Serving**: Fix type annotation, 3320, gtopper
* **Serving**: Fix monitoring stream pod losing events when event timestamp's microsecond equals zero, 3312, davesh0812
* **Context**: Fix failed to import a context from dict, 3308, yaelgen
* **Builder**: Fix default workdir and support setting workdir, 3245, alonmr
* **FrontendSpec**: Add allowed artifact path prefixes list to frontend spec, 3261, theSaarco
* **CI**: Bump prefix version for build images, 3315, liranbg
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc1#bug-fixes)
Pull requests:
f760105d [Tests] Fix tests to use preview if ingest is done with no targets and with_default_targets=False
cb08ab98 [Requirments] bump storey to v1.3.18 (3436)
ad06081a [CI] Add freeing up disk space and add more logs to go integration tests (3434)
6eef0f72 [Spark] Allow ingesting to a local path (3432)
7a308ddc [Serving] Graph/Step custom error-handler - fix bug and provide cleaner api (3390)
998a50c5 Support running most spark system tests locally with `run_local` flag (3419)
d8adcfd2 [Feature Set] Fix ingest to raise error when user did not provide targets and called set_targets with_default=False (3420)
114dd09d [Spark] Fix Redis key generation for single entity (3425)
90391e0d [DataStore] Enrich `V3ioDriver` with `mlconf.v3io_api` (3414)
69a4ea46 [Tests] Fix spark system tests (3418)
4c68d22f [CI] Set API log level in integration tests to `DEBUG` (3417)
031fe7bf [Requirements] Bump storey to v1.3.17 (3415)
156821f9 [Spark] Fix UDF - remove dependencies (3403)
ee33b3f7 [Builder] Fix pushing to ECR (3407)
99179dd2 [CI] Add datanode docker images removal command and skip DB deletion if DB instance is not available (3404)
64553567 [API] Reduce spammy logs (3408)
241cc6ee [MLRun] Fix use of json instead of simplejson (3405)
0fb7cccd [CI] Add branch information to the slack message in system tests (3401)
973c0df2 [Tests] Fix pipeline system tests (3389)
8c9d8447 [Serving] Fix process executer in ParallelRun (3400)
e6a00497 [Spark] Fix unexpected spark job failure
7aae8e97 [CLI] Add notifications to project (2934)
d6dbd34b [System Tests] Fix Run Notifications System Test (3397)
9cea482c [Runtimes] Adjust `require_build` logic to include new requirements attribute (3396)
5481f5b2 [CI] Support multi branch system tests (3393)
7e3c2bbc [Runtime] Introduce `requirements` attribute in the build spec to provide full separation between commands and requirements (3385)
a832c9e8 [Requirements] ARM64 requirements over conda env (3386)
f3f41f7b [Builder] Fix commands and requirements order when creating kaniko Dockerfile (3375)
42294061 [Utils] Fix multiple logs (3381)
c540f320 [Datastore] Fix `MapValues` spark implementation to account for change of type (3313)
92b5cc1a [Spark] Support more than 2 keys in spark online target ingestion engine (3322)
549d9994 [Serving] Fix 200x logging in CI (and potentially elsewhere) (3377)
7d738271 [Tests] Remove excessive logs in serving tests (3376)
688e48ef [CI] Publish tutorials tarball asset on releases (3369)
bf07df6e [Runtimes] Avoid hang on large stderr output in `run_exec` (3364)
41e6625c [Docs] Repair reference (3371)
cdd9387a [Project] Fix cleanup of downloaded artifact zip on import (3323)
9c0be5bb [Features] Fixing issue when value_type is `ValueType` instance (3368)
8ddeb385 [Tests] System test prepare purge DB (3366)
69bf2bfc [Tests] Fix parameter in tests (3363)
780e2f14 [Requirements] Bump pyarrow upper limitation & Fix system test to use ParquetDatasetV2 (3321)
f37f20ae [API] Add marketplace `get_asset` endpoint (3339)
b948c1db [Spark] Fix resolving code path (3356)
ba82e6d5 [Model Monitoring] Update system tests and fix endpoint_type in batch job (3350)
96edbed3 [Test] Fix API states healthz status code (3358)
f498afca [Model Monitoring] Fix monitoring feature set target (3357)
bba309c8 [Serving] Fix initialization of graph steps in error flow (3337)
ff181dab [Extras] Add avro for kafka (3193)
7360738a [API] Fail `healthz` requests when offline / waiting for chief (3344)
b1869921 [Docs] Add stament about which CE/Enterprise version gets installed (3347)
21fb1756 [Docs] Jobs and workflows (3353)
ee62334e [Runtimes] Fix workdir and source target dir (3334)
fc64e998 [Docs] Fix CE upgrade and slack notification command (3351)
d52d3c6c [DB] Remove FileDB (2867)
a1908848 [Docs] Fix SQLSource documentation anr remove ToDataFrame from targets table (3330)
9268392d [CI] Trigger CI on pull request against `feature/` branches (3345) (3348)
bd943f34 [API] Reflect correct message wen waiting for chief (3336)
9aa8441e [Makefile] Fix compile schemas dockerized dir volume (3346)
c284bb04 [Model Monitoring] Support SQL store target for model endpoints (2685)
a8a47df3 [Docs] Fix mlrun 1.3.0 client installation guide (3338)
2fe5ab85 [CI] Security scan github action (3331)
77359c3f [Datastore] Fix leading zeros in time partition names (3325)
8900a919 [Model Monitoring] Adjust Grafana dashboards to use V3IO datasource instead of MLRun API (3271)
d3929114 [Docs] Fix typo in project.md (3329)
cbf76f07 [Docs] Add that API will change in future: feature vector over several feature sets (3328)
ac73ece6 [Tests] Fixing Spark system test (3324)
ef073d72 [API] Update marketplace schema (3152)
59edc1c7 [Project] Deprecate constructor legacy params (3269)
65ce3a92 [Notifications] Fix importing API from Client code (3326)
003c8ae3 [Project] Fix function name isn't treated uniformly (3287)
361aa95d [Serving] Fix type annotation (3320)
ec9a2e51 [Docs] K8s Configuration Doc edits (3165)
b44bc18b [Models] Set CFLAGS before requirements installation (3318)
694218a6 [Serving] Fix monitoring stream pod losing events when event timestamp's microsecond equals zero (3312)
4c261db8 [Runtimes] Delete Spark 2 support (3280)
c8371e59 [Schedule] Update type hints for ScheduleCronTrigger to avoid unexpected pydantic behaviour (3286)
1c79a96b [API] Notification Mechanism (2414)
98f43706 [API] Allow sorting pipelines when specifying project (3310)
7d8811c1 [Context] Fix failed to import a context from dict (3308)
3cd252bf [Models] Add mpi4py requirement (3303)
85978042 [Utils] Clone gitlab with fine-grained access tokens (3297)
5b6d492b [Nuclio] `with_service_type` SDK (3296)
a6f50ff7 [CI] Update release automation script (3292)
5732dcc6 [Requirements] Bump httpx version (3291)
b28e4645 [Spark] Block pull source at runtime (3275)
e7078233 [Project] Remove unused legacy methods (3268)
ccc5ef74 [Builder] Fix default workdir and support setting workdir (3245)
3fb95c96 [FrontendSpec] Add allowed artifact path prefixes list to frontend spec (3261)
9360dd10 [Feature Store] get_offline_features over relations: add support for spark retrieval engine (3055)
5df665d3 [CI] Bump prefix version for build images (3315)
Failed parsing:
f760105d {davesh0812} [Tests] Fix tests to use preview if ingest is done with no targets and with_default_targets=False
e6a00497 {Gal Topper} [Spark] Fix unexpected spark job failure