Features / Enhancements
* **Builder**: Clone github repository to a directory other than `/tmp`, 4434, gtopper
* **Storey**: Make aggregations return `nan` when there is no data except for count, 4442, alxtkr77
* **k8s**: Sanitize label's values to ensure k8s compatibility, 4439, laurybueno
* **Test**: Update drop_column spark get-offline test, 4435, davesh0812
* **Feature Store**: Drop columns according to the user `drop_columns` param when reading the result df with `remotevectorresponse`, 4424, davesh0812
* **Feature-set**: Inject db session from server, 4422, alonmr
* **Security**: Remedy vulnerability, 4414, liranbg
* **SDK**: Remove deprecated `run_local`, 4413, alonmr
* **Model Monitoring**: Treat special chars properly in the inference flow, 4377, jond01
* **Workflows**: Minor tweaks, 4411, liranbg
* **API**: Bump uvicorn, 4410, liranbg
* **API**: Bump fastapi, 4409, liranbg
* **Model Monitoring **: Update `_model_monitoring_common_path` according to mlrun server split, 4408, davesh0812
* **MLRun**: Resolve some circular imports, 4404, alonmr
* **Feature Store**: Revert the order of the columns in the return dataframe when running `get_offline_features` in remote, 4405, davesh0812
* **Migrations**: Set pythonpath to root, 4403, alonmr
* **Builder**: Add force build flag to build_image and build_function, 4373, yaelgen
* **Tests**: Changes according to featurevectorstatus changes, 4397, davesh0812
* **Run Configuration**: Deploy ce, 4395, alonmr
* **Docs**: Tutorials images, 4379, daniels290813
* **Packager**: English edits, 4120, jillnogold
* **Config**: Move the `.importlinter` config to `pyproject.toml`, 4392, jond01
* **Project**: Set function to function spec only once, 4389, davesh0812
* **Log Collector**: Restart log streaming when k8s api sends eof, 4378, TomerShor
* **Docs**: Add fs fv-defined feature-set relations and join-type (per-join), 4347, jillnogold
* **Requirements**: Bump click, 4383, alonmr
* **DOCS**: [model monitoring] use `get_sample_path` to get the model path, 4385, Eyal-Danieli
* **Dask**: Update dask commands, 4382, alonmr
* **API**: Extract server code to external module, 4346, alonmr
* **Docs**: Update 1.4 change log, 4365, jillnogold
* **Docs**: Remove mentions of python 3.7, 4367, jillnogold
* **Docs**: Add spark runtime details, 4317, jillnogold
* **Feature Store**: Update feature vector features in featurevectorstatus, 4340, davesh0812
* **Dockerfiles**: Jupyter dockerfile update_demos, 4351, daniels290813
* **Requirements**: Remove unnecessary lz4 requirement, 4357, gtopper
* **Reqs**: Update requirements, 4349, liranbg
* **CI**: Cache jupyter builds, 4350, liranbg
* **Requirements**: Add support for pandas 2, 4228, gtopper
* **Iguazio**: Filter projects being deleted, 4348, liranbg
* **Notifications**: Remove notification params from mlrun_exec_config, 4334, yaelgen
* **API**: Reduce spammy logs, 4344, liranbg
* **Pipelines**: Delete kubeflow experiments along with its related mlrun project, 4288, laurybueno
* **Docs**: Add type hints to cli options, 4336, alonmr
* **Docs**: Improvements to image build docs, 4338, theSaarco
* **Runtimes**: Move server side runtime executions to runtime handlers, 4320, alonmr
* **Nuclio**: Support buildflags for nuclio function deployment, 4325, rokatyy
* **Nuclio**: Allow invoking without specifying path, 4332, liranbg
* **AsyncHTTP**: Do retry on connection refused error, 4331, liranbg
* **DOCS**: [model monitoring] update batch infer tutorial, 4273, Eyal-Danieli
* **Docker**: Remedy security vulnerabilities, 4326, liranbg
* **Docs**: Replace image name mlrun/ml-models with mlrun/mlrun, 4282, jillnogold
* **Docs**: Remove python 3.7, 4319, jillnogold
* **KFP**: Warn when using image property for non-remote pipelines, 4318, liranbg
* **Runtimes**: Support graceful termination in nuclio, 4159, gtopper
* **Model Monitoring**: Send a notification when an app reports "detected" status, 4313, jond01
* **Feature store**: Remove parameters deprecated in 1.5.0, 4312, gtopper
* **Model Monitoring**: Implement apps writer (ee), 4200, jond01
* **Datastore**: Add s3 and kafka support to datastore profiles, 4088, alxtkr77
* **Docs**: Import mlrun missing in monitoring, 4309, daniels290813
* **Artifacts**: Increase retrieved iterations to 1k, 4300, liranbg
* **Requirements**: Bump v3io-frames to 0.10.7, 4289, gtopper
* **Docs**: Align model path convention, 4299, daniels290813
* **Tutorials**: Remove warning on prediction, 4297, daniels290813
* **Runtimes**: Add handler and empty kinds to abortable runtimes, 4294, alonmr
* **Tutorials**: Remove ml-models, 4290, daniels290813
* **Log Collector**: Limit consecutive start log requests on failed runs, 4277, TomerShor
* **HTTPDB**: Add retryable invalid chunks exceptions, 4291, alonmr
* **Model-Monitoring**: Apps framework phase-1 (poc), 4216, assaf758
* **Docs**: Add details on workers and gpu, 4219, jillnogold
* **Datastore**: Remove deprecated `time_field` constructor parameter, 4274, gtopper
* **Docs**: Add dependencies to serving classes in model serving tutorial, 4276, jillnogold
* **Docs**: Remove bokeh and chart artifact types, 4272, jillnogold
* **Config**: Re-enable explicit ack by default, 4238, gtopper
* **Model Monitoring**: Encode feature statistics data (kv), 4263, Eyal-Danieli
* **Pipelines**: Add submit scheduled workflow logs, 4269, alonmr
* **Requirements**: Replace `azure-storage-blob` upperbound with exclusion, 4264, gtopper
* **Project**: Allow for on the fly configuration of git while pushing and pulling, 4206, laurybueno
* **LogCollector**: Bump go go 1.21, 4226, liranbg
* **CI**: Build development minor version, 4258, liranbg
* **Docs**: Add code description for controlling spark operator memory, 4253, jillnogold
* **CI**: Enhance periodic rebuild to automatically take branches, 4257, liranbg
* **Datastore**: Delete deprecated parameter `time_field` from `dataframesource`, 4254, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.6.0-rc1#features-and-enhancements)
Bug fixes
* **Datastore**: Fix reading parquet directory when using datastore profiles, 4444, alxtkr77
* **Test**: Fix test_db_commands system test, 4430, alonmr
* **Spark**: Fix function code indentation, 4428, gtopper
* **Workflows**: Fix missing related labels, 4419, laurybueno
* **Package**: Fix for inherited types unpacking, 4417, guy1992l
* **Runtimes**: Delete abstractspark classes and fix `spark3runtime` doc generation, 4363, gtopper
* **Images**: Fix jupyter copy docs images source path, 4398, alonmr
* **Spark**: Fix `topandas` to match pyspark 3.2.3, 4396, gtopper
* **Notifications**: Fix getting event loop in non-main thread, 4390, liranbg
* **Spark**: Fix datetime dtype error when pandas 2 is installed, 4388, gtopper
* **Runconfig**: Bugfix runconfig image with func and reference, 4362, tomerm-iguazio
* **RemoteRunner**: Fix sanitizing workflow spec, 4384, liranbg
* **Model Monitoring**: Fix drift result dictionary calculation when the value is 0, 4361, Eyal-Danieli
* **Workflow**: Fix running preloaded workflow, 4375, liranbg
* **Makefile**: Fix make log-collector command, 4374, alonmr
* **RuntimeResources**: Fix listing by label selector, 4371, liranbg
* **CI**: Fixes to open source system tests, 4370, liranbg
* **CI**: Fix system tests image build, 4364, liranbg
* **Docs**: Fix spark-operator notebook, 4353, gtopper
* **Tests**: Fix feature store test `test_preview_timestamp_key`, 4343, gtopper
* **Tests**: Fix test_model_monitoring_voting_ensemble system test, 4328, jond01
* **Function Docs**: Fix return type parsing + `kwargs`/`varargs` detection fix, 4330, theSaarco
* **Model Monitoring**: Fix generating `function_uri` when calling `get_or_create_model_endpoint`, 4306, Eyal-Danieli
* **Function Docs**: Fix wrongly reporting default param values when parsing function entrypoint, 4321, theSaarco
* **Tests**: Fix system tests local label verification, 4310, alonmr
* **Model Monitoring**: Validate `model_uri` prefix, 4280, Eyal-Danieli
* **Datastore**: Fix issue when parquet target path is directory but the parquet isn't partitioned, 4292, davesh0812
* **Docs**: Fix cli docs, 4255, alonmr
* **Project**: Affix `set_function` tag and naming, 4236, alonmr
* **SQLDB**: Fix read run not found error message, 4259, alonmr
* **Builder**: Enrich prefixed base image, 4267, alonmr
* **Requirements**: Fix `sdk_moniker` error caused by azure-storage-blob 12.18.0, 4256, gtopper
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.6.0-rc1#bug-fixes)
Pull requests:
4e583676 [Datastore] Fix reading parquet directory when using datastore profiles (4444)
a3b623a0 [Builder] Clone GitHub repository to a directory other than `/tmp` (4434)
41cf852f [Storey] Make aggregations return `NaN` when there is no data except for count (4442)
cc4be46c [k8s] Sanitize label's values to ensure k8s compatibility (4439)
549b6678 [Test] Update drop_column spark get-offline test (4435)
3e61c1ab [Test] Fix test_db_commands system test (4430)
4097471f [Spark] Fix function code indentation (4428)
d2459ba9 [Feature Store] Drop columns according to the user `drop_columns` param when reading the result df with `RemoteVectorResponse` (4424)
add2ee09 [Feature-set] Inject db session from server (4422)
6b4abbc1 [Workflows] Fix missing related labels (4419)
ee6d8a47 [Package] Fix for inherited types unpacking (4417)
4bd54088 [Security] Remedy vulnerability (4414)
25e828e5 [SDK] Remove deprecated `run_local` (4413)
301e4096 [Model Monitoring] Treat special chars properly in the inference flow (4377)
2e63e4b0 [Workflows] Minor tweaks (4411)
dc1c668c [API] Bump uvicorn (4410)
3dfad804 [API] Bump fastapi (4409)
1a92533f [Model Monitoring ] Update `_MODEL_MONITORING_COMMON_PATH` according to mlrun server split (4408)
c9bc8f39 [MLRun] Resolve some circular imports (4404)
937e9e6f [Feature Store] Revert the order of the columns in the return Dataframe when running `get_offline_features` in remote (4405)
9bc32a70 [Runtimes] Delete AbstractSpark classes and fix `Spark3Runtime` doc generation (4363)
15c7fefc [Migrations] Set PYTHONPATH to root (4403)
b73112b9 [Builder] Add force build flag to build_image and build_function (4373)
b0739b43 [Tests] Changes according to FeatureVectorStatus changes (4397)
d2b8d1b4 [Run Configuration] Deploy CE (4395)
901e48fd [Images] Fix Jupyter copy docs images source path (4398)
14a2c039 [Spark] Fix `toPandas` to match pyspark 3.2.3 (4396)
01dff682 [Notifications] Fix getting event loop in non-main thread (4390)
d3547382 [Docs] Tutorials images (4379)
61c98024 [Packager] English edits (4120)
656aa549 [Config] Move the `.importlinter` config to `pyproject.toml` (4392)
601a995c [Spark] Fix datetime dtype error when pandas 2 is installed (4388)
2b336c82 [Project] Set function to function spec only once (4389)
76d057b6 [Runconfig] Bugfix runconfig image with func and reference (4362)
3be059a3 [Log Collector] Restart log streaming when k8s API sends EOF (4378)
aa0c3b61 [Docs] Add FS FV-defined feature-set relations and join-type (per-join) (4347)
7a0bbc89 [RemoteRunner] Fix sanitizing workflow spec (4384)
a9d1cd24 [Requirements] Bump click (4383)
f288334a [DOCS][Model Monitoring] Use `get_sample_path` to get the model path (4385)
0704227b [Model Monitoring] Fix drift result dictionary calculation when the value is 0 (4361)
6f63ebdf [Dask] Update dask commands (4382)
1159d2c6 [Workflow] Fix running preloaded workflow (4375)
c587e167 [Makefile] Fix make log-collector command (4374)
10e9028b [API] Extract server code to external module (4346)
ae2fd4ab [Docs] Update 1.4 change log (4365)
65cb166f [Docs] Remove mentions of python 3.7 (4367)
0c2bb1c6 [Docs] Add Spark runtime details (4317)
5e02452c [RuntimeResources] Fix listing by label selector (4371)
74073b2d [CI] Fixes to open source system tests (4370)
eec04990 [CI] Fix system tests image build (4364)
8a1d3796 [Feature Store] Update feature vector features in FeatureVectorStatus (4340)
a46848ea [Docs] Fix spark-operator notebook (4353)
77a9a822 [Dockerfiles] Jupyter dockerfile update_demos (4351)
36049e1f [Requirements] Remove unnecessary lz4 requirement (4357)
6bfcb298 [Reqs] Update requirements (4349)
3109df71 [CI] Cache jupyter builds (4350)
db68dce9 [Requirements] Add support for pandas 2 (4228)
e892f447 [Iguazio] Filter projects being deleted (4348)
77fe2b3b [Notifications] Remove notification params from MLRUN_EXEC_CONFIG (4334)
56c6255d [API] Reduce spammy logs (4344)
6f8cda44 [Pipelines] Delete Kubeflow experiments along with its related MLRun project (4288)
48b0cb2b [Tests] Fix feature store test `test_preview_timestamp_key` (4343)
a7075ca9 [Docs] Add type hints to CLI options (4336)
0e162d8a [Docs] Improvements to image build docs (4338)
3c7376c1 [Runtimes] Move server side runtime executions to runtime handlers (4320)
88fe7192 [Nuclio] Support buildFlags for nuclio function deployment (4325)
c5e0c847 [Nuclio] Allow invoking without specifying path (4332)
717b1987 [AsyncHTTP] Do retry on connection refused error (4331)
27fd6172 [DOCS][Model Monitoring] Update Batch Infer tutorial (4273)
29ca3a00 [Tests] Fix test_model_monitoring_voting_ensemble system test (4328)
58e429f5 [Function Docs] Fix return type parsing + `kwargs`/`varargs` detection fix (4330)
110e2bf0 [Docker] Remedy security vulnerabilities (4326)
9a8214b6 [Docs] Replace image name mlrun/ml-models with mlrun/mlrun (4282)
5459a320 [Docs] Remove python 3.7 (4319)
072e077c [KFP] Warn when using image property for non-remote pipelines (4318)
b15503d2 [Model Monitoring] Fix generating `function_uri` when calling `get_or_create_model_endpoint` (4306)
431055f5 [Runtimes] Support graceful termination in nuclio (4159)
34b536cb [Model Monitoring] Send a notification when an app reports "detected" status (4313)
0ced07da [Function Docs] Fix wrongly reporting default param values when parsing function entrypoint (4321)
25b22222 [Feature store] Remove parameters deprecated in 1.5.0 (4312)
0bff85a8 [Model Monitoring] Implement apps writer (EE) (4200)
616518f3 [Datastore] Add S3 and Kafka support to datastore profiles (4088)
8fccbb93 [Tests] Fix system tests local label verification (4310)
4c169616 [Docs] Import mlrun missing in monitoring (4309)
f91ffc14 [Artifacts] Increase retrieved iterations to 1k (4300)
3c1b3e3a [Requirements] Bump v3io-frames to 0.10.7 (4289)
6cd16f1d [Docs] Align model path convention (4299)
6f9d7e3c [Tutorials] Remove warning on prediction (4297)
c35349bf [Runtimes] Add handler and empty kinds to abortable runtimes (4294)
5c3e2130 [Model Monitoring] Validate `model_uri` prefix (4280)
7f098cb5 [Datastore] Fix issue when parquet target path is directory but the parquet isn't partitioned (4292)
1eb4d351 [Tutorials] Remove ml-models (4290)
0e4dbc46 [Log Collector] Limit consecutive start log requests on failed runs (4277)
8ef1bbae [HTTPDB] Add retryable invalid chunks exceptions (4291)
8304dd34 [Model-Monitoring] Apps framework phase-1 (POC) (4216)
4c36d13c [Docs] Add details on workers and GPU (4219)
7f8b7982 [Datastore] Remove deprecated `time_field` constructor parameter (4274)
1152aabd [Docs] Add dependencies to serving classes in model serving tutorial (4276)
2d869561 [Docs] Fix CLI docs (4255)
e41a1954 [Docs] Remove bokeh and chart artifact types (4272)
56863c7e [Config] Re-enable explicit ack by default (4238)
231cba71 [Model Monitoring] Encode feature statistics data (KV) (4263)
ed9986d4 [Pipelines] Add submit scheduled workflow logs (4269)
b663888b [Project] Affix `set_function` tag and naming (4236)
1c1bf015 [SQLDB] Fix read run not found error message (4259)
59d11141 [Builder] Enrich prefixed base image (4267)
577d85f9 [Requirements] Replace `azure-storage-blob` upperbound with exclusion (4264)
8e2348e1 [Project] Allow for on the fly configuration of Git while pushing and pulling (4206)
70bc8c77 [LogCollector] Bump go go 1.21 (4226)
f5b6c92b [CI] Build development minor version (4258)
22911b97 [Docs] Add code description for controlling Spark Operator memory (4253)
5b7e9e88 [Requirements] Fix `sdk_moniker` error caused by azure-storage-blob 12.18.0 (4256)
7d088feb [CI] Enhance periodic rebuild to automatically take branches (4257)
c3fac2c8 [Datastore] Delete deprecated parameter `time_field` from `DataFrameSource` (4254)