Mlrun

Features / Enhancements
* **DOCS**: Update grafana configuration for model monitoring dashboards, 3839, Eyal-Danieli
* **CI**: Dynamically enrich env-vars for system tests, 3841, liranbg
* **Function**: Add waitreadinesstimeoutbeforefailure parameter to nuclio function, 3842, Yacouby
* **Notifications**: Add default values and validation to notifications, 3837, yaelgen
* **Package**: Add special handling for python 3.7, 3838, guy1992l
* **Events**: Change default events mode to `disabled` and bump `igz-mgmt~=0.0.10`, 3831, tankilevitch
* **CI**: Prep work for feature branch release, 3833, liranbg
* **Unknown**: Revert "[workflows] add validation and error message for invalid workflow setup", 3835, liranbg
* **Pipelines**: Support passing pipeline param to function spec resources, 3812, tankilevitch
* **CI**: Add pytest.ini to adhere new pytest conventions, 3830, liranbg
* **Workflows**: Add validation and error message for invalid workflow setup, 3797, yaelgen
* **Render**: Remove redundant quote replacement, 3829, alonmr
* **Requirements**: Bump nuclio-jupyter to 0.9.11, 3825, TomerShor
* **Docs**: Add ci-cd automation with git, 3640, jillnogold
* **Project**: Add option to enrich project on load from project_setup.py file if it exists, 3809, yaronha
* **DevEnv**: Added pycharm mlrun api run configuration, 3824, liranbg
* **Notifications**: Add methods to edit and remove notifications in pipelines, 3819, quaark
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc17#features-and-enhancements)

Bug fixes
* **Feature Store**: Fix passing `with _index` to `remotevectorresponse` & tests fix, 3843, davesh0812
* **CI**: Fix system test system deletion, 3836, liranbg
* **CI**: Fix deleting devutils namespace, 3834, eliyahu77
* **Artifact**: Fix enriching suffixes, 3832, liranbg
* **Feature Set**: On feture-set creation from ui, fix missing "engine type" in ui feature-set page, 3813, tomerm-iguazio
* **Feature Store**: Fix get offline result when the source of the feature set is scheduled and `passthrough=true`., 3826, davesh0812
* **Notifications**: Fix secret unmasking fails the whole notification mechanism, 3823, quaark
* **Workflows**: Fix fields being set to misleading value when setting workflow, 3790, yaelgen
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc17#bug-fixes)


Pull requests:
2f64371f [Feature Store] Fix passing `with _index` to `RemoteVectorResponse` & tests fix (3843)
8db5f159 [DOCS] Update Grafana configuration for model monitoring dashboards (3839)
81310f12 [CI] Dynamically enrich env-vars for system tests (3841)
f4a02ffe [Function] Add waitReadinessTimeoutBeforeFailure parameter to nuclio function (3842)
116883f1 [Notifications] Add default values and validation to notifications (3837)
2d4e60fe [Package] Add special handling for Python 3.7 (3838)
487c80e5 [CI] Fix system test system deletion (3836)
686a41f6 [Events] Change default events mode to `disabled` and bump `igz-mgmt~=0.0.10` (3831)
fe68dfbd [CI] Prep work for feature branch release (3833)
a0777d5b Revert "[Workflows] Add validation and error message for invalid workflow setup" (3835)
ceedf20c [CI] Fix deleting devutils namespace (3834)
c23a74d8 [Artifact] Fix enriching suffixes (3832)
3bb16040 [Pipelines] Support passing pipeline param to function spec resources (3812)
99de46a6 [CI] Add pytest.ini to adhere new pytest conventions (3830)
7cbed10f [Workflows] Add validation and error message for invalid workflow setup (3797)
c2fdaf09 [Feature Set] On feture-set creation from UI, fix missing "engine type" in UI feature-set page (3813)
4caea582 [Render] Remove redundant quote replacement (3829)
e5ba2a4d [Feature Store] Fix get offline result when the source of the feature set is scheduled and `passthrough=True`. (3826)
38fefc14 [Requirements] Bump nuclio-jupyter to 0.9.11 (3825)
36f14077 [Notifications] Fix secret unmasking fails the whole notification mechanism (3823)
bcc653fb [Docs] Add CI-CD automation with Git (3640)
0e36742e [Project] Add option to enrich project on load from project_setup.py file if it exists (3809)
b551fdef [DevEnv] Added pycharm MLRun API run configuration (3824)
1ee43300 [Workflows] Fix fields being set to misleading value when setting workflow (3790)
d42bb523 [Notifications] Add methods to edit and remove notifications in pipelines (3819)

Features / Enhancements
* **API**: Tweak create project flow, 3816, liranbg
* **Requirements**: Bump pydantic, 3821, alonmr
* **Images/Models**: Override base image, 3822, alonmr
* **Authz**: Revert opa `hub` path to `marketplace`, 3820, theSaarco
* **Feature Store**: Online vector with relations between different feature sets, 3672, davesh0812
* **LogCollector**: Don't start logs for pending pods, 3806, TomerShor
* **Images/Base**: Update conda to 23.1.0, 3815, alonmr
* **CI**: Update license and its github action verifier, 3811, liranbg
* **Model Monitoring**: Filter router models from the total average latency in grafana, 3805, Eyal-Danieli
* **Artifacts**: Remove model spec yaml from `extra_data`, 3798, TomerShor
* **CI**: Update test dockerfile docker installation, 3808, liranbg
* **Tests**: Adapt vulnerability test to new safety package, 3802, theSaarco
* **Docs**: Improve description of get_offline_features, 3785, jillnogold
* **Docs**: Tune logger description, 3795, george0st
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc16#features-and-enhancements)

Bug fixes
* **Notifications**: Fix git notification params going to message instead of params, 3818, quaark
* **Notifications**: Fix notification failed when no condition defined, 3817, yaelgen
* **Utils**: Fix missing logs on failure to add git metadata, 3810, alonmr
* **Feature Store**: Fix get_offline_feature when the key and the val of the relation are equal and `with_indexes=true`, 3814, davesh0812
* **Debug**: Improve flows for better debugging, 3807, liranbg
* **API**: Debug create project, 3803, liranbg
* **Feature Store**: Fix preview to rename column headings containing the `space` char, 3768, tomerm-iguazio
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc16#bug-fixes)


Pull requests:
8c174da4 [API] Tweak create project flow (3816)
24cf2e23 [Requirements] Bump pydantic (3821)
7fb3b470 [Images/Models] Override base image (3822)
7019f2b4 [Notifications] Fix git notification params going to message instead of params (3818)
07c451f0 [Notifications] Fix notification failed when no condition defined (3817)
bd18ff80 [Authz] Revert OPA `hub` path to `marketplace` (3820)
df407d20 [Feature Store] Online Vector with relations between different feature sets (3672)
7c87c615 [Utils] Fix missing logs on failure to add git metadata (3810)
86c14734 [Feature Store] Fix get_offline_feature when the key and the val of the relation are equal and `with_indexes=True` (3814)
5f6f777b [LogCollector] Don't start logs for pending pods (3806)
cc2bd287 [Images/Base] Update conda to 23.1.0 (3815)
c7b6f2c7 [CI] Update license and its github action verifier (3811)
5b92ad31 [Model Monitoring] Filter router models from the total average latency in Grafana (3805)
4c08b93e [Artifacts] Remove model spec yaml from `extra_data` (3798)
76194032 [Debug] Improve flows for better debugging (3807)
929d9511 [CI] Update test dockerfile docker installation (3808)
7a21e60f [Tests] Adapt vulnerability test to new safety package (3802)
f05d28f8 [Docs] Improve description of get_offline_features (3785)
7cad6757 [API] Debug create project (3803)
93f99fce [Docs] Tune logger description (3795)
d13e7b0a [Feature Store] Fix preview to rename column headings containing the `space` char (3768)

Features / Enhancements
* **Events**: Add support to audit secret actions to iguazio, 3711, tankilevitch
* **Feature Store**: Get-offline: enforce param `entity_timestamp_column` to be spcified only with param `entity_rows`, 3786, davesh0812
* **Build**: Bump alpine to 3.18, 3794, liranbg
* **System Tests**: Clear custom project names to delete after deletion, 3793, alonmr
* **Serving**: Add missing explain method, 3656, yanburman
* **KFP**: Align pipelines output with mlrun conventions, 3784, liranbg
* **CI**: Update dev_utilities, 3780, eliyahu77
* **Scaling**: Tune auto-scaling details, 3782, george0st
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc15#features-and-enhancements)

Bug fixes
* **Requirements**: Bump fastapi to fix security vulnerability, 3791, alonmr
* **Datastore**: Fix time zone error, 3788, gtopper
* **Spark**: Fix storing multiple keys from a spark dataframe into redis, 3789, alxtkr77
* **Serving**: Fix response for readiness status, 3776, Eyal-Danieli
* **CI**: Fix missing underscore when verifying run outputs, 3783, liranbg
* **Projects**: Fix no iteration parameter in `get_artifact_uri` method, 3775, quaark
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc15#bug-fixes)


Pull requests:
ca091a4a [Events] Add support to audit secret actions to Iguazio (3711)
e21127f7 [Feature Store] get-offline: Enforce param `entity_timestamp_column` to be spcified only with param `entity_rows` (3786)
2ed6c0a0 [Build] Bump alpine to 3.18 (3794)
6df3a01b [System Tests] Clear custom project names to delete after deletion (3793)
afc3f0d6 [Serving] Add missing explain method (3656)
7f44e906 [Requirements] Bump fastapi to fix security vulnerability (3791)
749e2fea [Datastore] Fix time zone error (3788)
4623a675 [Spark] Fix storing multiple keys from a Spark dataframe into Redis (3789)
34974300 [Serving] Fix response for readiness status (3776)
c4bdf092 [KFP] Align pipelines output with mlrun conventions (3784)
811c1646 [CI] Update dev_utilities (3780)
02ef829f [CI] Fix missing underscore when verifying run outputs (3783)
30b5a29c [Projects] Fix no iteration parameter in `get_artifact_uri` method (3775)
d3fde657 [Scaling] Tune auto-scaling details (3782)

Features / Enhancements
* **API**: Remove print command, 3778, liranbg
* **Unknown**: Revert "[artifacts] deprecate non-used artifact types", 3774, liranbg
* **Run**: Deprecate `run_local`, 3773, alonmr
* **Requirements**: Bump storey to 1.4.3, 3772, gtopper
* **Package**: Add all `pandas` file formats, 3765, guy1992l
* **API**: Reduce spammy log, 3769, liranbg
* **Package**: `mlrun.dataitem` ignored when hinted in a group as well, 3770, guy1992l
* **Artifacts**: Deprecate non-used artifact types, 3751, yaelgen
* **Tests**: Revert changes to default project after project creation, 3747, alonmr
* **Doc**: Added restriction on aggregation names, 3757, jillnogold
* **Docs**: Remove typo, 3762, george0st
* **Docs**: Move notifications page to better location and include it in docs side menu, 3758, quaark
* **Feature Store**: - save the engine as "storey" if the user-supplied fset engine is none., 3760, tomerm-iguazio
* **Docs**: Notification usage docs, 3746, quaark
* **Workflow**: Improving workflow error messages, 3753, yaelgen
* **Package**: Implement `mlrun.package`, 3333, guy1992l
* **Notifications**: Set notifications api, 3726, quaark
* **Docs**: Update mlrun installation python 3.7 pip requirement, 3748, alonmr
* **Requirements**: Bump storey to 1.4.2 ., 3745, tomerm-iguazio
* **Project**: Optionally add function tag to key of project function dicts, 3739, alonmr
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc14#features-and-enhancements)

Bug fixes
* **Spark**: Fix storing multiple keys from a spark dataframe into redis, 3777, alxtkr77
* **CI**: Fix failing tests, 3779, liranbg
* **Workflows**: Fix workflow completion even if a step is aborted, 3750, yaelgen
* **Notifications**: Fix pushing notifications, 3763, liranbg
* **gRPC**: Fix compiling schemas docker image, 3764, liranbg
* **Datastore**: Fix `_sanitize_url` when `parsed_url.netloc` is none, 3767, davesh0812
* **CI**: Fix system tests deploy command, 3759, quaark
* **CI**: Fix open source system tests config, 3755, quaark
* **Typo**: Fix mispellings, 3756, liranbg
* **SchemaCompiler**: Fix building container image, 3754, liranbg
* **Feature Store**: fix issues with start/end time in `_infer_from_static_df` and the `base-merger`, 3749, davesh0812
* **Notification**: Fix gitlab notification not being posted on issues, 3742, quaark
* **CI**: Fix open source tests invalid command, 3743, liranbg
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc14#bug-fixes)


Pull requests:
47a649e3 [Spark] Fix storing multiple keys from a Spark dataframe into Redis (3777)
6d0fd0aa [API] Remove print command (3778)
72271ca9 [CI] Fix failing tests (3779)
a5057ff9 Revert "[Artifacts] Deprecate non-used artifact types" (3774)
bd5dbb84 [Workflows] Fix workflow completion even if a step is aborted (3750)
4cb85914 [Notifications] Fix pushing notifications (3763)
5ec6dc45 [Run] Deprecate `run_local` (3773)
c3c12530 [Requirements] Bump storey to 1.4.3 (3772)
19e5cf0a [Package] Add all `pandas` file formats (3765)
f08fa15d [API] Reduce spammy log (3769)
219ff93f [Package] `mlrun.DataItem` ignored when hinted in a group as well (3770)
7726ca59 [gRPC] Fix compiling schemas docker image (3764)
d4cf4a2d [Artifacts] Deprecate non-used artifact types (3751)
d11c1b27 [Tests] Revert changes to default project after project creation (3747)
fdef93eb [Datastore] Fix `_sanitize_url` when `parsed_url.netloc` is None (3767)
51d5b831 [Doc] Added restriction on aggregation names (3757)
8ce2a2ee [Docs] Remove typo (3762)
215ffc7c [Docs] Move Notifications page to better location and include it in docs side menu (3758)
430cbdac [Feature Store] - Save the engine as "storey" if the user-supplied fset engine is None. (3760)
14451e0e [Datastore] Fix DataStore.as_df()
bee398f8 [CI] Fix system tests deploy command (3759)
ce495533 [CI] Fix Open Source System Tests Config (3755)
53d90220 [Docs] Notification usage docs (3746)
e53fda4a [Typo] Fix mispellings (3756)
2e548fb2 [Workflow] Improving workflow error messages (3753)
6d794d48 [SchemaCompiler] Fix building container image (3754)
9050b387 [Package] Implement `mlrun.package` (3333)
44913be1 [Notifications] Set notifications API (3726)
cebb09cb [Docs] Update MLRun installation Python 3.7 pip requirement (3748)
0a9b5c52 [Feature Store] Fix issues with start/end time in `_infer_from_static_df` and the `base-merger` (3749)
86f145c3 [Requirements] bump storey to 1.4.2 . (3745)
4401eba7 [Notification] Fix gitlab notification not being posted on issues (3742)
1ecf9177 [CI] Fix open source tests invalid command (3743)
0ae41710 [Project] Optionally add function tag to key of project function dicts (3739)

Failed parsing:
14451e0e {tomer-mamia} [Datastore] Fix DataStore.as_df()

Features / Enhancements
* **Project**: Raise error on wrong url source in `load_project`, 3728, tankilevitch
* **Docs**: Add 1.3.3 to change log, 3738, jillnogold
* **Docs**: Updated `lightgbm` code to match with newest version, 3736, guy1992l
* **Runs**: Add configurable timeout to abort_run, 3718, yaelgen
* **Notifications**: Evaluate condition as jinja template in separate process, 3715, quaark
* **Feature Store**: Delete `join_type` from `get_offline_feature`, 3643, davesh0812
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc13#features-and-enhancements)

Bug fixes
* **Notifications**: Fix local sync notifications not being run, 3731, quaark
* **Feature Store**: Fix time filter issues in `get_offline_features`, 3637, davesh0812
* **Datastore**: Fix ingestion from sql source, 3729, davesh0812
* **Tests**: Fix `rundbmock` runs dictionary, 3737, alonmr
* **Utils**: Fix remove image protocol prefix of default image, 3735, alonmr
* **API**: Fix error code in case of invalid pipeline run id, 3733, yanburman
* **Run**: Fix runtime error log, 3725, alonmr
* **Functions**: Remove protocol prefix from image name, 3730, yaelgen
* **Docs**: Fix helm repo in install mlrun on kubernetes, 3727, jillnogold
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc13#bug-fixes)


Pull requests:
762af5c7 [CI] Run tests on commit older than an hour (3741)
405ec1b6 [Project] Raise error on wrong url source in `load_project` (3728)
b2556997 [Notifications] Fix local sync notifications not being run (3731)
de2de400 [Feature Store] Fix time filter issues in `get_offline_features` (3637)
a208869e [Docs] Add 1.3.3 to change log (3738)
27c7c036 [Datastore] Fix ingestion from sql source (3729)
b7f6af5b [Docs] Updated `lightgbm` code to match with newest version (3736)
a11b5185 [Tests] Fix `RunDBMock` runs dictionary (3737)
d6d865b1 [Utils] Fix remove image protocol prefix of default image (3735)
a3b2e6b2 [API] Fix error code in case of invalid pipeline run ID (3733)
563ece1b [Run] Fix runtime error log (3725)
621744a7 [Runs] Add configurable timeout to abort_run (3718)
e0486ad9 [Functions] Remove protocol prefix from image name (3730)
ae4994c8 [Notifications] Evaluate condition as jinja template in separate process (3715)
ed4885dc [Docs] fix helm repo in Install MLRun on Kubernetes (3727)
92d3bc4f [Feature Store] Delete `join_type` from `get_offline_feature` (3643)

Features / Enhancements
* **Kaniko**: Retry extracting image filesystem, 3724, TomerShor
* **LogCollector**: Stop log collection for pod in unknown state, 3720, liranbg
* **Notifications**: Support notifications on aborted runs, 3703, quaark
* **CI**: Uncomment install dev utilities, 3719, tankilevitch
* **Requirements**: Bump storey to 1.4.1, 3671, tomerm-iguazio
* **Feature Store**: Raise a clear error when no features are found on retrieval, 3687, gtopper
* **Requirements**: Bump humanfriendly to 9.2, 3717, alonmr
* **Functions**: Improve test readability, 3713, yaelgen
* **API**: Better request handling logging, 3714, liranbg
* **System tests**: Mark test_run_state_completion as enterprise, 3705, yaelgen
* **Project**: Add `requirements_file` argument to missing functions, 3710, TomerShor
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc12#features-and-enhancements)

Bug fixes
* **Runtimes**: Fix funcdoc ast attributes parsing, 3716, alonmr
* **Project**: Fix `run_function` use in pipeline docstring, 3723, alonmr
* **Notification**: Fix remote ipython notification raising exception, 3722, quaark
* **CI**: Fix project test, 3721, liranbg
* **Notifications**: Fix notifications are not being sent for special local run cases (handler, dask), 3706, quaark
* **Notifications**: Fix notification message in slack & git, 3702, quaark
* **Notification**: Fix multiple notifications with identical names being ignored except for last notification, 3704, quaark
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.4.0-rc12#bug-fixes)


Pull requests:
34871964 [Runtimes] Fix funcdoc AST attributes parsing (3716)
28a1306f [Kaniko] Retry extracting image filesystem (3724)
de7970d3 [Project] Fix `run_function` use in pipeline docstring (3723)
cf9dc661 [Notification] Fix remote ipython notification raising exception (3722)
23a1783f [CI] Fix project test (3721)
9c960b57 [LogCollector] Stop log collection for pod in unknown state (3720)
277687ad [Notifications] Fix notifications are not being sent for special local run cases (handler, dask) (3706)
3e4e9d95 [Notifications] Support notifications on aborted runs (3703)
138ebddf [CI] Uncomment install dev utilities (3719)
b9dcc449 [Requirements] bump storey to 1.4.1 (3671)
84decaaf [Feature Store] Raise a clear error when no features are found on retrieval (3687)
63aecf0c [Requirements] Bump humanfriendly to 9.2 (3717)
27fae602 [Functions] Improve test readability (3713)
a81fffde [API] Better request handling logging (3714)
325b2e0d [Notifications] Fix Notification Message in slack & git (3702)
db743763 [System tests] Mark test_run_state_completion as enterprise (3705)
c44ccb01 [Project] Add `requirements_file` argument to missing functions (3710)
5424b502 [Notification] Fix multiple notifications with identical names being ignored except for last notification (3704)