Mlrun

Features / Enhancements
* **Docs**: Update sample (use image python 3.9 not 3.7), 5451, george0st
* **Kafka**: Add warning and fallback on old kafka option everywhere it applies, 5452, gtopper
* **Hack**: Delete comment that is no longer relevant from notebook, 5449, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc12#features-and-enhancements)

Bug fixes
* **Datastore**: Revert 'kind' prefix for default and v3io stores, 5450, alxtkr77
* **Artifacts**: Fix retained producer overwriting artifact spec, 5381, alonmr
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc12#bug-fixes)


Pull requests:
d99c139a [Docs] Update sample (use image python 3.9 not 3.7) (5451)
daad905f [Datastore] Revert 'kind' prefix for default and v3io stores (5450)
177a7b29 [Kafka] Add warning and fallback on old kafka option everywhere it applies (5452)
06efdda2 [Hack] Delete comment that is no longer relevant from notebook (5449)
811d3f0b [Artifacts] Fix retained producer overwriting artifact spec (5381)
e472f22a [Dependabot] Bump golang.org/x/net from 0.22.0 to 0.23.0 in /server/log-collector (5446)

Failed parsing:
e472f22a {dependabot[bot]} [Dependabot] Bump golang.org/x/net from 0.22.0 to 0.23.0 in /server/log-collector (5446)

Features / Enhancements
* **Datastore**: Rely on buffer instead of mmap, 5439, tomerm-iguazio
* **API**: Add alerts handling, 5367, yanburman
* **FeatureStore**: Set 'kind' for all the default stores as 'nosql', 5441, alxtkr77
* **Model Monitoring**: Raise error when using mlrun default image with client_version<1.6.3 and set_tracking is on, 5438, davesh0812
* **Pagination**: Phase vi - sdk uses pagination, 5436, quaark
* **Serving**: Revert 5322, 5431, gtopper
* **API Reference**: Add `mlrun.model_monitoring` docstrings, 5422, jond01
* **Docs**: Add an example how to use `log_artifact` method, 5411, GiladShapira94
* **Formatting**: Run the ruff formatter on docstrings, 5420, jond01
* **Model Monitoring**: Delete pipelines `access_key` from serving_spec_env, 5423, davesh0812
* **Model Monitoring**: Improve infra functions deployment, 5418, jond01
* **Utils**: Use `time.monotonic()` when measuring run time, 5421, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc11#features-and-enhancements)

Bug fixes
* **Docs**: Fix text block formatting, 5427, jond01
* **Model Monitoring**: Fix model inputs and outputs concatenation, 5435, jond01
* **Tests**: Fix `teardown_class`, 5426, tomerm-iguazio
* **Kafka**: Fix handling of new `brokers` parameter in `kafkatarget`, 5430, gtopper
* **Kafka**: Fix `kafka_brokers` fallback on `kafka_bootstrap_servers`, add deprecation warning, 5429, gtopper
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc11#bug-fixes)


Pull requests:
fbea0ad0 [Docs] Fix text block formatting (5427)
dc382166 [Model Monitoring] Fix model inputs and outputs concatenation (5435)
1401c784 [Tests] Fix `teardown_class` (5426)
bf95217e [Datastore] Rely on buffer instead of mmap (5439)
57e09417 [API] Add alerts handling (5367)
52373185 [FeatureStore] Set 'kind' for all the default stores as 'nosql' (5441)
5c1c4b7e [Kafka] Fix handling of new `brokers` parameter in `KafkaTarget` (5430)
477b3667 [Kafka] Fix `kafka_brokers` fallback on `kafka_bootstrap_servers`, add deprecation warning (5429)
498848b3 [Model Monitoring] raise error when using mlrun default image with client_version<1.6.3 and set_tracking is on (5438)
7c2d8ca8 [Pagination] Phase VI - SDK Uses Pagination (5436)
eddf225e [Serving] Revert 5322 (5431)
84133897 [API Reference] Add `mlrun.model_monitoring` docstrings (5422)
90c42251 [Docs] Add an example how to use `log_artifact` method (5411)
1e58ee7c [Formatting] Run the Ruff Formatter on docstrings (5420)
8e801eb0 [Model Monitoring] Delete pipelines `access_key` from SERVING_SPEC_ENV (5423)
d3e45852 [Model Monitoring] Improve infra functions deployment (5418)
f99e193d [Utils] Use `time.monotonic()` when measuring run time (5421)

Features / Enhancements
* **Application**: Forward query params to sidecar, 5416, alonmr
* **Nuclio**: Add ability to delete function with async client, 5414, rokatyy
* **API**: Support format for single get projects endpoint, 5407, liranbg
* **Datastore**: Snowflake offline target, 5214, tomerm-iguazio
* **Pagination**: Phase v.2 - function pagination endpoint support, 5415, quaark
* **Requirements**: Bump igz-mgmt to 0.1.3, 5413, moranbental
* **Application**: Support building the application image, 5341, alonmr
* **Pagination**: Phase v.1 - runs pagination endpoint support, 5399, quaark
* **API**: Ensure uvicorn logger matches the handler class, 5408, liranbg
* **Config**: Use mlrun.mlconf instead of mlrun.config.config, 5405, yanburman
* **Nuclio**: Add wait_for_readiness functionality to store_api_gateway, 5406, rokatyy
* **Kafka**: Rename `bootstrap_servers` -> `brokers`, 5398, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc9#features-and-enhancements)

Bug fixes
* **Tensorflow**: Fix imports, 5410, gtopper
* **API**: Fix logging headers for incoming/responding requests, 5409, liranbg
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc9#bug-fixes)


Pull requests:
3396f9ef [Application] Forward query params to sidecar (5416)
0be210b9 [Nuclio] Add ability to delete function with Async client (5414)
8dd496d8 [API] Support format for single get projects endpoint (5407)
ccdbfdda [Datastore] Snowflake offline target (5214)
76240c16 [Pagination] Phase V.2 - Function Pagination Endpoint Support (5415)
48de4653 [Requirements] Bump igz-mgmt to 0.1.3 (5413)
007ab801 [Application] Support building the application image (5341)
002bf0a4 [Tensorflow] Fix imports (5410)
35ae3778 [Pagination] Phase V.1 - Runs Pagination Endpoint Support (5399)
bbe47a9e [API] Fix logging headers for incoming/responding requests (5409)
0498c578 [API] Ensure uvicorn logger matches the handler class (5408)
061da847 [Config] Use mlrun.mlconf instead of mlrun.config.config (5405)
e06a1896 [Nuclio] Add wait_for_readiness functionality to store_api_gateway (5406)
18fa12ca [Kafka] Rename `bootstrap_servers` -> `brokers` (5398)

Features / Enhancements
* **Nuclio**: Api gateway system test, 5374, rokatyy
* **Make**: Add comments describing the logic behind container cleanups, 5400, yanburman
* **Tests**: Add dask coverage in datastore tests, 5371, tomerm-iguazio
* **Errors**: Use `error_to_str()` to format exceptions, 5404, yanburman
* **Tests**: Print mlrun-api logs in integ test in human readable form, 5402, yanburman
* **Projects**: Expose project level default function node selector via sdk for user interface, 5369, yaelgen
* **Requirements**: Allow for newer versions of fsspec, 5383, gtopper
* **Requirements**: Tighten pydantic upperbound due to breakage upstream, 5390, gtopper
* **FeatureStore**: Add default value for ds profile url, 5386, alxtkr77
* **Project**: Use job kind by default if not specified, 5224, Yacouby
* **Pagination**: Phase iv - handle permission filtering on paginated requests, 5385, quaark
* **Tests**: Allow running tests after previous failure, 5384, yanburman
* **Requirements**: Raise minimum `orjson` version due to cve-2024-27454, 5382, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc8#features-and-enhancements)

Bug fixes
* **Model Monitoring**: Fix security issue - delete pipelines access key from serving env, 5393, davesh0812
* **Tests**: Fix `testbatchdrift::test_batch_drift` system test, 5394, davesh0812
* **Tensorflow**: Fix import, 5375, gtopper
* **Pipelines**: Fix sensitive data appearing in pipeline metadata artifact, 5373, quaark
* **Pagination**: Phase iv.5 - fix no pagination on authenticated request and refactor config, 5387, quaark
* **Retryer**: Fix retryer not keeping last exception, 5376, alonmr
* **Docs**: Fix cheat sheet usage of `kafkatarget`, 5372, gtopper
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc8#bug-fixes)


Pull requests:
cc1ff1e9 [Model Monitoring] Fix security issue - delete pipelines access key from serving env (5393)
989d496b [Nuclio] API Gateway system test (5374)
a72edcde [Make] Add comments describing the logic behind container cleanups (5400)
492d5eea [Tests] Fix `TestBatchDrift::test_batch_drift` system test (5394)
a6903389 [Tests] Add dask coverage in datastore tests (5371)
292d4eec [Errors] Use `error_to_str()` to format exceptions (5404)
7ad90eef [Tests] Print mlrun-api logs in integ test in human readable form (5402)
c723f751 [Projects] Expose Project level default function node selector via SDK for user interface (5369)
5837ce36 [Tensorflow] Fix import (5375)
0e4b2eae [Requirements] Allow for newer versions of fsspec (5383)
cbafd621 [Requirements] Tighten pydantic upperbound due to breakage upstream (5390)
7cc4fa65 [FeatureStore] Add default value for ds profile url (5386)
404d8ffe [Pipelines] Fix sensitive data appearing in pipeline metadata artifact (5373)
33d5edff [Pagination] Phase IV.5 - Fix No Pagination on authenticated request and Refactor Config (5387)
14cc5e28 [Project] Use job kind by default if not specified (5224)
acebdc44 [Pagination] Phase IV - Handle Permission Filtering on Paginated Requests (5385)
31bed60f [Tests] Allow running tests after previous failure (5384)
812813ef [Retryer] Fix retryer not keeping last exception (5376)
61818c4e [Requirements] Raise minimum `orjson` version due to CVE-2024-27454 (5382)
a95fefd8 [Docs] Fix cheat sheet usage of `KafkaTarget` (5372)

Features / Enhancements
* **Model Monitoring**: Deploy the default app on the go, 5344, jond01
* **Docs**: Repair sample with csvsource, 5360, george0st
* **Model Serving**: Add system benchmark notebook, 5356, gtopper
* **Docs**: Add open issue ml-5876 to change log, 5368, jillnogold
* **Serving**: Add support for async engine in router topology, 5322, gtopper
* **Projects**: Enrich function node selector from project node selector, 5332, yaelgen
* **Tests**: Reduce the example size generated by hypothesis in the ci, 5364, jond01
* **Datastore**: Support alibaba oss, 5319, yakovga
* **Pagination**: Phase iii - paginator logic & finalize pagination cache lifecycle, 5337, quaark
* **API**: Bump igz-mgmt to 0.1.1, 5357, yaelgen
* **Docs**: Update change log for v1.6.2, 5329, jillnogold
* **Docs**: Update change log, 5336, jillnogold
* **Requirements**: Bump v3io to 0.6.4, 5355, tomerm-iguazio
* **Workflow**: Restore unintentional `source_code_target_dir` revert, 5353, alonmr
* **MLRun**: Finalizing docs for 1.6.2, 5345, liranbg
* **Nuclio**: Add api gateway syncing functionality and documentation, 5342, rokatyy
* **Schemas**: Remove duplicated monitoringstrenum, 5343, alonmr
* **Nuclio**: Add with_canary functionality for api gateway, 5338, rokatyy
* **Model Monitoring**: Add mysql implementation for the mm application framework, 5304, Eyal-Danieli
* **Nuclio**: Api gateways minor improvements, 5330, rokatyy
* **ModelObj**: Filter warnings when using to_dict, 5334, alonmr
* **Model Monitoring**: Remove monitoring batch job, 5309, jond01
* **Pagination**: Phase ii - pagination cache lifecycle, 5333, quaark
* **Pagination**: Phase i - pagination cache table, 5325, quaark
* **Serving**: Allow hundreds of models per serving function, 5198, yanburman
* **Builder**: Normalize source dir to mount path, 5326, alonmr
* **Projects**: Persist node selector configuration from zebo project to mlrun project, 5302, yaelgen
* **Model Serving**: Add local benchmark, 5324, gtopper
* **Nuclio**: Api gateway authentication improvements, 5327, rokatyy
* **Projects**: Allow deleting archived projects without leader, 5323, alonmr
* **Datastore**: Properly handle empty spark configurations for azure and gcs, 5320, alxtkr77
* **API**: Verify log collections stopped on startup only on currently collected logs, 5315, TomerShor
* **Log Collector**: Add endpoint to list runs in progress, 5314, TomerShor
* **Docs**: Repair kafkatarget sample, 5317, george0st
* **DataStore**: Condition http verify on mlrun config, 5313, liranbg
* **Nuclio**: Delete api gateway implementation, 5316, rokatyy
* **Docs**: Add information regarding `hadoop_user_name`, 5310, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc7#features-and-enhancements)

Bug fixes
* **Tests**: Fix model monitoring batch inference tsdb check, 5370, jond01
* **Automation**: Fix patch remote reset db, 5365, alonmr
* **Run**: Fix `'nonetype' object is not subscriptable` error, 5358, gtopper
* **Model Monitoring**: Fix `test_all` system test, 5348, Eyal-Danieli
* **Tests**: Fix `test_inference_feature_set` system test, 5351, davesh0812
* **Pipelines**: Fix get workflow id timeouts and make it configurable per run, 5335, alonmr
* **Serving**: Fix drain and termination callbacks, 5349, gtopper
* **Model Monitoring**: Fix monitoring feature set update, 5328, davesh0812
* **Tests**: Fix 2 feature store system tests, 5331, gtopper
* **Datastore**: Fix v3io stream trigger creation, 5318, gtopper
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc7#bug-fixes)


Pull requests:
06b1879c [Model Monitoring] Deploy the default app on the go (5344)
3f1a6bc6 [Docs] Repair sample with CSVSource (5360)
6f64563b [Tests] Fix model monitoring batch inference TSDB check (5370)
6ec19ddf [Model Serving] Add system benchmark notebook (5356)
9106ac82 [Docs] Add open issue ML-5876 to change log (5368)
8ce14539 [Serving] Add support for async engine in router topology (5322)
de319d4d [Projects] Enrich function node selector from project node selector (5332)
68e5734e [Tests] Reduce the example size generated by Hypothesis in the CI (5364)
2fe4b2e7 [Datastore] Support alibaba OSS (5319)
65a14413 [Automation] Fix patch remote reset DB (5365)
303167ba [Pagination] Phase III - Paginator Logic & Finalize Pagination Cache Lifecycle (5337)
a6e963c0 [API] Bump igz-mgmt to 0.1.1 (5357)
f8591453 [Docs] Update change log for v1.6.2 (5329)
e067557f [Run] Fix `'NoneType' object is not subscriptable` error (5358)
38d9ec7c [Docs] Update change log (5336)
eda4516f [Requirements] Bump v3io to 0.6.4 (5355)
160ae9e7 [Model Monitoring] Fix `test_all` system test (5348)
d7cd8873 [Tests] Fix `test_inference_feature_set` system test (5351)
fe1a8ee8 [Workflow] Restore unintentional `source_code_target_dir` revert (5353)
729938d1 [Pipelines] Fix get workflow id timeouts and make it configurable per run (5335)
1608f50e [Serving] Fix drain and termination callbacks (5349)
2442fe44 [MLRun] Finalizing docs for 1.6.2 (5345)
089013bc [Nuclio] Add API gateway syncing functionality and documentation (5342)
58e36701 [Schemas] Remove duplicated MonitoringStrEnum (5343)
1cf51d4a [Nuclio] Add with_canary functionality for API gateway (5338)
92a9926d [Model Monitoring] Add MySQL implementation for the mm application framework (5304)
1c0ee404 [Model Monitoring] Fix monitoring feature set update (5328)
c5d4f67d [Nuclio] API Gateways minor improvements (5330)
6f994e6b [ModelObj] Filter warnings when using to_dict (5334)
b8e8e864 [Tests] Fix 2 feature store system tests (5331)
b82407e1 [Model Monitoring] Remove monitoring batch job (5309)
2c206087 [Pagination] Phase II - Pagination Cache Lifecycle (5333)
ce7e4b44 [Pagination] Phase I - Pagination Cache Table (5325)
ff99cb01 [Serving] Allow hundreds of models per serving function (5198)
b7f3c5c5 [Builder] Normalize source dir to mount path (5326)
0a5aa180 [Projects] Persist node selector configuration from Zebo project to MLRun project (5302)
d21ffbfc [Model Serving] Add local benchmark (5324)
5d81056e [Nuclio] API Gateway authentication improvements (5327)
8127357d [Projects] Allow deleting archived projects without leader (5323)
4cbd4596 [Datastore] Properly handle empty Spark configurations for Azure and GCS (5320)
394e366e [API] Verify log collections stopped on startup only on currently collected logs (5315)
e6221e1e [Log Collector] Add endpoint to list runs in progress (5314)
332ac19c [Datastore] Fix v3io stream trigger creation (5318)
7737c58a [Docs] Repair KafkaTarget sample (5317)
1a6252d2 [DataStore] Condition http verify on mlrun config (5313)
b92bd44c [Nuclio] Delete API Gateway implementation (5316)
83a6abf1 [Docs] Add information regarding `HADOOP_USER_NAME` (5310)

Features / Enhancements
* **Model Monitoring**: Organize the monitoring deployment module, 5299, jond01
* **Application**: Introducing application runtime phase i, 5234, alonmr
* **SQL**: Setting all default mysql modes, 5268, liranbg
* **Docs**: Update kafka sample, 5303, george0st
* **Project**: Retain producers of exported artifacts, 5283, TomerShor
* **Model Monitoring**: Log artifacts in the histogram data drift app, 5280, jond01
* **Serving**: Bring back support for older (<1.12.10) nuclio versions, 5242, gtopper
* **API**: Use a common dependency in model monitoring endpoints, 5296, jond01
* **Docs**: Re-arrange data store content, 5226, jillnogold
* **CI**: Release bundle tutorials add welcome, 5294, daniels290813
* **Linting**: Check copyright notice in python file in `make lint`, 5297, jond01
* **Kaniko**: Bump kaniko for open source, 5287, liranbg
* **Tutorials**: Mlflow image paths, 5295, daniels290813
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc6#features-and-enhancements)

Bug fixes
* **Model Monitoring**: Test and fix for model-monitoring data-path: support llm/deep-learning models, 5289, davesh0812
* **Datastore**: Fix spark read path in `csvsource`, 5307, gtopper
* **Projects**: Fix second create_remote not overriding current remote, 5245, yaelgen
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v1.7.0-rc6#bug-fixes)


Pull requests:
cbfd1ee5 [Model Monitoring] Organize the monitoring deployment module (5299)
a10578e7 [Application] Introducing application runtime phase I (5234)
0cfbc03b [Model Monitoring] Test and Fix for Model-monitoring data-path: support LLM/deep-learning models (5289)
2af3d96c [SQL] Setting all default mysql modes (5268)
530b7cdc [Datastore] Fix Spark read path in `CSVSource` (5307)
285a9379 [Docs] Update Kafka sample (5303)
3a28f9d2 [Project] Retain producers of exported artifacts (5283)
0f21baf4 [Model Monitoring] Log artifacts in the histogram data drift app (5280)
cf03af85 [Serving] Bring back support for older (<1.12.10) nuclio versions (5242)
b1e54599 [API] Use a common dependency in model monitoring endpoints (5296)
728f9361 [Docs] Re-arrange data store content (5226)
67659e62 [CI] Release bundle tutorials add welcome (5294)
68e514d8 [Linting] Check copyright notice in Python file in `make lint` (5297)
7218958c [Projects] Fix second create_remote not overriding current remote (5245)
daae2b7b [Kaniko] Bump kaniko for open source (5287)
d806f91f [Tutorials] Mlflow image paths (5295)