Mlrun

Features / Enhancements
* **Feature Store**: ingestion of large files + BigQuery source (pandas + spark), 1394, yaronha
* **Feature Store**: Support partitioning in parquet target in spark, 1400, gtopper
* **API**: Count file artifacts instead of functions in project summary, 1358, Hedingber
* **Datastore**: Support Google cloud storage, 1395, theSaarco
* **Runtimes**: Add project secrets to Nuclio functions, 1386, theSaarco
* **Feature Store**: Check permissions for feature set/vector ops, 1393, katyakats
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc6#features-and-enhancements)

Bug fixes
* **DB**: Fix `data_version` table, 1399, quaark
* **MySQL Migration**: explicitly set sqlite tables to migrate, 1396, quaark
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc6#bug-fixes)


Pull requests:
02c523f1 [Feature Store] ingestion of large files + BigQuery source (pandas + spark) (1394)
9da0cd8c [Feature Store] Support partitioning in parquet target in spark (1400)
ac1b6756 [API] Count file artifacts instead of functions in project summary (1358)
f626ea88 [DB] Fix `data_version` table (1399)
22735c45 [Datastore] Add missing comment in gcs (1397)
33fe83a1 [Datastore] Support Google cloud storage (1395)
e921b6a8 [MySQL Migration] explicitly set sqlite tables to migrate (1396)
57c593c9 [Runtimes] Add project secrets to Nuclio functions (1386)
d864e588 [Feature Store] Check permissions for feature set/vector ops (1393)

Features / Enhancements
* **Feature Store**: Add `with_indexes` flag to `get_offline_features`, 1391, yaronha
* **Docs**: Remove unneeded context from getting started tutorial, 1390, yaronha
* **API**: Optimize data migrations to happen only once, 1362, Hedingber
* **Requirements**: Bump `storey` version to 0.8.2, 1388, eyalsol
* **Frameworks**: Added ONNX support and IO logging, 1299, guy1992l
* **Docs**: Update spark doc, 1385, dinal
* **Requirements**: Loosen fsspec and related requirements, 1312, gtopper
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc5#features-and-enhancements)

Bug fixes
* **Sparkjob**: Fix empty node selector handling, 1389, urihoenig
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc5#bug-fixes)


Pull requests:
4e9cf66a [Feature Store] Add `with_indexes` flag to `get_offline_features` (1391)
04ade2dd [Docs] Remove unneeded context from getting started tutorial (1390)
4a242835 [Sparkjob] Fix empty node selector handling (1389)
c2196044 [API] Optimize data migrations to happen only once (1362)
f8c25c3d [Requirements] Bump `storey` version to 0.8.2 (1388)
7df1c36f [Frameworks] Added ONNX support and IO logging (1299)
7582c4c8 [Docs] Update spark doc (1385)
45fc6f0f [Requirements] Loosen fsspec and related requirements (1312)

Features / Enhancements
* **Secrets**: Data-stores to use project secrets for credentials if configured, 1369, theSaarco
* **Docs**: Model Monitoring dashboards update toward automated setup, 1376, eyalsol
* **Nuclio**: Support env variables from k8s secrets in config spec, 1346, AlonMaor14
* **Feature Store**: Move feature enrichment/imputing into `get_online_features`, 1356, yaronha
* **API**: Checking project existence in secret-related APIs, 1372, theSaarco
* **Requirements**: Bump storey and frames, 1373, dinal
* **DB**: Support using MySQL, 1200, quaark
* **SDK+API**: Enrich runtimes with access key instead of session, 1357, Hedingber
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc4#features-and-enhancements)

Bug fixes
* **Requirements**: Change `fastapi` to `~=0.67.0` to fix docs generation bug, 1377, eyalsol
* **Utils**: Fix hub templating, 1379, Hedingber
* **Docs**: Update tutorial to support air-gapped networks, 1375, gilad-shaham
* **Model Monitoring**: Delete model endpoints project resources, 1365, eyalsol
* **Docs**: Fix feature store demo serving monitoring code, 1360, gilad-shaham
* **System Tests**: Fix import bug, 1368, Hedingber
* **Automation**: Make release notes generator more forgiving, 1367, Hedingber
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc4#bug-fixes)


Pull requests:
eea4bd97 [System Tests] Fix imports (1384)
e746e9c5 [System Tests] Add API requirements (1383)
e23c0209 [Requirements] Align pymysql specifiers (1382)
422a2f3d [Secrets] Data-stores to use project secrets for credentials if configured (1369)
5ad6f5d0 [Docs] Model Monitoring dashboards update toward automated setup (1376)
497327ce [Requirements] Change `fastapi` to `~=0.67.0` to fix docs generation bug (1377)
48013dbd [Nuclio] Support env variables from k8s secrets in config spec (1346)
1dd4bd12 [Feature Store] Move feature enrichment/imputing into `get_online_features` (1356)
f8f2f904 [Utils] Fix hub templating (1379)
340c7d71 [API] Checking project existence in secret-related APIs (1372)
fb76f205 [Docs] Update tutorial to support air-gapped networks (1375)
bf935189 [Requirements] Bump storey and frames (1373)
a9eb4232 [DB] Support using MySQL (1200)
03225a73 [SDK+API] Enrich runtimes with access key instead of session (1357)
8d3ede2f [Model Monitoring] Delete model endpoints project resources (1365)
ffee6ab4 [Docs] Fix feature store demo serving monitoring code (1360)
5fdc6138 [System Tests] Fix import bug (1368)
89094d09 [Automation] Make release notes generator more forgiving (1367)

Features / Enhancements
* **API**: Restructure auth code, 1361, Hedingber
* **API**: Remove projects summary format & optimize counters calculation to happen in parallel, 1347, Hedingber
* **Requirements**: Bump fastapi to 0.68.x, 1352, Hedingber
* **Config**: Support configuring hub url without template, 1349, Hedingber
* **Projects**: Support owner filter in follower mode, 1348, Hedingber
* **Serving**: Support for graph step input/result redirection, 1330, yaronha
* **API**: Add schedules and pipelines counters to project summary & create project summary endpoints, 1342, Hedingber
* **Serving**: Support fn.add_model() in flow topologies, 1341, yaronha
* **Projects**: Add after() to local pipeline build/deploy ops, 1340, yaronha
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc3#features-and-enhancements)

Bug fixes
* **API**: Fix leader format in list projects endpoint, 1366, Hedingber
* **System Tests**: Fix model monitoring metrics testing, 1359, eyalsol
* **Model Monitoring**: Set user access key to `delete_endpoint_record`, 1354, eyalsol
* **Serving**: Fix async input_path bug in RemoteStep, 1355, yaronha
* **System tests**: Model monitoring test fix, 1351, eyalsol
* **Model Monitoring**: Pass access key in a different header, 1353, Hedingber
* **All**: Don't default function argument to config value, 1350, Hedingber
* **Model Monitoring**: Scheduled job's function url is moved to `spec`, 1343, eyalsol
* **Tests**: Azure blob env tests were always skipped, 1339, theSaarco
* **Serving**: Fix node selectors and priority class name support, 1334, AlonMaor14
* **Feature Store**: Setting function db connection to enable saving in ingest API flow, 1338, theSaarco
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc3#bug-fixes)


Pull requests:
e6b00000 [API] Fix leader format in list projects endpoint (1366)
9660289d [SDK] Fix setup.py to include missing packages (1363)
7be8adea [API] Restructure auth code (1361)
67aba358 [System Tests] Fix model monitoring metrics testing (1359)
6001e603 [Model Monitoring] Set user access key to `delete_endpoint_record` (1354)
d07e57f6 [Serving] Fix async input_path bug in RemoteStep (1355)
c4f6b74b [System tests] Model monitoring test fix (1351)
6fe42fd6 [Model Monitoring] Pass access key in a different header (1353)
5287967d [API] Remove projects summary format & optimize counters calculation to happen in parallel (1347)
2a6349a8 [Requirements] Bump fastapi to 0.68.x(1352)
a144858f [All] Don't default function argument to config value (1350)
53c3f495 [Config] Support configuring hub url without template (1349)
536ecd4e [Projects] Support owner filter in follower mode (1348)
d51ab290 [Serving] Support for graph step input/result redirection (1330)
9b7beace [System Tests] Download the model to accessible path to the serving function (1345)
cf4a31fd [Model Monitoring] Scheduled job's function url is moved to `spec` (1343)
ea6ef9d0 [API] Add schedules and pipelines counters to project summary & create project summary endpoints (1342)
8bce594d [Serving] Support fn.add_model() in flow topologies (1341)
68bfd479 [Projects] Add after() to local pipeline build/deploy ops (1340)
d8d58538 [Tests] Azure blob env tests were always skipped (1339)
57704da4 [Serving] Fix node selectors and priority class name support (1334)
8115bee5 [Feature Store] Setting function db connection to enable saving in ingest API flow (1338)

Features / Enhancements
* **Docs**: Update fraud end-to-end demo, 1332, gilad-shaham
* **Makefile**: Add option to disable cache, 1336, Hedingber
* **Feature Store**: Add kafka source to ingestion service, 1241, dinal
* **Docs**: Update model monitoring example, 1329, eyalsol
* **Tests**: Add test to enforce requirement specifiers convention, 1328, Hedingber
* **API**: Make data migrations configurable, 1324, Hedingber
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc2#features-and-enhancements)

Bug fixes
* **Model Monitoring**: Don't explode in list endpoints endpoint on project w/o endpoints, 1337, eyalsol
* **Docs**: Update getting-started tutorial to align with recent MLRun improvements, 1333, gilad-shaham
* **Utils**: Fix unanchored github links, 1331, gtopper
* **CI**: Fix periodic system tests, 1326, Hedingber
* **Serving**: Fix `context.get_remote_endpoint()` to return url from function name, 1325, yaronha
* **Serving**: Fix and enhance remote graph steps, 1319, yaronha
* **Docs**: Fix images Readme's, 1323, Hedingber
* **CI**: Trigger build workflow on new version release, 1320, Hedingber
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc2#bug-fixes)


Pull requests:
6336baf6 [Docs] Update fraud end-to-end demo (1332)
82a332fd [Model Monitoring] Don't explode in list endpoints endpoint on project w/o endpoints (1337)
07b45b37 [Makefile] Add option to disable cache (1336)
d10437b7 [CI] Fix open source system tests (1335)
23a72a3c [Docs] Update getting-started tutorial to align with recent MLRun improvements (1333)
b6e18050 [Feature Store] Add kafka source to ingestion service (1241)
7fb7e4a2 [Utils] Fix unanchored github links (1331)
3d04dda1 [Docs] Update model monitoring example (1329)
92ffc454 [Tests] Add test to enforce requirement specifiers convention (1328)
1ab04b1d [System Tests] Fix imports (1327)
e2269718 [CI] Fix periodic system tests (1326)
80ac4e0d [Serving] Fix `context.get_remote_endpoint()` to return url from function name (1325)
b0fff2cc [Serving] Fix and enhance remote graph steps (1319)
78a392a6 [Docs] Fix images Readme's (1323)
9a1639ea [API] Make data migrations configurable (1324)
9231a1a4 [CI] Wait for pypi release before triggering build workflow + trigger mlrun/ui as well (1322)
ea3bc3e2 [CI] Trigger build workflow on new version release (1320)

Features / Enhancements
* **Sparkjob**: Support dynamic allocation & node selector for driver/executor, 1317, urihoenig
* **Runtimes**: Infrastructure for performing auto-mount when UI submits jobs, 1280, theSaarco
* **Requirements**: Bump v3io-frames to 0.9.3, 1315, Hedingber
* **Secrets**: Auto add k8s project secrets, 1301, theSaarco
* **Sparkjob**: Allow priority classes in spark 3, 1311, urihoenig
* **Requirements**: Bump storey 0.8.0, 1306, dinal
* **Docs**: Update model monitoring example, 1309, eyalsol
* **System Tests**: Add tests for model monitoring, 1302, eyalsol
* **Sparkjob**: Add support for spark operator 3, 1246, urihoenig
* **UI**: [Features & enhancement](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc1#features-and-enhancements)

Bug fixes
* **API**: Fix get pipeline endpoint OPA validation and project enrichment, 1314, Hedingber
* **Runtimes**: Keep order in valid pod priority class names list, and rename methods, 1313, AlonMaor14
* **Feature Store**: Add owner to ingest api, 1305, theSaarco
* **Model Monitoring**: Relieve checks to infer columns from data, 1304, eyalsol
* **Feature Store**: Modify `get_stats_table` to support bool and on spark to drop 50% column, 1300, benbd86
* **Runtimes**: Explode when invalid auto-mount is configured, 1296, theSaarco
* **UI**: [Bug fixes](https://github.com/mlrun/ui/releases/tag/v0.8.0-rc1#bug-fixes)


Pull requests:
6fb90a4d [Sparkjob] Support dynamic allocation & node selector for driver/executor (1317)
b3fedefc [Tests] Fix `test_submit_job_auto_mount` (1318)
121d843a [Runtimes] Infrastructure for performing auto-mount when UI submits jobs (1280)
4c967d19 [Requirements] Bump v3io-frames to 0.9.3 (1315)
6a573529 [Secrets] Auto add k8s project secrets (1301)
d3e62876 [Config] Revert config refactor (1316)
ef9ded72 [API] Fix get pipeline endpoint OPA validation and project enrichment (1314)
c8d9b2d5 [Runtimes] Keep order in valid pod priority class names list, and rename methods (1313)
e7a91a41 [Sparkjob] Allow priority classes in spark 3 (1311)
2efac2e5 [Requirements] Add scikit-learn to system tests requirements (1310)
b3dd3f28 [Requirements] Bump storey 0.8.0 (1306)
2242c3be [Docs] Update model monitoring example (1309)
aaaab86a [Feature Store] Add owner to ingest api (1305)
cbba27b1 [SDK] Fix `setup.py` to include missing packages (1308)
71d465ac [System Tests] Add tests for model monitoring (1302)
6ec3cd4c [Model Monitoring] Relieve checks to infer columns from data (1304)
eb88de91 [Feature Store] Modify `get_stats_table` to support bool and on spark to drop 50% column (1300)
1311e518 [Config] Refactor and duplicate to several sub modules (1270)
a5716dbe [Sparkjob] Add support for spark operator 3 (1246)
be533fdf [Runtimes] Explode when invalid auto-mount is configured (1296)