Mindsdb

New handlers:
- Mindsdb inference endpoints https://github.com/mindsdb/mindsdb/pull/9044

Features, Improvements and Fixes:
- bump litellm version https://github.com/mindsdb/mindsdb/pull/9064
- Managing knowledge base columns https://github.com/mindsdb/mindsdb/pull/9005
- Integrate rag with langchain agents https://github.com/mindsdb/mindsdb/pull/9027
- Initial RAG 2.0 integration https://github.com/mindsdb/mindsdb/pull/9068
- Option to disable storage backup https://github.com/mindsdb/mindsdb/pull/9073
- Kb updates 04.2024 https://github.com/mindsdb/mindsdb/pull/9069

Documentation Updates:
- Fix typo https://github.com/mindsdb/mindsdb/pull/9065

Features, Improvements and Fixes:
- Add RAG model and utilities for Mindsdb integration https://github.com/mindsdb/mindsdb/pull/8996
- Update requirements.txt https://github.com/mindsdb/mindsdb/pull/9048
- Update requirements.txt https://github.com/mindsdb/mindsdb/pull/9050
- update sampledatabases to new k8s server https://github.com/mindsdb/mindsdb/pull/8986
- The "database" field in the form is changed to not required. https://github.com/mindsdb/mindsdb/pull/9052
- Fixed Column Structure of chat_messages Table https://github.com/mindsdb/mindsdb/pull/9015
- Fix BYOM engine create https://github.com/mindsdb/mindsdb/pull/9054
- Clear LAST value in editor https://github.com/mindsdb/mindsdb/pull/9049
Documentation Updates:
- updated agents docs https://github.com/mindsdb/mindsdb/pull/9058
- updated broken links in mongo docs https://github.com/mindsdb/mindsdb/pull/9059
- Feature/update dd docs https://github.com/mindsdb/mindsdb/pull/9062

What's Changed
* removing redundant package lists and sentence-transformers library by QuantumPlumber in https://github.com/mindsdb/mindsdb/pull/8971
* Safe extraction for all tar files by StpMax in https://github.com/mindsdb/mindsdb/pull/8928
* Fix tarfile safe extract by StpMax in https://github.com/mindsdb/mindsdb/pull/9000
* Refactor Langchain Handler by tmichaeldb in https://github.com/mindsdb/mindsdb/pull/8998
* Tests for sql features by ea-rus in https://github.com/mindsdb/mindsdb/pull/8952
* Update query format in quickstart-tutorial.mdx by vlad-ro in https://github.com/mindsdb/mindsdb/pull/9011
* [404] fix url in huggingface_inference_api.mdx by ArnavK-09 in https://github.com/mindsdb/mindsdb/pull/9016
* Fix hardcoded API base by ZoranPandovski in https://github.com/mindsdb/mindsdb/pull/9019
* Added Check for Import Errors When Running CREATE MODEL Statement by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9020
* updated hostname of sample dbs by martyna-mindsdb in https://github.com/mindsdb/mindsdb/pull/9025
* Fixed Installation of Dependencies for Integrations That Refer to Other requirements.txt Files by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9022
* fixed slack chatbot tutorial by martyna-mindsdb in https://github.com/mindsdb/mindsdb/pull/9026
* Fix delete from table in database by ea-rus in https://github.com/mindsdb/mindsdb/pull/9017
* Added File Path and URL Support to the Vertex AI Integration by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9007
* clean up handler install log messages by hamishfagg in https://github.com/mindsdb/mindsdb/pull/8720
* Docker build improvements by hamishfagg in https://github.com/mindsdb/mindsdb/pull/8999
* Add 'seed db' function to MSSQL tests by hamishfagg in https://github.com/mindsdb/mindsdb/pull/8742
* Fixed Installation of Dependencies for Integrations That Refer to requirements.txt Files (Docker-supported) by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9034
* Fixed Installation of Dependencies When requirements.txt Files Contain Comments by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9038
* Fixed the Initializer for the EventStoreDB Integration by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9029
* Fixed Unused Imports and Dependencies in Rockset Integration by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9031
* updated email integration docs by martyna-mindsdb in https://github.com/mindsdb/mindsdb/pull/9035
* Make alembic use mindsdb log level by hamishfagg in https://github.com/mindsdb/mindsdb/pull/9028
* Bump version for release by hamishfagg in https://github.com/mindsdb/mindsdb/pull/9041
* Fix LAST with slack by ea-rus in https://github.com/mindsdb/mindsdb/pull/9036
* Updated LightFM Integration Docs with Tip to Install Linux Dev Pakcages by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9042
* updated ollama docs by martyna-mindsdb in https://github.com/mindsdb/mindsdb/pull/8995
* Updated Snowflake Integration Docs with Tip to Install Git by MinuraPunchihewa in https://github.com/mindsdb/mindsdb/pull/9032

New Contributors
* vlad-ro made their first contribution in https://github.com/mindsdb/mindsdb/pull/9011
* ArnavK-09 made their first contribution in https://github.com/mindsdb/mindsdb/pull/9016

**Full Changelog**: https://github.com/mindsdb/mindsdb/compare/v24.3.5.0...v24.4.2.0

Features, Improvements and Fixes:
- create prometheus dir if it doesnt exist https://github.com/mindsdb/mindsdb/pull/8991
- add default handlers to manifest and fix pip install test https://github.com/mindsdb/mindsdb/pull/8989
- agent behaves as model https://github.com/mindsdb/mindsdb/pull/8984
- Fix image tags https://github.com/mindsdb/mindsdb/pull/8979
- Add Local Ollama Model Support to Langchain Handler https://github.com/mindsdb/mindsdb/pull/8978
- Sets the 'success' Attribute of /<handler_name>/install Endpoint to False Upon Installation Failure https://github.com/mindsdb/mindsdb/pull/8977
- Add Support for Querying Agents via SQL https://github.com/mindsdb/mindsdb/pull/8856
- New /tabs routes https://github.com/mindsdb/mindsdb/pull/8898
- added ollama_serve_url argument to overwrite hardcoded default URL and validated linux compatability https://github.com/mindsdb/mindsdb/pull/8914
- Updated the Broken Dependencies for the BigQuery Handler https://github.com/mindsdb/mindsdb/pull/8910
- Github handler: all tables converted to APIResource https://github.com/mindsdb/mindsdb/pull/8940
- Del stream interface https://github.com/mindsdb/mindsdb/pull/8967
Documentation Updates:
- updated mindsdb editor image in docs https://github.com/mindsdb/mindsdb/pull/8982
- mindsdb sql updates for docs https://github.com/mindsdb/mindsdb/pull/8939
- updated docker docs https://github.com/mindsdb/mindsdb/pull/8938

- fixed docker image tag

Features, Improvements and Fixes:
* [ENH] Code and contextual QA formatters for LLM finetuning https://github.com/mindsdb/mindsdb/pull/8759
* Fixes for Issue 8565 https://github.com/mindsdb/mindsdb/pull/8567
* Refactor email handler https://github.com/mindsdb/mindsdb/pull/8794
* clean up docker/docker-compose and comment https://github.com/mindsdb/mindsdb/pull/8798
* Add 12labs handler to cloud https://github.com/mindsdb/mindsdb/pull/8804
* Improve email ingestion and handling in MindsDB https://github.com/mindsdb/mindsdb/pull/8803
* Added insert method for email campaigns table https://github.com/mindsdb/mindsdb/pull/8698
* Skills updates https://github.com/mindsdb/mindsdb/pull/8765
* Refactor docker bake file https://github.com/mindsdb/mindsdb/pull/8763
* Improve error message if model in 'error' status https://github.com/mindsdb/mindsdb/pull/8827
* Fix create ml engine https://github.com/mindsdb/mindsdb/pull/8830
* Fix `describe` of broken openai model https://github.com/mindsdb/mindsdb/pull/8829
* Fix: JOIN model with empty dataframe https://github.com/mindsdb/mindsdb/pull/8843
* PR for small fixes on hachaton https://github.com/mindsdb/mindsdb/pull/8833
* Fix `describe` for models with 'broken' ml_engines https://github.com/mindsdb/mindsdb/pull/8839
* Validate api key during OpenAI or Anyscale-endpoints ml_engine creation https://github.com/mindsdb/mindsdb/pull/8847
* Validate the timegpt token https://github.com/mindsdb/mindsdb/pull/8841
* Add multi environment deploy step https://github.com/mindsdb/mindsdb/pull/8836
* add deploy to staging when mergeing to staging branch https://github.com/mindsdb/mindsdb/pull/8852
* Fix show command https://github.com/mindsdb/mindsdb/pull/8849
* Adding icon.svg file for writer handler https://github.com/mindsdb/mindsdb/pull/8859
* Removed Non-integrations from the /handlers Endpoint https://github.com/mindsdb/mindsdb/pull/8862
* Fixed Several Unusable Handlers https://github.com/mindsdb/mindsdb/pull/8864
* Added Support for Summarization to the Twelve Labs Integration https://github.com/mindsdb/mindsdb/pull/8795
* Make Langchain Handler More Reliable https://github.com/mindsdb/mindsdb/pull/8844
* Add /completions POST Endpoint for Agent Completions https://github.com/mindsdb/mindsdb/pull/8850
* [ENH] Updates to langchain: version bump, observability https://github.com/mindsdb/mindsdb/pull/8785
* Getting anyscale key instead openai https://github.com/mindsdb/mindsdb/pull/8800
* Skills decoupling https://github.com/mindsdb/mindsdb/pull/8792
* Updated icons for TPOT and StatsForecast https://github.com/mindsdb/mindsdb/pull/8872
* Slack list messages updated https://github.com/mindsdb/mindsdb/pull/8796
* Don't pickle exception, wrap it https://github.com/mindsdb/mindsdb/pull/8866
* Make `langchain_community` dependency optional https://github.com/mindsdb/mindsdb/pull/8875
* Mark `files` handler as permanent https://github.com/mindsdb/mindsdb/pull/8879
* fix `github_tables` filtering https://github.com/mindsdb/mindsdb/pull/8881
* Make web handler optional https://github.com/mindsdb/mindsdb/pull/8880
* Twelvelabs Integration fixes https://github.com/mindsdb/mindsdb/pull/8883
* Fixed the Import of MatrixOneHandler in D0lt Handler https://github.com/mindsdb/mindsdb/pull/8886
* Fix last: one condition in view https://github.com/mindsdb/mindsdb/pull/8867
* Add auth flag in the config example https://github.com/mindsdb/mindsdb/pull/8888
* Anomaly detection process data bug https://github.com/mindsdb/mindsdb/pull/8897
* Fix warning about flask JSONEncoder deprecation https://github.com/mindsdb/mindsdb/pull/8869
* Init load tests https://github.com/mindsdb/mindsdb/pull/8730
* anthropic to use messages api (instead of legacy completions api) https://github.com/mindsdb/mindsdb/pull/8885
* Removed Icons as Determining Factor for Handler Import Status https://github.com/mindsdb/mindsdb/pull/8909
* Updated the Broken Dependencies for the BigQuery Handler https://github.com/mindsdb/mindsdb/pull/8910
* Add Support for Prometheus Metrics & Add New Handler Metrics https://github.com/mindsdb/mindsdb/pull/8899
* fix for email handler to work in jobs with last https://github.com/mindsdb/mindsdb/pull/8913
* Fix failing coveralls action https://github.com/mindsdb/mindsdb/pull/8917
* Fix `select connection_id()` https://github.com/mindsdb/mindsdb/pull/8920
* Added Improved Logos for Integrations https://github.com/mindsdb/mindsdb/pull/8854
* Add `jobs_history` to `log` db https://github.com/mindsdb/mindsdb/pull/8793
* Bump follow-redirects from 1.15.5 to 1.15.6 in /docs https://github.com/mindsdb/mindsdb/pull/8932
* Fix supported python versions for pip installs https://github.com/mindsdb/mindsdb/pull/8905
* Json operators support https://github.com/mindsdb/mindsdb/pull/8895
* fix setup limits https://github.com/mindsdb/mindsdb/pull/8937
* Add Prometheus Metrics for All API Endpoints https://github.com/mindsdb/mindsdb/pull/8904
* Include prometheus_metrics Dir in Dockerfile https://github.com/mindsdb/mindsdb/pull/8944

Documentation Updates:
* Typo "mbd" vs "mdb" https://github.com/mindsdb/mindsdb/pull/8736
* Update README.md - tweak messaging https://github.com/mindsdb/mindsdb/pull/8797
* [Docs] update mongo doc: replace `insert`->`insertOne`, `predictors`->`models https://github.com/mindsdb/mindsdb/pull/8802
* fixed api_key param names https://github.com/mindsdb/mindsdb/pull/8809
* added info to finetune commands https://github.com/mindsdb/mindsdb/pull/8808
* docs for evaluate by https://github.com/mindsdb/mindsdb/pull/8807
* update to rest api docs https://github.com/mindsdb/mindsdb/pull/8810
* docs rearranged and modified intro pages https://github.com/mindsdb/mindsdb/pull/8811
* Cleanup docs https://github.com/mindsdb/mindsdb/pull/8825
* added a note that create table needs database with write access https://github.com/mindsdb/mindsdb/pull/8832
* Update Anomaly detection docs https://github.com/mindsdb/mindsdb/pull/8834
* added eeg forecast tutorial https://github.com/mindsdb/mindsdb/pull/8835
* tutorial for learning hub https://github.com/mindsdb/mindsdb/pull/8837
* fixed query in tutorial https://github.com/mindsdb/mindsdb/pull/8840
* updated tutorials for learning hub https://github.com/mindsdb/mindsdb/pull/8845
* added data file to openai finetuning tutorial https://github.com/mindsdb/mindsdb/pull/8853
* update file link https://github.com/mindsdb/mindsdb/pull/8855
* fixed slack chatbot tutorial https://github.com/mindsdb/mindsdb/pull/8868
* Less redundant doc example https://github.com/mindsdb/mindsdb/pull/8873
* fixed github docs https://github.com/mindsdb/mindsdb/pull/8877
* fixed anthropic model names in docs https://github.com/mindsdb/mindsdb/pull/8884
* Update README.md https://github.com/mindsdb/mindsdb/pull/8887
* Update README.md https://github.com/mindsdb/mindsdb/pull/8889
* Update monkeylearn.mdx https://github.com/mindsdb/mindsdb/pull/8891
* Update README.md https://github.com/mindsdb/mindsdb/pull/8901
* updated middleware to platform https://github.com/mindsdb/mindsdb/pull/8894
* added links to use cases https://github.com/mindsdb/mindsdb/pull/8912
* update to docker docs https://github.com/mindsdb/mindsdb/pull/8916
* updated slack docs https://github.com/mindsdb/mindsdb/pull/8921
* Update MindsDB Installation for Development docs https://github.com/mindsdb/mindsdb/pull/8908
* updating ai engines doc pages https://github.com/mindsdb/mindsdb/pull/8799