Aioradio

* Use spark df.toPandas() function instead of private function converted spark df -> pandas -> polars.

* Avoid instantiating spark if databricks-connect installed.

* Add pyspark back in as install requirement.

* Remove pyspark as an install requirement.

* Add new function promote_model_to_production in ds_utils.
* Update ddtrace==2.6.5.
* Update httpx==0.27.0.
* Update orjson==3.9.15.
* Update pandas==2.2.1.
* Update pyodbc==5.1.0.
* Update polars==0.20.13.
* Update redis==5.0.2.
* Update python to 3.12.2.
* Add .show() to end of spark.sql(...) to display merge statistics.

* Update aioboto3==12.3.0.
* Update boto3==1.34.34.
* Update botocore==1.34.34.
* Update dominodatalab==1.3.0.
* Update fakeredis==2.21.1.
* Update httpx==0.26.0.
* Update polars==0.20.10.
* Update pre-commit==3.6.2.
* Update pytest==8.0.1.
* Update twine==5.0.0.