Sparkmagic

Updates

- Officially drop support for Python 3.6. Sparkmagic will not guarantee Python 3.6 compatibility moving forward.
- Re-format all code with [`black`](https://black.readthedocs.io/en/stable/index.html) and validate via CI

Bug Fixes

- Fixed, simplified, and sped up the sparkmagic Docker images for local development and testing
- Adds support for `ipython>=8`
- Adds support for `ipykernel>=6`

Bug Fixes

- Pins `ipython<8.0.0` because of breaking changes. Thanks utkarshgupta137

Bug Fixes

- Pins `ipykernel<6.0.0` because of breaking changes

Updates

- Migrate from Travis to Github Actions for CI

Features

- Added one internal magic to enable retry of session creation. Thanks edwardps
- New `%%pretty` magic for pretty printing a dataframe as an HTML table. Thanks hegary
- Update Endpoint widget to shield passwords when entering them in the ipywidget. Thanks J0rg3M3nd3z jodom961

Updates

- Officially drop support for Python 2. Sparkmagic will not guarantee Python 2 compatibility moving forward.

Features

- Update Spark, SparkR, and PySpark kernels to include language info and file extension for Jupyterlab LSP compatibility. Thanks skakker
- `KeyboardInterrupt` cancels the Livy statement. Thanks hanyucui
- Add user to %%info output. Thanks tprelle

Bug fixes

- Fix missing url passing when using a custom authenticator [684](https://github.com/jupyter-incubator/sparkmagic/pull/684). Thanks gthomas-slack