Sparkmagic

Features

- Customizable Livy authentication methods [662](https://github.com/jupyter-incubator/sparkmagic/pull/662). Thanks alexismacaskilll

Bug fixes

- Fix Dockerfile.jupyter build [672](https://github.com/jupyter-incubator/sparkmagic/pull/672)

Bug fixes

- Fix ContextualVersionConflict in Dockerfile.spark. Thanks Linan Zheng, LinanZheng
- Fix Info Subcommand in RemoteSparkMagic. Thanks Linan Zheng, LinanZheng
- Fix to ignore unsupported spark session types whilst fetching the session list. Thanks, Murat Burak Migdisoglu, mmigdiso

Features

- `cleanup_all_sessions_on_exit` configuration to cleanup all registered livy sessions regardless of whether the process exits gracefully. Thanks Juho Autio, juhoautio
- Add configuration options to for the default `HTTPKerberosAuth` constructor. Thanks Pedro Gonçalves Rossi Rodrigues, PedroRossi

Bug fixes

- Respect the `all_errors_are_fatal` flag and raise an exception if the session fails to start. Thanks Devin Stein, devstein
- Use `requests.Session` to avoid negotiating Kerberos tickets in every request. Thanks Pedro Gonçalves Rossi Rodrigues, PedroRossi

Bug fixes

- Enabled heartbeat by default, so long-running tasks don't time out. Thanks to John Pugliesi for the bug report.
- The PySpark kernel uses Python 3 lexer, instead of Python 2. Python 2 support is going away in the near future.
- Fixed papermill support; there's a different option now you need to use, `all_errors_are_fatal`. See the README for details. Thanks to Devin Stein for the patch.

Other changes

- Fixed silly mistake in the tests.

Features

- Added two configuration options that make it easier to run Sparkmagic notebooks with Papermill. Thanks to Michael Diolosa for the patch.
- Support `text/html` messages from the Livy server; currently Livy/Spark itself don't really do this, but some experimental tools can benefit from this. Thanks to Steve Suh.