Rsmtool

What's Changed
* Python 3.8 and 3.9 are no longer supported since the [SKLL](https://github.com/EducationalTestingService/skll) dependency was updated to v5.0.1.
* Remove rsmextra and special sections by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/676
* Add type hints (part 1) by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/677
* Add type hints (Part 2) by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/679
* Add type hints (Part 3) by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/681
* Add Type Hints (Part 4) by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/682
* Add Type Hints (Final Part) by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/683
* Fix pandas-related warnings by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/684
* Separate runtime and dev dependencies by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/685

**Full Changelog**: https://github.com/EducationalTestingService/rsmtool/compare/v11.3.0...v12.0.0

💡 New features 💡
-------------------
* Add section ordering for `rsmexplain` by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/667
* Update intermediate files notebook section for readability by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/670

🛠️ Bugfixes & Improvements 🛠️
-------------------------------
* Update SHAP to the latest version 0.44.0 by damien2012eng in https://github.com/EducationalTestingService/rsmtool/pull/664
* Unpin dependencies and fix minor issues by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/666
* Fix new warnings & remove manual suppressions by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/668
* Refactor CLI tests to modernize codecov by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/669
* Pin numpy to < 2 by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/673

🙏🏽 Contributions & Code Reviews 🙏🏽
------------------------------------
damien2012eng
desilinguist
Frost45
mulhod
tamarl08

**Full Changelog**: https://github.com/EducationalTestingService/rsmtool/compare/v11.2.0...v11.3.0

💡 New features 💡
-------------------
* Add sections for W&B logging to make information easier to find by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/659
* Add configuration option to disable truncation of outliers by damien2012eng in https://github.com/EducationalTestingService/rsmtool/pull/661

🛠️ Bugfixes & Improvements 🛠️
-------------------------------
* Fix bugs when processing cross-validation folds in `rsmxval` by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/662

🙏🏽 Contributions & Code Reviews 🙏🏽
------------------------------------
damien2012eng
desilinguist
mulhod
tamarl08


**Full Changelog**: https://github.com/EducationalTestingService/rsmtool/compare/v11.1.1...v11.2.0

:bulb: New features :bulb:
* Add a new human-human confusion matrix for double-scored data by mulhod in https://github.com/EducationalTestingService/rsmtool/pull/649
* Allow prallelization of grid search when using SKLL models in `rsmtool` by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/650
:hammer_and_wrench: Bugfixes & Improvements :hammer_and_wrench:
* Update pre-commit checks by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/647
* Enhance wandb logging of evaluation metrics by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/651
* Fix warnings in reports by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/654


🙏🏽 Contributions & Code Reviews 🙏🏽
damien2012eng
desilinguist
mulhod
tamarl08
tazin-afrin

**Full Changelog**: [v11.0.1...v11.1.1](https://github.com/EducationalTestingService/rsmtool/compare/v11.0.1...v11.1.1)

:bulb: New features :bulb:

* New rsmexplain plots by damien2012eng in https://github.com/EducationalTestingService/rsmtool/pull/603
* Full W&B integration to allow logging of output artifacts and report by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/617, https://github.com/EducationalTestingService/rsmtool/pull/620, https://github.com/EducationalTestingService/rsmtool/pull/621, https://github.com/EducationalTestingService/rsmtool/pull/623, https://github.com/EducationalTestingService/rsmtool/pull/627
* Add FAQ page to documentation by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/622
* Add support for Python 3.11 by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/628
* Add support for output files when auto-generating configurations by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/640
* Enhancements to fast_predict by mulhod in https://github.com/EducationalTestingService/rsmtool/pull/632
* **NOTE**: The `.model` files produced by `rsmtool` are no longer SKLL model files. They are serialized `rsmtool.Modeler` objects. This change should be transparent to the users if the only places they use the `.model` files are with `rsmpredict` and `rsmexplain`. However, if those files are used *outside* of RSMTool and expected to contain SKLL learners, then the following change is needed: users would now need to use the `Modeler.load_from_file()` method to load the `.model` file produced by `rsmtool` and then access the SKLL learner via the `.learner` attribute.

:hammer_and_wrench: Bugfixes & Improvements :hammer_and_wrench:

* Migrate nose to nose2 by damien2012eng in https://github.com/EducationalTestingService/rsmtool/pull/610
* Upgrade `shap` by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/612
* Use example IDs when specifying `sample_ids` by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/613
* Expect `scale_with` value of 'raw' in rsmeval by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/614
* Fix `update_files` for `nose2`. by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/616
* Fix bug in wording of what will be highlighted for disattenuated correlation by mulhod in https://github.com/EducationalTestingService/rsmtool/pull/594
* Pin skll version in doc requirements by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/619
* Remove unnecessary warnings in HTML reports. by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/624
* Include system information in RSMExplain reports by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/633
* Suppress alt text warnings when generating reports by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/634
* Fix W&B tests and add to CI builds. by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/637
* Switch to `ruff` for pre-commit checks by desilinguist in https://github.com/EducationalTestingService/rsmtool/pull/639
* Fix test dir usage in test_wandb by tamarl08 in https://github.com/EducationalTestingService/rsmtool/pull/642

🙏🏽 Contributions & Code Reviews 🙏🏽
* tamarl08
* mulhod
* damien2012eng
* dblandan
* Frost45
* blongwill

**Full Changelog**: https://github.com/EducationalTestingService/rsmtool/compare/v10.0.0...v11.0.1

This is a major new release! It includes new functionality as well as updated dependencies.️
:bulb: New features :bulb:
Dependencies

- [Shap](https://shap.readthedocs.io/en/latest/) is now a required dependency. It is currently pinned to 0.41.0 but we plan to keep RSMTool updated with the latest SHAP versions as they are released.
- Numpy has been pinned to <= 1.23.5 since SHAP 0.41.0 does not work with numpy 1.24.x.

RSMExplain

- Added new command-line utility `rsmexplain` to generate an explanation report for an existing rsmtool experiment. Underlyingly, `rsmexplain` leverages SHapley Additive exPlanations produced by `shap`.
- Added comprehensive documentation on how to run `rsmexplain`.
- Added support for automated and interactive configuration generation for `rsmexplain`.
- Add comprehensive functional tests for `rsmexplain`.

More reliable notebook merging

- Updated `rsmtool.reporter.merge_notebooks()` to use `nbconvert` and `nbformat` APIs instead of the JSON-based hack that was being used before.

:hammer_and_wrench: Bugfixes & Improvements :hammer_and_wrench:

- Use `legend_handles` instead of the deprecated `legendHandles` attribute for matplotlib to avoid deprecation warnings in notebooks.
- Minor documentations fixes in various places.

Contributions from: damien2012eng, desilinguist, tamarl08, dblandan, and mulhod!