Dcicsnovault

=====

* In ``Makefile``:

* Add ``make test-full`` to test like ``make test`` but without the ``instafail`` option.

* Add ``make test-static`` to run static checks.

* Add ``make test-one TEST_NAME=<test_name_or_filename_base>`` so you can test a single file or test from ``make``.
This is not so important in ``snovault`` as in ``cgap-portal`` but I want the interface to be uniform.

* In all testing, added ``SQLALCHEMY_WARN_20=1`` at start of command line to enable SQLAlchemy 2.0
compatibility warnings, since we're using ``SQLAlchemy 1.4``, which has those warnings.

* In ``pyproject.toml``:
* Require ``dcicutils 6,7`` for fixes to ``Eventually``.

* Include ``pipdeptree`` as a dev dependency for debugging.

* Remove "backports.statistics", needed for Python 3.3 support and earlier.

* Bump python_magic foothold (no effective change, just faster locking)

* Update some comments.

* In ``snovault/updater.py``:

* Better error message for UUID integrity errors, noting they might not be conflits but just maybe also UUID missing.

* Rearrange imports for clarity.

* In new file ``snovault/tools.py``:

* New functions ``make_testapp``, ``make_htmltestapp``, ``make_authenticated_testapp``,
``make_submitter_testapp``, ``make_indexer_testapp``, and ``make_embed_testapp``.

* New context managers ``being_nested`` and ``local_collections``.

* New function ``index_n_items_for_testing``.

These functions are potentially useful in the portal repos, so are not part of the test files.

* In file ``snovault/tests/serverfixtures.py``:

* New fixture ``engine``

* In file ``snovault/tests/test_indexing.py``:

* Material changes to testing to use better storage synchronization (semaphor-style rather than sleep-style),
hopefully achieving fewer intermittent errors in testing both locally and in GA.

* Bug fixes in a few tests that were assigning settings or other dictionary structures but not assuring an
undo was done if the test failed.

* In files ``snovault/util.py``, ``snovault/tests/test_embedding.py``, ``snovault/tests/test_storage.py``:

* Various changes for PEP8 or other readability reasons, including to satisfy ``PyCharm`` linters.

* Allow Postgres 14 to be used.

=====

* In ``upgrader.py``, default ``parse_version`` argument to ``'0'``, rather than ``'1'``
when ``None`` or the empty string is given.

* Remove the Python 3.7 classifier in ``pyproject.toml``.

* Add ``make clear-poetry-cache`` in ``Makefile``.

* Misc PEP8.

=====

* Fix C4-984:

* Add ``pip install wheel`` in ``make configure``.

* Remove dependency in ``pyproject.toml`` on ``futures`` library.

* Fix C4-985:

* Make a wrapper for ``pkg_resources.parse_version`` in ``upgrader.py``
that parses the empty string as if ``'1'`` had been supplied.

* Fix C4-987:

* Use ``in str(exc.value)`` rather than ``in str(exc)`` after ``with pytest.raises(....) as exc:``

=====

* Small fix/adjustment to snapshot related error handling when re-mapping

=====

* Supress log errors from skip_indexing
* Suppress errors from SQLAlchemy relationship overlap
* Add reindex_by_type capabilities
* Small changes to indexing tests to speed them up

=====

* Upgrades ElasticSearch to version 7 (OpenSearch 1.3 in production)
* Upgrades SQLAlchemy to 1.4.41 (and other associated versions)
* Adds B-Tree index on max_sid to optimize retrieval of this value in indexing
* Drop support for Python 3.7