Cloudfeaster

Added

* generate cloudfeaster and cloudfeaster-lite docker images which
can be used as the basis for building docker images of spiders

Changed

* remove extra whitespace EO generate-circleci-config.py output
* spiders.py output now includes a _metadata property

Removed

* Nothing

Added

* added spiders.py to enable infrastructure spider discovery
* added get-clf-version.sh the encapsulate the pattern of parsing setup.py
to extract the cloudfeaster version
* added runtime docker image for running spiders

Changed

* _metadata.spider.name in spider output is now name of file containing spider
rather than spider's class name. This change was made as a result of learning more
about the spider hosting infrastructure.
* selenium 3.14.0 -> 3.141.0
* generate-circleci-config.py now generates a CircleCI config file that packages
all spiders in a docker image
* install-chromedriver.sh now install ChromeDriver version based
on Google Chrome version

Removed

* removed Browser.wait_for_login_to_complete() and Browser.wait_for_signin_to_complete()
because they used an old sync pattern and the methods really weren't being used anymore

Added

* add CircleCI docker executor [authenticated pull](https://circleci.com/docs/2.0/private-images/)
* per [this](https://discuss.circleci.com/t/old-linux-machine-image-remote-docker-deprecation/37572) article, added
explicit version to setup_remote_docker in CircleCI pipeline
* add CircleCI docker executor [authenticated pull](https://circleci.com/docs/2.0/private-images/)
for CircleCI config generated by generate-circleci-config.py

Changed

* Nothing

Removed

* Nothing

Added

* Nothing

Changed

* logging level in generate-circleci-config.py changed from INFO
to DEBUG which is intended to make it simplier to debug CI pipeline
crawl failures

Removed

* Nothing

Added

* Nothing

Changed

* fix: generate-circleci-config.py which was generating references
to the docker image simonsdave/cloudfeaster-bionic-dev-env
instead of simonsdave/cloudfeaster-dev-env
* fix: docker image badge in main README.md

Removed

* Nothing

Added

* add [clair-cicd](https://github.com/simonsdave/clair-cicd) docker image vulnerability
assessment to CircleCI pipeline
* add [LGTM](https://lgtm.com/) badges to main README.md

Changed

* dev-env 0.6.10 -> 0.6.11
* changes to generate-circleci-config.py to improve reliability of capturing
crawl results when crawls fail

Removed

* Nothing