Demisto-sdk

* Added the `types-markdown` dependency, adding markdown capabilities to existing linters using the [Markdown](https://pypi.org/project/Markdown/) package.
* Added support in the **format** command to remove nonexistent incident/indicator fields from *layouts/mappers*
* Added the `Note: XXX` and `XXX now generally available.` release notes templates to **doc-review** command.
* Updated the logs shown during the docker build step.
* Removed a false warning about configuring the `GITLAB_TOKEN` environment variable when it's not needed.
* Removed duplicate identifiers for XSIAM integrations.
* Updated the *tags* and *use cases* in pack metadata validation to use the local files only.
* Fixed the error message in checkbox validation where the defaultvalue is wrong and added the name of the variable that should be fixed.
* Added types to `find_type_by_path` under tools.py.
* Fixed an issue where YAML files contained incorrect value type for `tests` key when running `format --deprecate`.
* Added a deprecation message to the `tests:` section of yaml files when running `format --deprecate`.
* Added use case for **validate** on *wizard* objects - set_playbook is mapped to all integrations.
* Added the 'integration-get-indicators' commands to be ignored by the **verify_yml_commands_match_readme** validation, the validation will no longer fail if these commands are not in the readme file.
* Added a new validation to the **validate** command to verify that if the phrase "breaking changes" is present in a pack release notes, a JSON file with the same name exists and contains the relevant breaking changes information.
* Improved logs when running test playbooks (in a build).
* Fixed an issue in **upload** did not include list-type content items. nicolas-rdgs
* Reverted release notes to old format.

* Added debug print when excluding item from ID set due to missing dependency.
* Added a validation to the **validate** command, failing when non-ignorable errors are present in .pack-ignore.
* Fixed an issue where `mdx server` did not close when stopped in mid run.
* Fixed an issue where `-vvv` flag did not print logs on debug level.
* enhanced ***validate*** command to list all command names affected by a backward compatibility break, instead of only one.
* Added support for Wizard content item in the **format**, **validate**, **upload**, **create-id-set**, **find-dependecies** and **create-content-artifacts** commands.
* Added a new flag to the **validate** command, allowing to run specific validations.
* Added support in **unify** and **create-content-artifacts** for displaying different documentations (detailed description + readme) for content items, depending on the marketplace version.
* Fixed an issue in **upload** where list items were not uploaded.
* Added a new validation to **validate** command to verify that *cliName* and *id* keys of the incident field or the indicator field are matches.
* Added the flag '-x', '--xsiam' to **upload** command to upload XSIAM entities to XSIAM server.
* Fixed the integration field *isFetchEvents* to be in lowercase.
* Fixed an issue where **validate -i** run after **format -i** on an existing file in the repo instead of **validate -g**.
* Added the following commands: 'update-remote-data', 'get-modified-remote-data', 'update-remote-system' to be ignored by the **verify_yml_commands_match_readme** validation, the validation will no longer fail if these commands are not in the readme file.
* Updated the release note template to include a uniform format for all items.
* Added HelloWorldSlim template option for *--template* flag in **demisto-sdk init** command.
* Fixed an issue where the HelloWorldSlim template in **demisto-sdk init** command had an integration id that was conflicting with HelloWorld integration id.
* Updated the SDK to use demisto-py 3.1.6, allowing use of a proxy with an environment variable.
* Set the default logger level to `warning`, to avoid unwanted debug logs.
* The **format** command now validates that default value of checkbox parameters is a string 'true' or 'false'.
* Fixed an issue where `FileType.PLAYBOOK` would show instead of `Playbook` in readme error messages.
* Added a new validation to **validate** proper defaultvalue for checkbox fields.

* Fixed an issue in the **format** command where the `id` field was overwritten for existing JSON files.
* Fixed an issue where the **doc-review** command was successful even when the release-note is malformed.
* Added timestamps to the `demisto-sdk` logger.
* Added time measurements to **lint**.
* Added the flag '-d', '--dependency' to **find-dependencies** command to get the content items that cause the dependencies between two packs.
* Fixed an issue where **update-release-notes** used the *trigger_id* field instead of the *trigger_name* field.
* Fixed an issue where **doc-review** failed to recognize script names, in scripts using the old file structure.
* Fixed an issue where concurrent processes created by **lint** caused deadlocks when opening files.
* Fixed an issue in the **format** command where `_dev` or `_copy` suffixes weren't removed from the subscript names in playbooks and layouts.
* Fixed an issue where **validate** failed on nonexistent `README.md` files.
* Added support of XSIAM content items to the **validate** command.
* Report **lint** summary results and failed packages after reporting time measurements.

* Added the new **generate-yml-from-python** command.
* Added a code *type* indication for integration and script objects in the *ID Set*.
* Added the [Vulture](https://github.com/jendrikseipp/vulture) linter to the pre-commit hook.
* The `demisto-sdk` pack will now be distributed via PyPi with a **wheel** file.
* Fixed a bug where any edited json file that contained a forward slash (`/`) escaped.
* Added a new validation to **validate** command to verify that the metadata *currentVersion* is
the same as the last release note version.
* The **validate** command now checks if there're none-deprecated integration commands that are missing from the readme file.
* Fixed an issue where *dockerimage* changes in Scripts weren't recognized by the **update-release-notes** command.
* Fixed an issue where **update-xsoar-config-file** did not properly insert the marketplace packs list to the file.
* Added the pack name to the known words by default when running the **doc-review** command.
* Added support for new XSIAM entities in **create-id-set** command.
* Added support for new XSIAM entities in **create-content-artifacts** command.
* Added support for Parsing/Modeling Rule content item in the **unify** command.
* Added the integration name, the commands name and the script name to the known words by default when running the **doc-review** command.
* Added an argument '-c' '--custom' to the **unify** command, if True will append to the unified yml name/display/id the custom label provided
* Added support for sub words suggestion in kebab-case sentences when running the **doc-review** command.
* Added support for new XSIAM entities in **update-release-notes** command.
* Enhanced the message of alternative suggestion words shown when running **doc-review** command.
* Fixed an incorrect error message, in case `node` is not installed on the machine.
* Fixed an issue in the **lint** command where the *check-dependent-api-modules* argument was set to true by default.
* Added a new command **generate-unit-tests**.
* Added a new validation to **validate** all SIEM integration have the same suffix.
* Fixed the destination path of the unified parsing/modeling rules in **create-content-artifacts** command.
* Fixed an issue in the **validate** command, where we validated wrongfully the existence of readme file for the *ApiModules* pack.
* Fixed an issue in the **validate** command, where an error message that was displayed for scripts validation was incorrect.
* Fixed an issue in the **validate** and **format** commands where *None* arguments in integration commands caused the commands to fail unexpectedly.
* Added support for running tests on XSIAM machines in the **test-content** command.
* Fixed an issue where the **validate** command did not work properly when deleting non-content items.
* Added the flag '-d', '--dependency' to **find-dependencies** command to get the content items that cause the dependencies between two packs.

* **Breaking change**: Fixed a typo in the **validate** `--quiet-bc-validation` flag (was `--quite-bc-validation`). upstart-swiss
* Dropped support for python 3.7: Demisto-SDK is now supported on Python 3.8 or newer.
* Added an argument to YAMLHandler, allowing to set a maximal width for YAML files. This fixes an issue where a wrong default was used.
* Added the detach mechanism to the **upload** command, If you set the --input-config-file flag, any files in the repo's SystemPacks folder will be detached.
* Added the reattach mechanism to the **upload** command, If you set the --input-config-file flag, any detached item in your XSOAR instance that isn't currently in the repo's SystemPacks folder will be re-attached.
* Fixed an issue in the **validate** command that did not work properly when using the *-g* flag.
* Enhanced the dependency message shown when running **lint**.
* Fixed an issue where **update-release-notes** didn't update the currentVersion in pack_metadata.
* Improved the logging in **test-content** for helping catch typos in external playbook configuration.

* Added dependency validation support for core marketplacev2 packs.
* Fixed an issue in **update-release-notes** where suggestion fix failed in validation.
* Fixed a bug where `.env` files didn't load. nicolas-rdgs
* Fixed a bug where **validate** command failed when the *categories* field in the pack metadata was empty for non-integration packs.
* Added *system* and *item-type* arguments to the **download** command, used when downloading system items.
* Added a validation to **validate**, checking that each script, integration and playbook have a README file. This validation only runs when the command is called with either the `-i` or the `-g` flag.
* Fixed a regression issue with **doc-review**, where the `-g` flag did not work.
* Improved the detection of errors in **doc-review** command.
* The **validate** command now checks if a readme file is empty, only for packs that contain playbooks or were written by a partner.
* The **validate** command now makes sure common contextPath values (e.g. `DBotScore.Score`) have a non-empty description, and **format** populates them automatically.
* Fixed an issue where the **generate-outputs** command did not work properly when examples were provided.
* Fixed an issue in the **generate-outputs** command, where the outputs were not written to the specified output path.
* The **generate-outputs** command can now generate outputs from multiple calls to the same command (useful when different args provide different outputs).
* The **generate-outputs** command can now update a yaml file with new outputs, without deleting or overwriting existing ones.
* Fixed a bug where **doc-review** command failed on existing templates.
* Fixed a bug where **validate** command failed when the word demisto is in the repo README file.
* Added support for adding test-playbooks to the zip file result in *create-content-artifacts* command for marketplacev2.
* Fixed an issue in **find-dependencies** where using the argument *-o* without the argument *--all-packs-dependencies* did not print a proper warning.
* Added a **validate** check to prevent deletion of files whose deletion is not supported by the XSOAR marketplace.
* Removed the support in the *maintenance* option of the *-u* flag in the **update-release-notes** command.
* Added validation for forbidden words and phrases in the **doc-review** command.
* Added a retries mechanism to the **test-content** command to stabilize the build process.
* Added support for all `git` platforms to get remote files.
* Refactored the **format** command's effect on the *fromversion* field:
* Fixed a bug where the *fromversion* field was removed when modifying a content item.
* Updated the general default *fromversion* and the default *fromversion* of newly-introduced content items (e.g. `Lists`, `Jobs`).
* Added an interactive mode functionality for all content types, to ask the user whether to set a default *fromversion*, if could not automatically determine its value. Use `-y` to assume 'yes' as an answer to all prompts and run non-interactively.