Buildtest-framework

------------------------

The following features have been added in 0.1.8

* Automate batch job submission from buildtest via **--submitjob**
* Fix shell magic (!/bin/sh, !/bin/bash, !/bin/csh) for binary test
* Tab completion for buildtest argument using argcomplete module. See https://github.com/HPC-buildtest/buildtest-framework/pull/52/commits/ddb9e426f1b466d3e9b1957a009f0955c236f7a2
* autopopulate choice for --system, --sysyaml, and --software
* Fix output of -svr and resolve bug when 2 modules with same app/version found in different trees. Only in HMNS. See https://github.com/HPC-buildtest/buildtest-framework/pull/52/commits/7ddf91b761f88ddacf0548c7f259b2badd93bdfd for more details
* Group buildtest commands for ease of use.
* Support for yaml keys **scheduler** and **jobslot** to enable jobscript creation from yaml files. See https://github.com/HPC-buildtest/buildtest-framework/pull/52/commits/0fe4189df0694bef586e9d8e4565ec4cc3e169c9
* Further support for scheduler and automatic detection. Currently supports LSF and SLURM.

buildtest 0.1.7 release
-------------------------
- Add support for creating LSF Job scripts via templates. Use **buildtest --job-template** see https://github.com/HPC-buildtest/buildtest-framework/commit/927dc09e347fdafa7020d7cfd3016fd8f430ac10
- Add support for creating YAML config for system package binary testing via **buildtest --sysyaml** see https://github.com/HPC-buildtest/buildtest-framework/commit/4ab8870eddb9da5177b6c414e98f1231d14b35ab
- adding keys envvar, procrange, threadrange in YAML https://github.com/HPC-buildtest/buildtest-framework/commit/9a2152307dbf88943618a0b7ee8f6984de3a5340 https://github.com/HPC-buildtest/buildtest-framework/commit/1524238919be638edc831df6395425f92e46bc2c https://github.com/HPC-buildtest/buildtest-framework/commit/3d43b8a68946c4a376e1645c4ad204c7498ae6c3
- Add support for multiple shell (csh, bash, sh) see https://github.com/HPC-buildtest/buildtest-framework/commit/aea9d6ff06dcc207e84ba0953c53e2cbd67a49fe https://github.com/HPC-buildtest/buildtest-framework/commit/c154db87f876251cc6b2985e8bfb8c2265843216
- remove verbose option from buildtest
- major code refactor see https://github.com/HPC-buildtest/buildtest-framework/commit/fd8d466dc1f009f5822d2161eaf73e85f42a985e https://github.com/HPC-buildtest/buildtest-framework/commit/9d112c0e2e8c6800013eeda7968f568a749f2586
- Fixed a bug during compiler detection when building GCC see https://github.com/HPC-buildtest/buildtest-framework/commit/f139756213a280301771214894c8f48e8bcee4e8
- create a pretty menu for Interactive Testing via **buildtest --runtest** see https://github.com/HPC-buildtest/buildtest-framework/commit/231cfeb0cf88cbc70826a9e76697947d06f0a6e1
- replace shell commands **subprocess.Popen()** with python library equivalents
- Add support for **--testset Tcl** see https://github.com/HPC-buildtest/buildtest-framework/commit/373cc1ea2fb2c5aedcf9ddadf105a94232cc1fa4
- Add support for **--testset Ruby** see https://github.com/HPC-buildtest/buildtest-framework/commit/c6b7133b5fc4b0690b8040d0e437784567cc1963
- Print software in alphabetical order for -svr option see https://github.com/HPC-buildtest/buildtest-framework/commit/fcf61019c644cd305e459234a85c5d39df06433f

Features:
----------
1. Add support for FlatNamingScheme in buildtest, added flag **--module-naming-scheme** to control setting
2. Add prototype functions
- get_appname()
- get_appversion()
- get_toolchain_name()
- get_toolchain_version()

3. Add support for logging via Python Logger module

Bugs:
- Fix buildtest version, in 0.1.5 release buildtest was reporting version 1.0.1
- Provide clean termination when no easyconfig is found
- Fix issue when no toolchain is provided in CMakeList.txt
- Optimize nested loop when performing --software-version-relationship

-------------------------------------

The buildtest repo has been moved from http://github.com/shahzebsiddiqui to http://github.com/HPC-buildtest

* Report what tests can be generated from buildtest through YAML files by using **--scantest**
* Fixed a bug with flag **-svr** that was related to structure of easybuild repo, now no dependency on easybuild repo. Also added pretty output
* Adding CONTRIBUTION page
* Fix out software, toolchain, and easyconfig check is done. Arguments to --software and --toolchain must go through module check, then toolchain check, and then finally easyconfig check
* Add support for **--check-setup** which can be used to determine if buildtest framework is setup properly
* Add interactive testing via **buildtest --runtest** which is menu-driven with ability to run all tests, or run individual test directory in menu and see output
* Fix some issues with --testset and now buildtest reports number of tests generated not the path for each test to limit output. For --testset like R, Python, Perl buildtest will report generated test for each package
* buildtest will now use **eb --list-toolchains** to get list of all toolchains for toolchain check
* Can properly generate tests via --testset when R, Python, and Perl repos were created and moved out of buildtest-configs
* Add **buildtest -V** for version display

There has been lots of restructuring of code. There still needs some improvement for organizing scripts by functions

buildtest 0.1.4 release
-------------------------

Major code restructure around processing binary test and support for logging environment variable
**BUILDTEST_LOGCONTENT**
**BUILDTEST_LOGDIR**
**BUILDTEST_LOGFILE**

Provide get functions to retrieve value from arg.parser https://github.com/shahzebsiddiqui/buildtest/commit/6006027d653401a848628b0dd9d81a98d631f22f

Add support for Perl with --testset https://github.com/shahzebsiddiqui/buildtest/commit/cc96eb9f825bed997a13d8dd13e43e4074ad1b03

Add for more logging support in module and eb verification

------------------------

There have been several changes in the buildtest framework to allow for more capabilities.

The following changes have been done in this release
1. buildtest can generate binary test for same executable with multiple parameters. See https://github.com/shahzebsiddiqui/buildtest/commit/2203a8db080e6b566a1f8d98a64da5575b79cc37
2. Adding support for R, Perl and Python with more tests.
3. R, Python, Perl (soon to come), and MPI tests are organized in testset using **--testset** flag see https://github.com/shahzebsiddiqui/buildtest/commit/dac986b18d32e98e9b101e611d5a99dcfc41b6d5
this allows for multiple packages to reuse tests across different apps. For instance OpenMPI, MPICH, MVAPICH and intel can now reference the mpi testset.
4. Add support for **inputfile** YAML key to allow input redirection into program. See https://github.com/shahzebsiddiqui/buildtest/commit/6ef1dc5b072c792c998b6b4757acffd0196a96bc
5. Add support for **outputfile** YAML key to allow output redirection. See https://github.com/shahzebsiddiqui/buildtest/commit/a54cb590f9f6c6bf95c4a81c29c53838a2330546
6. Add support for argument passing using **arg** key word see https://github.com/shahzebsiddiqui/buildtest/commit/eca0ec6d153cd97abb942bdbb4bd070803b28bc8
7. Add support for **iter** YAML key to allow N tests to be created. https://github.com/shahzebsiddiqui/buildtest/commit/859d197daa2127fb255582ad50d9eb73bd8a26dd
8. Switching BUILDTEST_MODULEROOT to BUILDTEST_MODULE_EBROOT to emphasize module tree should be coming from what easybuild generates.
9. Fixed some bugs pertaining to CMakeLists.txt