Mlpack

2018-07-27
* Fix Visual Studio compilation issue (1443).

* Allow running local_coordinate_coding binding with no initial_dictionary
parameter when input_model is not specified (1457).

* Make use of OpenMP optional via the CMake 'USE_OPENMP' configuration
variable (1474).

* Accelerate FNN training by 20-30% by avoiding redundant calculations
(1467).

* Fix math::RandomSeed() usage in tests (1462, 1440).

* Generate better Python setup.py with documentation (1460).

2018-06-08
* Documentation generation fixes for Python bindings (1421).

* Fix build error for man pages if command-line bindings are not being built
(1424).

* Add 'shuffle' parameter and Shuffle() method to KFoldCV (1412). This will
shuffle the data when the object is constructed, or when Shuffle() is
called.

* Added neural network layers: AtrousConvolution (1390), Embedding (1401),
and LayerNorm (layer normalization) (1389).

* Add Pendulum environment for reinforcement learning (1388) and update
Mountain Car environment (1394).

2018-05-10
* Fix intermittently failing tests (1387).

* Add big-batch SGD (BBSGD) optimizer in
src/mlpack/core/optimizers/bigbatch_sgd/ (1131).

* Fix simple compiler warnings (1380, 1373).

* Simplify NeighborSearch constructor and Train() overloads (1378).

* Add warning for OpenMP setting differences (1358/1382). When mlpack is
compiled with OpenMP but another application is not (or vice versa), a
compilation warning will now be issued.

* Restructured loss functions in src/mlpack/methods/ann/ (1365).

* Add environments for reinforcement learning tests (1368, 1370, 1329).

* Allow single outputs for multiple timestep inputs for recurrent neural
networks (1348).

* Add He and LeCun normal initializations for neural networks (1342).
Neural networks: add He and LeCun normal initializations (1342), add FReLU
and SELU activation functions (1346, 1341), add alpha-dropout (1349).

2018-03-30
* Speed and memory improvements for DBSCAN. --single_mode can now be used for
situations where previously RAM usage was too high.

* Bump minimum required version of Armadillo to 6.500.0.

* Add automatically generated Python bindings. These have the same interface
as the command-line programs.

* Add deep learning infrastructure in src/mlpack/methods/ann/.

* Add reinforcement learning infrastructure in
src/mlpack/methods/reinforcement_learning/.

* Add optimizers: AdaGrad, CMAES, CNE, FrankeWolfe, GradientDescent,
GridSearch, IQN, Katyusha, LineSearch, ParallelSGD, SARAH, SCD, SGDR,
SMORMS3, SPALeRA, SVRG.

* Add hyperparameter tuning infrastructure and cross-validation infrastructure
in src/mlpack/core/cv/ and src/mlpack/core/hpt/.

* Fix bug in mean shift.

* Add random forests (see src/mlpack/methods/random_forest).

* Numerous other bugfixes and testing improvements.

* Add randomized Krylov SVD and Block Krylov SVD.

2017-08-25
* Compilation fix for some systems (1082).

* Fix PARAM_INT_OUT() (1100).

2017-07-18
* Speed and memory improvements for DBSCAN. --single_mode can now be used for
situations where previously RAM usage was too high.

* Fix bug in CF causing incorrect recommendations.