Trains

Features

- Add direct plotly figure reporting 136
- Improve matplotlib integration 140
- Add `Task.set_parent()` 144
- Add `Task.wait_for_status()` 145
- Enhance framework `save`/`load` binding callbacks https://github.com/pytorch/ignite/issues/1056
- Add `TrainsJob.is_failed()`
- Add APIClient support using `trains.backend_api.session.APIClient`
- Add URL tracking when using `StorageManager.get_local_copy()` (log remote url instead of local file copy)
- Improve & expand examples

Bug Fixes

- Fix `pytorch_tensorboard.py` example 148
- Fix `ssh://userdomainserver.com/` in Git repository link 149
- Fix do not call `make_deterministic()` on import
- Fix initialization wizard (allow at most two verification retries, then print error) [trains-agent 16](https://github.com/allegroai/trains-agent/issues/16)
- Fix Google CoLab code/package detection
- Improve Pytorch-Ignite integration
- Fix TensorFlow >=2 histogram binding
- Fix `Logger.tensorboard_single_series_per_graph`
- Fix anonymous named models
- Fix incorrect entry point detection when called from Trains wrapper (e.g. `TrainsLogger` in Pytorch Ignite/Lightning)

First official release!

This release is part of the [Trains Server v0.15.0](https://github.com/allegroai/trains-server/releases/tag/0.15.0) release and is included in the pre-packaged docker image and other deployment methods (see *Trains Server and Trains Agent deployment options* under [Deploying Trains Overview](https://allegro.ai/docs/deploying_trains/trains_deploy_overview/)).

Features and Bug Fixes

- Add Logger histogram mode (stack/group/relative)
- Add PEP610 support for new pip>=20.1 git reference feature (see https://github.com/pypa/pip/issues/609) 62
- Better support for PyTorch Ignite integration
- Support `` and `?` in uploaded image file names
- Support `ArgumentParser.parse_arg()` used before initializing task when `auto_connect_arg_parser=False`
- Fix upload_object_via_stream() in Azure storage driver
- Fix `Task.get_tasks()` return type

Features

- Add media (audio) support for both Logger and Tensorboard binding using `Logger.report_media()` 120
- Add autokeras example (see [here](https://github.com/allegroai/trains/tree/master/examples/autokeras)) 125
- Add caching of extracted zip artifacts
- Add `Task.get_tasks()` filtering support
- Add `trains.storage.StorageManager`
- Add nicer stdout log flush
- Add text logging to TF V1 example
- Improve SSL retries and error handling
- Improve shutdown behavior in case of a user abort (Ctrl-C)
- Improve repository and module detection
- Improve resource monitor
* Report memory usage for process (and sub-processes)
* Report GPU memory usage for process (and sub-processes)
* Stability
- Improve Jupyter support
* Make sure `trains` is included in Jupyter requirements
* Ignore IPython directives in converted Python script (like `%` and `!` lines)
- Update Pytorch/TensorboardX examples

Bug Fixes

- Fix renaming/deleting model file right after saving will break asynchronous upload 123
- Fix shutdown behavior:
* Logger flush delay and termination
* Repository/package detection termination
* Threads termination
- Fix text encoding `utf-8` and `pr_curve` broken in Tensorboard support
- Fix single log request exceeds max packet size
- Fix upload debug assets with series / title including `,` or `/` did not add iteration index to the filename
- Fix `scikit-learn` module detection
- Use UID in message if user name cannot be retrieved (from the [Trains Slack channel](https://github.com/allegroai/trainsdocumentation-community--support))
- Fix cast in Tensorflow v2 example

Features and Bug Fixes

- Add OpenMPI/Slurm support, support `TRAINS_FORCE_MASTER_NODE` environment variable to allow forcefully specifying a node is master (not based on the MPI Rank)
- Add `Task.get_models()` and `Task.models` for retrieving stored models for previously executed tasks
- Support multiple `EventWriter` in TensorFlow eager mode (TF 2.0+) 26
- Support reusing models
- Fix TensorFlow `NaN`/`Inf` values support 118
- Fix `joblib` binding
- Fix metrics/files/models upload on shutdown
- Fix support for `Task` init/close multiple times
- Update [manual_reporting.py](https://github.com/allegroai/trains/blob/master/examples/manual_reporting.py) example with `Logger.report_table()` example
- Deprecate `Task.set_model_config()`, `Task.get_model_config_text()` and `Task.get_model_config_dict()`

Features and Bug Fixes

- Add support for reporting tables (`pandas`, `csv` etc.) using `Logger.report_table()`
- Support setting task initial iteration for continuing previous runs using `Task.set_initial_iteration()` and `Task.get_initial_iteration()`
- Add multiprocess task support 96
- Add `trains-init` support for config file override using the `TRAINS_CONFIG_FILE` environment variable or `--file` command line argument 105
- Add initial `slurm` support
- Allow disabling repository detection when calling `Task.init()`
- Add Jupyter notebook server execution example
- Update examples
- Better warning messages for storage errors and missing storage packages
- Fix HTTP link quoting in stored links