Catalyst

Added

- RecSys loss functions: `AdaptiveHingeLoss`, `BPRLoss`, `HingeLoss`, `LogisticLoss`, `RocStarLoss`, `WARPLoss` ([1269](https://github.com/catalyst-team/catalyst/pull/1269), [#1282](https://github.com/catalyst-team/catalyst/pull/1282))
- object detection examples ([1271](https://github.com/catalyst-team/catalyst/pull/1271))
- SklearnModelCallback ([1261](https://github.com/catalyst-team/catalyst/pull/1261))
- Barlow Twins example ([1261](https://github.com/catalyst-team/catalyst/pull/1261))
- TPU/XLA support ([1275](https://github.com/catalyst-team/catalyst/pull/1275))
- with updated [example](./examples/engines)
- native `sync_bn` support for all available engines ([1275](https://github.com/catalyst-team/catalyst/pull/1275))
- Torch, AMP, Apex, FairScale

Changed

- Registry moved to `hydra-slayer` ([1264)](https://github.com/catalyst-team/catalyst/pull/1264))
- ([1275](https://github.com/catalyst-team/catalyst/pull/1275))
- batch metrics sync removed from ddp-runs to speedup training process
- `AccumulationMetric` renamed to `AccumulativeMetric`
- moved from `catalyst.metrics._metric` to `catalyst.metrics._accumulative`
- `accululative_fields` renamed to `keys`


Removed

-

Fixed

- PeriodicLoaderCallback docsting ([1279](https://github.com/catalyst-team/catalyst/pull/1279))
- matplotlib issue ([1272](https://github.com/catalyst-team/catalyst/pull/1272))
- sample counter for the loader ([1285](https://github.com/catalyst-team/catalyst/pull/1285))

Added

- added `pre-commit` hook to run codestyle checker on commit ([1257](https://github.com/catalyst-team/catalyst/pull/1257))
- `on publish` github action for docker and docs added ([1260](https://github.com/catalyst-team/catalyst/pull/1260))
- MixupCallback and `utils.mixup_batch` ([1241](https://github.com/catalyst-team/catalyst/pull/1241))
- Barlow twins loss ([1259](https://github.com/catalyst-team/catalyst/pull/1259))
- BatchBalanceClassSampler ([1262](https://github.com/catalyst-team/catalyst/pull/1262))

Changed

-

Removed

-

Fixed

- make `expdir` in `catalyst-dl run` optional ([1249](https://github.com/catalyst-team/catalyst/pull/1249))
- Bump neptune-client from 0.9.5 to 0.9.8 in `requirements-neptune.txt` ([1251](https://github.com/catalyst-team/catalyst/pull/1251))
- automatic merge for master (with [Mergify](https://mergify.io/)) fixed ([#1250](https://github.com/catalyst-team/catalyst/pull/1250))
- Evaluate loader custom model bug was fixed ([1254](https://github.com/catalyst-team/catalyst/pull/1254))
- `BatchPrefetchLoaderWrapper` issue with batch-based PyTorch samplers ([1262](https://github.com/catalyst-team/catalyst/pull/1262))
- Adapted MlflowLogger for new config hierarchy ([1263](https://github.com/catalyst-team/catalyst/pull/1263))

Added

- ([1230](https://github.com/catalyst-team/catalyst/pull/1230))
- FairScale support
- DeepSpeed support
- `utils.ddp_sync_run` function for synchronous ddp run
- CIFAR10 and CIFAR100 datasets from torchvision (no cv-based requirements)
- [Catalyst Engines demo](https://github.com/catalyst-team/catalyst/tree/master/examples/engines)
- `dataset_from_params` support in config API ([1231](https://github.com/catalyst-team/catalyst/pull/1231))
- transform from params support for config API added ([1236](https://github.com/catalyst-team/catalyst/pull/1236))
- samplers from params support for config API added ([1240](https://github.com/catalyst-team/catalyst/pull/1240))
- recursive registry.get_from_params added ([1241](https://github.com/catalyst-team/catalyst/pull/1241))
- albumentations integration ([1238](https://github.com/catalyst-team/catalyst/pull/1238))
- Profiler callback ([1226](https://github.com/catalyst-team/catalyst/pull/1226))

Changed

- ([1230](https://github.com/catalyst-team/catalyst/pull/1230))
- loaders creation now wrapper with `utils.ddp_sync_run` for `utils.ddp_sync_run` data preparation
- runner support stage cleanup: loaders and callbacks will be deleted on the stage end
- Apex-based engines now support both APEXEngine and ApexEngine registry names

Removed

-

Fixed

- multiprocessing in minimal tests hotfix ([1232](https://github.com/catalyst-team/catalyst/pull/1232))
- Tracing callback hotfix ([1234](https://github.com/catalyst-team/catalyst/pull/1234))
- Engine hotfix for `predict_loader` ([1235](https://github.com/catalyst-team/catalyst/pull/1235))
- ([1230](https://github.com/catalyst-team/catalyst/pull/1230))
- Hydra hotfix due to `1.1.0` version changes
- `HuberLoss` name conflict for pytorch 1.9 hotfix ([1239](https://github.com/catalyst-team/catalyst/pull/1239))

Added

- Reinforcement learning tutorials ([1205](https://github.com/catalyst-team/catalyst/pull/1205))
- customization demo ([1207](https://github.com/catalyst-team/catalyst/pull/1207))
- FAQ docs: multiple input and output keys, engine tutorial ([1202](https://github.com/catalyst-team/catalyst/pull/1202))
- minimal Config API example ([1215](https://github.com/catalyst-team/catalyst/pull/1215))
- Distributed RL example (Catalyst.RL 2.0 concepts) ([1224](https://github.com/catalyst-team/catalyst/pull/1224))
- SklearnCallback as integration of sklearn metrics ([1198](https://github.com/catalyst-team/catalyst/pull/1198))

Changed

- tests moved to `tests` folder ([1208](https://github.com/catalyst-team/catalyst/pull/1208))
- pipeline tests moved to `tests/pipelines` ([1215](https://github.com/catalyst-team/catalyst/pull/1215))
- updated NeptuneLogger docstrings ([1223](https://github.com/catalyst-team/catalyst/pull/1223))

Removed

-

Fixed

- customizing what happens in `train()` notebook ([1203](https://github.com/catalyst-team/catalyst/pull/1203))
- transforms imports under catalyst.data ([1211](https://github.com/catalyst-team/catalyst/pull/1211))
- change layerwise to layerwise_params ([1210](https://github.com/catalyst-team/catalyst/pull/1210))
- add torch metrics support ([1195](https://github.com/catalyst-team/catalyst/issues/1195))
- add Config API support for BatchTransformCallback ([1209](https://github.com/catalyst-team/catalyst/issues/1209))

Added

- Weights and Biases Logger (``WandbLogger``) ([1176](https://github.com/catalyst-team/catalyst/pull/1176))
- Neptune Logger (``NeptuneLogger``) ([1196](https://github.com/catalyst-team/catalyst/pull/1196))
- `log_artifact` method for logging arbitrary files like audio, video, or model weights to `ILogger` and `IRunner` ([1196](https://github.com/catalyst-team/catalyst/pull/1196))

Added

- Nifti Reader (NiftiReader) ([1151](https://github.com/catalyst-team/catalyst/pull/1151))
- CMC score and callback for ReID task (ReidCMCMetric and ReidCMCScoreCallback) ([1170](https://github.com/catalyst-team/catalyst/pull/1170))
- Market1501 metric learning datasets (Market1501MLDataset and Market1501QGDataset) ([1170](https://github.com/catalyst-team/catalyst/pull/1170))
- extra kwargs support for Engines ([1156](https://github.com/catalyst-team/catalyst/pull/1156))
- engines exception for unknown model type ([1174](https://github.com/catalyst-team/catalyst/issues/1174))
- a few docs to the supported loggers ([1174](https://github.com/catalyst-team/catalyst/issues/1174))

Changed

- ``TensorboardLogger`` switched from ``global_batch_step`` counter to ``global_sample_step`` one ([1174](https://github.com/catalyst-team/catalyst/issues/1174))
- ``TensorboardLogger`` logs loader metric ``on_loader_end`` rather than ``on_epoch_end`` ([1174](https://github.com/catalyst-team/catalyst/issues/1174))
- ``prefix`` renamed to ``metric_key`` for ``MetricAggregationCallback`` ([1174](https://github.com/catalyst-team/catalyst/issues/1174))
- ``micro``, ``macro`` and ``weighted`` aggregations renamed to ``_micro``, ``_macro`` and ``_weighted`` ([1174](https://github.com/catalyst-team/catalyst/issues/1174))
- ``BatchTransformCallback`` updated ([1153](https://github.com/catalyst-team/catalyst/issues/1153))

Removed

- auto ``torch.sigmoid`` usage for ``metrics.AUCMetric`` and ``metrics.auc`` ([1174](https://github.com/catalyst-team/catalyst/issues/1174))

Fixed

- hitrate calculation issue ([1155](https://github.com/catalyst-team/catalyst/issues/1155))
- ILoader wrapper usage issue with Runner ([1174](https://github.com/catalyst-team/catalyst/issues/1174))
- counters for ddp case ([1174](https://github.com/catalyst-team/catalyst/issues/1174))