Cupy

This is the release note of v6.0.0a1. See [here](https://github.com/cupy/cupy/milestone/39?closed=1) for the complete list of solved issues and merged PRs.

Highlights

- Improved support of random sampling functions (`cupy.random.*`); see the list below for details.

New Features

- Support `astype` in fused functions (1586)
- Add float16 and float64 support for `scatter_add` (1707, 1684, thanks uchida!)
- Add random sampling functions
- `cupy.random.hypergeometric` (1625)
- `cupy.random.logistic` (1626)
- `cupy.random.logseries` (1628)
- `cupy.random.power` (1629)
- `cupy.random.rayleigh` (1630)
- `cupy.random.triangular` (1631)
- `cupy.random.wald` (1632)
- `cupy.random.weibull` (1633)
- `cupy.random.negative_binomial` (1635)
- `cupy.random.noncentral_chisquare` (1637)
- `cupy.random.noncentral_f` (1637)

Enhancements

- Update `ndimage` to support SciPy 1.0+ (1606)
- Improve reduction code for performance (1668)
- Device comparison with non-Device class (1672)
- Fix ufunc performance degradation (1714)
- Code enhancements
- Minor refactoring in random kernels (1641)
- Reorder definitions of distribution kernels (1681)
- Update einsum optimization routine (1718)
- Remove unnecessary intermediate data in FP16 `atomicAdd` (1706)

Bug Fixes

- Fix float16 `nextafter` (1665, thanks toru-fukaya!)
- Fix NVRTC error in `cupy.random.hypergeometric` (1688)
- Fix `cupy.random.rand` to not generate 1 (1701)
- Fix comparison with NumPy scalar (1727)
- Fix `ndarray.__iter__` to raise `TypeError` correctly for 0-d arrays (1697)
- Add complex support in `solve` (1524, 1674 thanks boeddeker!)

Documentation

- Fix typo in docstring for `cupy.linalg.slogdet` (1667, thanks fiarabbit!)
- Add licenses of distribution kernels from numpy (1680)
- Fix math docs of `cupy.random` (1685)
- Explain that `-ftz=true` affects `nextafter` (1717)
- Drop support for CUDA 7.0 / 7.5 (1722)
- Add support for NumPy 1.15 in docs (1728)
- Add Python 3.7 support to installation docs (1739)

Installation

- Reorganize setup requirements (1478)
- Update base docker image (1723)

Tests

- Tentatively skip failing `test_nextafter_combination` (1687)
- Compare distributions between cupy and numpy by two-sample K-S test (1300)
- Improve floating point tests (1673)
- Mark slow `cupy.random` tests (1677)
- Add more K-S tests (1678)
- Minor fixes to `cupy.random` tests (1679)
- Fix `TestRandintDtype` was slow (1682)
- Ignore scipy<1.0 is warned by using deprecated feature of numpy>=1.15 (1702)
- Workaround for test failure when Python 3.4 + SciPy 0.x + NumPy 0.15 (1732)
- Fix test for Python 3.7 (1743)

Others

- Add header file generated by Cython to gitignore (1700)

This is the release note of v5.4.0. This is the final release of v5.x series. See [here](https://github.com/cupy/cupy/milestone/47?closed=1) for the complete list of solved issues and merged PRs.

Highlights

- CUDA 10.1 and cuDNN 7.5 are now supported. CuPy also starts to compile for compute capability 7.5 for Turing GPUs.

Enhancements
- Avoid using pytest attributes during import (2057)
- Fix fp16 issue in batch normalization (2094, thanks anaruse!)
- Keep backward compatibility on `cupy.cudnn.batch_normalization_forward_training` (2094)
- Support CUDA 10.1 + cuDNN 7.5 + Turing (2123)

Bug Fixes
- Ensure that sparse matrix shapes are always a tuple of `int` (2082, thanks grlee77!)
- Fix assigning from complex to float (2092)
- Check array contiguity in `copy` (2093)
- Fix assertion error in `_Chunk.split` (2112, thanks liwt31!)
- Support `dltensor` with strides of `NULL` (2119, thanks crcrpar!)
- Avoid sharing handles between threads (2122)

Code Fixes
- Remove unused variable (2108, thanks crcrpar!)

Documentation
- Add NCCL v2.4 support to docs (2089)
- Add `strides` to docstring of `ndarray` (2109, thanks crcrpar!)

Tests
- Do not fail by warnings when building docs (2086)

This is the release note of v5.3.0. See [here](https://github.com/cupy/cupy/milestone/46?closed=1) for the complete list of solved issues and merged PRs.

New Features
- Add NCCL 2.4 functions (2052)

Enhancements
- Use version interface in NCCL 2.3.4 (2006)
- Fix vector handling (2013)
- Avoid `import numpy` (2054)
- Support Python scalars in `iscomplexobj` (1993)

Performance Improvements
- Improve dictionary operation (2039)

Bug Fixes
- Fix `cupy.random.randint` fail with size zero (1981)
- Call `free_all_blocks` to free CUDA memory (1987)
- Define `__dealloc__` instead of `__del__` for cdef-classes to fix memory leak (2000)
- Fix NCCL version assignment for NCCL < 2.3.4 (2012)
- Fix random generator seed type (2041)

Code Fixes
- Remove duplicate declaration of `cudaMalloc` (2037)

Documentation
- Add `cupy-cuda100` to README (1980)
- Fix README image to use URL (1982)
- Document NumPy 1.16 support (1996)

Tests
- Fix test to support SciPy 1.12 (1971)
- Fix test of `assert_array_list_equal` (2003)
- Fix test with NumPy 1.16.1 (2004)

This is the release note of v5.2.0. See [here](https://github.com/cupy/cupy/milestone/44?closed=1) for the complete list of solved issues and merged PRs.

Highlights

- CuPy now runs without CUDA development headers if you are using CUDA 9.2 or 10.0.
- Improved compatibility with NumPy 1.16.

New Features

- Add `cupyx.scipy.sparse.diags` (1865, thanks grlee77!)
- Support New APIs in cuDNN v7.4.1 (1893)

Enhancements

- Bundle CUDA fp16 headers (1858)
- Support for documenting NCCL interfaces (1868)
- Verbose broadcast failure message (1875)
- Support NumPy arrays as seeds in RandomState (1882, thanks mrocklin!)
- Use item instead of asscalar to support NumPy 1.16 (1895)
- Use LF instead of CR+LF (1920)
- Support NumPy 1.16 (1923)

Performance Improvements

- Fix ufunc performance degradation (1929)

Bug Fixes

- Fix backward of batch normalization (1860)
- Check if cx is None (1863)
- Fix RecursionError bug in conj method of sparse matrix classes (1922, thanks grlee77!)
- Fix ndarray initialization bug (1927)
- Fix `ndim` not using `cdef` (1939)
- Ensure the input to the CUFFT Plan1D class is C contiguous (1964, thanks grlee77!)

Code Fixes

- Clean up `internal.pyx` (`prod`) (1960)

Documentation

- Update docs for newly supported libraries (1855)
- Fix stylecheck installation in contribution guide. (1876, thanks crcrpar!)
- Add memory management documentation (1877)
- Align with the latest numpy docs (1878)
- Rename Code of Conduct filename (1963)

Tests

- Add tests for complex min and max (1859)
- Fix `randint` high value in test for Windows (1902)

Others

- Ignore W503 and W504 (1957)

This is the release note of v5.1.0. See [here](https://github.com/cupy/cupy/milestone/42?closed=1) for the complete list of solved issues and merged PRs.

New Features
- Support comparison operators for complex numbers (1820, thanks themightyoarfish!)
- Add cuDNN RNN high-level API (1821)
- Add cuDNN softmax and pooling interface (1752, 1753)
- Add cuDNN batch normalization interface (1784)


Enhancements
- Add float16 and float64 support for `scatter_add` (1756, thanks uchida!, 1763)
- Code enhancements
- Rename `_make_rnn_workspace` function (1841)
- Make a helper function to get the number of layers in RNN (1844)
- Remove code for CUDA 7.0 / 7.5 and cuDNN v4 (1778)
- Remove unnecessary intermediate data in FP16 `atomicAdd` (1777)
- Fix DropoutStates interface to avoid using cuDNN handle (1796)
- Assume CUDA v8 in cuSPARSE/cuSOLVER check (1782)

Bug Fixes
- Fix error in typecast from fp16 to complex dtype in `cupy.fuse` (1801)
- Fix invalid memory access during reduction whose output is large to exceed 32-bit (1810)
- Fix incorrect cast in element-wise op for float array and complex scalar (1803)

Test
- Workaround for test failure with Python 3.4 + SciPy 0.x + NumPy 0.15 (1738)
- Fix userspace kernel test failure in Windows (1761)
- Fix `PendingDeprecationWarning` when running test against NumPy 1.15 (1762)
- Support skipping tests decorated by condition or parametize (1767)
- Fix test failure of binomial distribution in Windows (1851)

Documentation
- Add code of conduct (1831)
- Improve comparison table (1750)
- Add requirements to build documentation on RTD (1768)
- Add policy on compatibility of random sampling (1771)
- Fix description of `CUDA_PATH` environment variable (1783)
- Indicate alias in comparison table (1794)
- Fix English in `ndarray.nbytes` documentation (1798)
- Add note about `cupy.random.{get_set}_state` (1814)
- Enable intersphinx to cupyx module (1816, thanks grafi-tt!)
- Add 10.0 to supported CUDA versions (1826)
- Add docs about conversion from/to cupy ndarray and sparse (1830)
- Add v7.3 and v7.4 to supported cuDNN versions (1825)

Full support for ROCm 5.0 has been added as of this release. Binary packages are available in PyPI and can be installed with the following command: `pip install cupy-rocm-5-0`

Changes

Enhancements

- Support ROCm 5.0 (6496)
- Support cuSPARSELt 0.2.0 (repost) (6507)
- Update `cupy.array_api` (6550)
- Fix `cupy.copyto` to take NumPy array scalars (6593)
- Fix for supporting ROCm 5.0 (6599)
- Make einsum accept subscripts in numpy int (6516)

Bug Fixes

- Fix error message in `vectorize` (6515)
- Fix `cupy.cumsum` on ROCm 5.0 (6525)
- Fix coo_matrix.diagonal (6533)
- Fix `out` args parser of ufunc (6547)
- Fix `cupy.fill` to properly take zero-dim `cupy.ndarray` (6548)
- Fix cuSPARSELt 0.1.0 support in v10 (6563)
- Fix `may_share_memory` algorithm (6565)
- Avoid using the same kernel from different devices in JIT (6581)
- Fix array creation shape (6592)
- Fix cupy.full and cupy.full_like to make unsafe casting (6595)
- Fix device context management in `MemoryAsyncPool` (6596)

Code Fixes

- mypy: array_api (6552)

Documentation

- Remove description about issues from contribution guide (6542)
- Fix documents for CUDA 11.6 (6543)

Installation

- Remove `CUPY_SETUP_ENABLE_THRUST=0` environment variable (6488)
- Skip appending `--compiler-bindir` if `cl.exe` is already on `PATH` (6514)
- Bump version to v10.3.0 (6602)

Tests

- Ignore warnings from Optuna 3.0 pre-releases (6490)
- Disable CentOS 8 test (6519)
- Add FlexCI projects for Windows (6540)
- Skip `async_malloc` tests on unsupported device (6544)
- CI: Trigger `push` event of FlexCI via GitHub Actions (6554)
- CI: regenerate matrix (6557)
- CI: Fix rule name in dispatcher (6558)
- CI: Fix event name in dispatcher (6559)
- Fix flaky test_inverse_indices_shape (6573)
- Trigger CUDA 11.6 Windows CI when push/pull-request (6578)

Contributors

The CuPy Team would like to thank all those who contributed to this release!

anaruse asi1024 kmaehashi leofang Onkar627 takagi toslunar tushxr16