Jiminy-py

pid_kd = [3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3, 3.0e-3]
[blocks_config.wrapper_kwargs]
augment_observation = true

Partially stack observation frames
[[blocks_config]]
wrapper_class = "gym_jiminy.common.wrappers.StackedJiminyEnv"
[blocks_config.wrapper_kwargs]
nested_fields_list = [
["t"],
["sensors", "ImuSensor"],
["targets"],
]
num_stack = 3


New features:
[gym] Add 'load_pipeline' utility to load pipeline from file.

Miscellaneous:
[gym] Use folder architecture for clarity and maintainability.

Robots are now fully serialized in log files, including all their hardware but not their controller. This means that they can be used for running new simulation without any issue. Previously, they are only suitable for viewer replay. Apart from that, some outdated environment pipeline wrappers have been refactored to significantly improve their performance.

New features

* [core] Full support of serialization of 'Robot'. (770) (775)

Improvements

* [core] Log the acceleration both at the end and the beginning of a step if dynamics has changed. (779)
* [python/simulator] 'plot' now support multi-robot simulations. (770)
* [gym/common] Speedup 'PDController' env pipeline block. (770)
* [gym/common] Speedup 'StackedJiminyEnv' wrapper. (770)
* [gym/common] More generic 'FilterObservation', 'StackedJiminyEnv' wrappers. (770) (776)

Patches and bug fixes

* [core] Fix pessimistic step adjustment that could lead to undeserved integration failure.
* [core] Fix inconsistent acceleration acceleration after updating discrete-time controller command. (779)
* [gym/common] Improve 'Env.render_mode' support.
* [gym/rllib] Fix multi-GPU support using custom PPO (774)

Miscellaneous

* [gym/zoo] Cleanup and speedup toy model environments. (770)
* [misc] Add RL tutorial notebook.

A new API for defining quantities in reward and termination conditions computations has been added. The first objective is to make much easier to new comers that are not used to rigid body dynamics, and secondly, to compute them as efficiently as possible. In this regard, a new quantity manager is responsible for keeping track of all quantities involved in computations and optimisation the overall computation path, by avoiding redundant computations through caching and sharing of intermediary quantities, but also by aggregating them whenever possible to take advantage of vectorisation optimally. Apart from that, the multi-robot simulations have been made much easier by supporting them via Python API. Finally, backlash in simple motor transmission are now natively supported, modelled an extra virtual joint together with a massless body.

New features

* [core] Add backlash support at motor-level. (767)
* [python/simulator|python/plot] First-class multi-robot support. (754) (764) (766)
* [gym/common] Introduce new first-class quantity manager. (749) (751) (752) (756)

Improvements

* [core] Clarify terminology: 'Rigid' by 'Mechanical', 'Original' by 'Theoretical', 'Actual' by 'Extended'. (753) (762) (763)
* [core] User is now systematically responsible for serializing constants before telemetry registration. (753)
* [core] Consistent export/import/get/set options between single- and multi-robot simulations. (758) (760) (761)
* [core/python] Add method to query heightmaps on multiple positions at once. (750)
* [gym/common] Plot state, action and features of all pipeline blocks. (750)
* [gym/common] PD controller now satisfies position, velocity and acceleration bounds. (750) (765) (768)
* [gym/common] Allows PD control with position action. (750)
* [gym/common] Decouple PD controller action order adapter from acceleration integration. (764)

Patches and bug fixes

* [core] Fix bias/noise check for EncoderSensor. (744)
* [core] Fix exception not caught during stepper integration. (747)
* [core] More appropriate tolerance when checking GCD to avoid false positive. (753)
* [python/viewer] Fix arrow maker with panda3d backend.
* [python/viewer] Fix viewer automatic closing during replay not working. (756)
* [gym/common] Fix corrupted robot proxy if model changes. (746)

Miscellaneous

* [core] Fix some symbols not exported by mistake. (742)
* [gym/common] Refactor 'compute_command' to operate in-place. (764)
* [gym/rllib] Migrate from ray[rllib]==2.5.0 to 2.9.*. (739)
* [misc] More robust build procedure. (739) (746)
* [misc] Upgrade C++ dependencies. (741)
* [misc] Fix numpy version requirement. (750)

A observer block for multiple punctual deformations has been implemented at position-level only. This is based on the work of [Matthieu Vigne et al.](https://hal.science/hal-03511198/document). In addition, a bunch of minor bugs has been fixed as usual.

New features

* [gym/common] Add 'DeformationEstimator' block. (732)

Improvements

* [core] More bad control flow checks. (730)
* [core/python] 'Model' can now be instantiated from Python. (730)
* [gym/common] Add 'compute_tilt_from_quat', 'swing_from_vector', and 'remove_twist_from_quat'. (731)
* [gym/common] Allow negative block update period to match env step. (734)

Patches and bug fixes

* [core] Fix broken 'getRigidVelocityFromFlexible'. (732)
* [core/python] Fix partially broken 'FunctionalController' bindings. (730)
* [core/python] Fix multiple typos. (731)
* [python/simulator] Fix 'robot' and 'robot_state' corrupted if robot is replaced. (731)
* [gym/common] Fix 'refresh_observation' being called before 'initialize_buffers' at simulation start. (731)
* [gym/common] Fix broken mahony filter for 'twist_time_constant != None'. (731)
* [gym/common] Fix support of non-batched mode for generic math. (731)
* [gym/common] Fix 'matrix_to_rpy' to be consistent with 'pin.matrixToRpy'. (731)
* [gym/envs] Fix broken 'Ant' environment. (731)

Miscellaneous

* [core] Print warnings even for release build type. (731)
* [gym/common|gym/toolbox] Promote generic SE3 math utilities from toolbox to common module. (731)
* [misc] Update documentation. (736)

The confusing and unnecessary notion of system, ie a named pair (robot, controller), has been completely removed. All robots now have a name, and the controller is now an integral part of the robot. Similarly, the single-robot wrapper around the multi-robot Engine has been removed from C++ core. Note that the Python wrapper `Simulator` is still single-robot for now. Finally, the numerical stability of the constraint solver has been improved using the under-relaxation technics.

Improvements

* [core] Add relaxation to PGS solver to mitigate convergence instabilities. (726)

Patches and bug fixes

* [core] More conservative step adjustment for adaptive steppers. (724)
* [python/plot] Synchronise x-axes on all tabs by default. (724)
* [gym/common] Ease debugging of Gym environments. (724)
* [gym/common] Do not enforce 'dtMax'. (727)

Miscellaneous

* [core] Remove confusing and unnecessary 'System' hierarchy. (728)
* [core] Remove single-robot 'Engine' class. (728)

A few bugs that have been recently have been finally fixed, including some poorly motivated changes in adaptive steppers that was causing numerical instabilities. In addition, a long-standing bug that was leading to integration failure in a very specific, but not so unusual, scenario.

Improvements

* [core] Error and warning reporting more consistent with Python. (716)

Patches and bug fixes

* [core] Fix exception handling for visco-elastic coupling and internal flex forces. (716)
* [core] Fix error estimation too optimistic for adaptive steppers. (716)
* [core] Fix partially broken step adjustment optim that could lead to integration fail. (721)
* [gym/zoo] Fix 'acrobot' and 'cartpole' env using wrong integrator. (719)

Miscellaneous

* [misc] Fix easy install doc. (721)
* [misc] Fix support of virtual env ('venv', 'pyenv', ...) when building dependencies. (721)