- When loading parameters, SockeyeModel now ignores false positive missing parameters for traced modules. These modules use the same parameters as their original non-traced versions.
3.1.9
Changed
- Clarified usage of `batch_size` in Translator code.
3.1.8
Fixed
- When saving parameters, SockeyeModel now skips parameters for traced modules because these modules are created at runtime and use the same parameters as non-traced versions. When loading parameters, SockeyeModel ignores parameters for traced modules that may have been saved by earlier versions.
3.1.7
Changed
- SockeyeModel components are now traced regardless of whether `inference_only` is set, including for the CheckpointDecoder during training.
3.1.6
Changed
- Moved offsetting of topk scores out of the (traced) TopK module. This allows sending requests of variable batch size to the same Translator/Model/BeamSearch instance.