Major changes
**Change in pagination mode (159)**
*This change only applies to form and case exports to all supported SQL databases. It does not apply to exports of other data types or other output formats.*
This release introduces a new pagination mode for the tool in order to avoid certain edge cases where data may be missed in the requests to the CommCare API. Previous versions used the modification dates of forms and cases for sorting and pagination ("server_modified_on" for forms and "server_date_modified" for cases). From this version onward the default will be to use the "indexed_on" field for sorting and pagination.
The new pagination mode will automatically be used in the following circumstances:
- All new tables (ones that do not have an existing checkpoint)
- Any runs of the command that use the '--since' command line parameter
- Any runs of the command that use the '--start-over' command line parameter
The old pagination mode will continue to be used for existing tables as long as none of the statements above apply.
It is recommended that ALL existing tables be re-synced using the new pagination mode. This can be done by passing '--start-over' on the command line for the first run of the tool. Once the tool has completed at least one checkpoint it will continue to use the new pagination mode for that table from that point onward.
Any tables that continue to use the old pagination mode will output a warning at the start of the command:
2021-01-27 14:19:43,302 commcare_export.cli WARNING
====================================
This export is using a deprecated pagination mode which will be removed in future versions.
To switch to the new mode you must re-sync your data using `--start-over`.
See https://wiki.commcarehq.org/display/commcarepublic/CommCare+Export+Tool+Release+Notes for more details.
====================================
Minor changes
**Enhancements**
173 - add "data source" and "last_doc_id" to checkpoints
171 - test that emitted rows is a generator