Azure SQL Incremental Configuration
Enable Incremental Read
In Azure SQL data source, the option for incremental read can be enabled or disabled. Enable to read the desired data incrementally from the specified column as per the input start date. Disable to read the data within a specific range by providing the start date and an end date.
Column
The timestamp field should be selected on which the condition to fetch data will be applied as per the incremental read type.
Offset
Mention a value of the reference column, Only the records whose value of the reference column is greater than this value will be read.
Read Control Type
Control how you want to read the data from the source with one of the below options:
None
Read the data without specifying any limit. Provide a record from the selected Column, and the data will be read starting from the provided value.
Limit by Count
Specify the number of records you want to read in a single request.
Limit by Value
Read the data till the specified limit. Provide a record from the selected Column, and the data will be read till the provided value.
If you have any feedback on Gathr documentation, please email us!