This can happen when a full page of data ends with some replication key value, where the next request - by virtue of using the greater than operator (gt) - will exclude data that has the same exact replication key value:
- initial request made
- last replication key
UpdatedDate value is 2026-02-25T11:55:33.1676158Z
- next request made with
$filter expression UpdatedDate gt 2026-02-25T11:55:33.1676158Z
- other data with an
UpdatedDate of 2026-02-25T11:55:33.1676158Z will be excluded
|
elif isinstance(next_page_token, str): |
|
params["$filter"] = f"{self.replication_key} gt {next_page_token}" |
This can happen when a full page of data ends with some replication key value, where the next request - by virtue of using the greater than operator (
gt) - will exclude data that has the same exact replication key value:UpdatedDatevalue is2026-02-25T11:55:33.1676158Z$filterexpressionUpdatedDate gt 2026-02-25T11:55:33.1676158ZUpdatedDateof2026-02-25T11:55:33.1676158Zwill be excludedtap-aptem/tap_aptem/client.py
Lines 104 to 105 in 9b70cfa