-
Notifications
You must be signed in to change notification settings - Fork 21
Open
Description
The current approach (_copy_data
) for loading data from the source database relies on limit + offset, which is slow. Replace it with a faster approach, perhaps using yield_per or a window function. e.g.:
for data in source_session.query(table).yield_per(batchsize):
_insert_data(target_session,source_schema,table,data)
See:
Metadata
Metadata
Assignees
Labels
No labels