-
-
Notifications
You must be signed in to change notification settings - Fork 66
Open
Description
Task requirement: to sync mySQL table into PostgreSQL table for every 6 hours in daily
Issue: Show connection read timeout error every time
Solutions that have applied:
- Suspect the mySQL table is large in size (~805MB), so added index. After added index, first run it succeed (took about 25mins to finish the sync) but after that all failed (either no result return for hours or connection timeout error show)
- Set config of
idleTimeoutto 0,timeoutto 0 andpoolSizeto 15 inClient.connect(), 1 day succeed once the most. Others sync will be show no result return even run for hours (it seems stuck in the middle of process and stopped at different rows every time). - Upgrade mySQL library from
2.10.2to2.10.3and repeat step 1 and 2, but same result (no result for hours / connection read timeout error)
Note: Syncing 3 tables from mySQL to Postgres but only 1 table failed. The other 2 tables size in few kbs.
Deno: v1.29.4
Nessie: v2.0.10
mySQL: v2.10.3
Metadata
Metadata
Assignees
Labels
No labels
