MOLT Verify transformations and filter rules#22700
Conversation
✅ Deploy Preview for cockroachdb-api-docs canceled.
|
✅ Deploy Preview for cockroachdb-interactivetutorials-docs canceled.
|
Files changed: |
✅ Netlify Preview
To edit notification comments on pull requests, go to your Netlify project configuration. |
bsanchez-the-roach
left a comment
bsanchez-the-roach
left a comment
There was a problem hiding this comment.
Some comments are minor nits about phrasing that you can take or leave, others are slightly more substantial.
|
|
||
| ### Verify transformed data | ||
|
|
||
| If you applied [transformations during `molt fetch`]({% link molt/molt-fetch.md %}#transformations), you can apply the same transformations with MOLT Verify to match source data with the transformed target data. |
There was a problem hiding this comment.
When do you write it as MOLT Fetch vs. molt fetch
There was a problem hiding this comment.
I generally use the former when referring generally to the product, and the latter when describing the running process.
src/current/molt/molt-verify.md
Outdated
| ## Known limitations | ||
|
|
||
| - MOLT Verify compares 20,000 rows at a time by default, and row values can change between batches, potentially resulting in temporary inconsistencies in data. To configure the row batch size, use the `--row_batch_size` [flag](#flags). | ||
| - MOLT Verify only supports comparing one MySQL database to a whole CockroachDB schema (which is assumed to be `public`). |
There was a problem hiding this comment.
I'm confused by this. Does this not contradict the fact that MySQL sources are supported for selective data verification?
There was a problem hiding this comment.
This was written a long time ago and I think it can be removed. I believe what it's trying to say is that MySQL doesn't have the schema concept from PG, so MySQL databases map to CRDB public schemas by default. (We make this point in e.g. Load and Replicate.) This isn't really a known limitation IMO, so I'll make the point inline under the MySQL connection string example.
Co-authored-by: bsanchez-the-roach <brandon.sanchez@cockroachlabs.com>
Co-authored-by: bsanchez-the-roach <brandon.sanchez@cockroachlabs.com>
4 participants
DOC-15554