-
Notifications
You must be signed in to change notification settings - Fork 2.1k
[FLINK-38142] Upgrading the Paimon version to 1.2.0 #4066
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There will be some adjustments needed as compilation is failing after the version bump. I will get to it later. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I let some comment
@Mrart Sorry I couldn't find your comment on the PR. I am looking into the test case failures, but it looks like those have been failing for other cases as well. |
You could rebase to master to solve those failed cases. |
...r-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java
Outdated
Show resolved
Hide resolved
...tor-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonCommitter.java
Show resolved
Hide resolved
...r-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java
Outdated
Show resolved
Hide resolved
...r-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java
Outdated
Show resolved
Hide resolved
...r-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java
Outdated
Show resolved
Hide resolved
...r-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/SchemaChangeProvider.java
Outdated
Show resolved
Hide resolved
Well, LGTM. |
Yeah fixed those cases, and the unit tests are successfully passing. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
Upgrades the Paimon version to 1.2.0. This supports both Flink 1.19 and 1.20.