Commit Graph

1124 Commits (release-3.2)
 

Author SHA1 Message Date
Hang Ruan e578fce1cb
[hotfix][docs] Fix dead links in Doris (#3878) (#3885) 1 week ago
yuxiqian 3017e14b3c
[BP-3.2][docs] Update download links to up-to-date cdc version (#3765)
* [docs] Update download links to up-to-date cdc version

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: replace params to allow dead link checking to pass

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: just don't check any interpolating urls

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* Bump version to 3.2.1

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
Leonard Xu 45a030a7d7
[hotfix][docs][pipeline-connector/es] Add missed supported flink versions and Elasticsearch versions
This closes #3751
2 months ago
Runkang He d63512ea19
[FLINK-36572][pipeline-connector][starrocks] Fix the issue that the local time zone is wrongly set
This closes  #3733.
2 months ago
Kunni fb2a1d0c38
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
This closes #3745.
2 months ago
Kunni 203bb9211b
[FLINK-35291][runtime] Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme (#3289) (#3670)
Co-authored-by: liuzeshan <liuzeshan@bytedance.com>
Co-authored-by: lzshlzsh <liu.zeshan@qq.com>
2 months ago
Leonard Xu 12c36f1ccd
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type (#3684) 2 months ago
Junbo wang 2c4aa3c0a2
[FLINK-36052][docs][cdc-pipeline-connector/es] Add flink cdc pipeline elasticsearch connector docs (#3686)
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
2 months ago
yuxiqian 4d0174c79c
[FLINK-36565][transform] Route allows merging Decimals with various precisions (#3743) 2 months ago
MOBIN 1bf40f09cc [FLINK-36093][transform] Fix preTransformoperator wrongly filters columns belong to different transforms
This closes #3572
2 months ago
yuxiqian da653566ee [FLINK-36596][transform] Fix unable to schema evolve with project-less transform rules
This closes  #3665.
2 months ago
yuxiqian 6fb19e612b [FLINK-36461][transform] Fix schema evolution failure with un-transformed tables
This closes  #3721.
2 months ago
yuxiqian e8a4084d13 [FLINK-35982][transform] Fix unable to transform metadata without projections
This closes #3695.
2 months ago
yuxiqian 7d31be505f [FLINK-35980][tests] Add transform-related test cases 2 months ago
Sergei Morozov e9ea04c077 [FLINK-36407][runtime] Shut down coordinatorExecutor upon closing SchemaRegistry
This closes #3709
2 months ago
yuxiqian a92dba6530 [FLINK-36105][flink-cdc-cli] Fix unable to restore from checkpoint with Flink 1.20
This closes #3701.
2 months ago
Kunni 1aa89733d8 [FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
This closes #3727.
2 months ago
yuxiqian 1be923467c [FLINK-36408][source-connector/mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision
This closes #3711.
2 months ago
yuxiqian bd2aa0aaa1
[FLINK-35985][transform] Correct the substring function in transform rule
This closes #3702.

Co-authored-by: MOBIN <18814118038@163.com>
2 months ago
yuxiqian 908949bc72
[FLINK-36326][source-connector/mysql] Fix auto scan newly-added table failure
This closes #3661.

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
Kunni 40db6d5eb7
[FLINK-36509][pipeline-connector][paimon] Add partition columns to primary key
This closes  #3726.
2 months ago
Kunni d7d7f42c0b
[FLINK-36211][pipeline-connector/kafka] Shade org.apache.flink.streaming.connectors.kafka to avoid conflict with flink-connector-kafka jar
This closes #3697
2 months ago
Junbo wang 0b805a69ac
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
This closes  #3715
2 months ago
Runkang He f0a6104e2c
[FLINK-36681][mysql-cdc][docs] Fix the wrong chunks splitting query in incremental snapshot reading section
This closes  #3732.
3 months ago
Hang Ruan 452bceaa2d
[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp (#3731)
This closes #3332

Co-authored-by: ConradJam <jam.gzczy@gmail.com>
3 months ago
yuxiqian 086536bb30
[hotfix][e2e] Temporarily disable TransformE2eITCase in multiple parallelism
This closes #3718
3 months ago
Kunni 3025d9138a
[FLINK-36560][pipeline-connector][paimon] Fix the issue that timestamp_ltz field is not correctly converted
This closes  #3717.
3 months ago
Timi 8c2c17c3bc
[FLINK-36678][docs][deploy] Fix the typo in Flink CDC YARN deployment documentation
This closes #3720.
3 months ago
North Lin c085c12d2e
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColumnEvent
This closes  #3714.
3 months ago
yuxiqian 42c9a05202
[FLINK-36214][build] Downgrade scala-maven-plugin version to 4.8.0 to keep compatibility with Java 8
This closes #3662
3 months ago
yuxiqian 5c1c50e2ed
[FLINK-36474][route] Support merging timestamp columns when routing
This closes #3693
3 months ago
Hang Ruan a01e72088b
[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error (#3678) (#3700)
Co-authored-by: wudi <676366545@qq.com>
3 months ago
Hang Ruan aa6de9e9c6
[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase (#3602) (#3699)
Co-authored-by: Xin Gong <genzhedangdang@gmail.com>
3 months ago
yuxiqian 722eb2e76a
[FLINK-36221][docs] Add `CAST ... AS ...` documentations (#3694) 3 months ago
yuxiqian bd5cab30d4
[FLINK-36151][docs] Add schema evolution related docs
This closes  #3640.
4 months ago
yuxiqian 316ea9c6ab
[BP-3.2][FLINK-36183][cdc-runtime] Fix lenient schema evolution failure with route blocks (#3584) 5 months ago
yuxiqian fc752fb3c8
[FLINK-36184][transform] Fix transform operator swallows schema changes from tables not present in transform rules (#3591) 5 months ago
yuxiqian 6ef4734e2e
[hotfix][mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax
This closes #3582
5 months ago
yuxiqian 1ebefd6d2e [hotfix] Run schema coordinator logic asynchronously to avoid blocking the main thread 5 months ago
yuxiqian 9816848c4b [hotfix][cdc-runtime] Keep upstream pending requests in order to avoid checkpoint hanging 5 months ago
yuxiqian debd43cdd7 [FLINK-36128][cdc-runtime] Fix potential unrecoverable in-flight data exception by promoting LENIENT as the default schema change behavior
This closes #3574.

(cherry picked from commit 2e938a92f5)
5 months ago
Sergei Morozov daf28ddc99 [FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp
This closes #3561.

(cherry picked from commit 52f2019469)
5 months ago
yuxiqian 803d438657 [hotfix][cdc-runtime] Fix schema registry hanging in multiple parallelism 5 months ago
yuxiqian dacbe7c34a [FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcarded transform rule
This closes #3557.

(cherry picked from commit 3837887819)
5 months ago
yuxiqian 6dd1c11fe1 [FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
This closes #3563.

Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>

(cherry picked from commit ee843e2f24)
5 months ago
Hongshun Wang 5a80757443 [FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
This closes #3558.

(cherry picked from commit 6205a5a0f1)
5 months ago
Kevin Wang 39afc4fc89 [FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart (#3548)
Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>
(cherry picked from commit 77c63385d9)
5 months ago
Hongshun Wang 9f358ab1d7 [FLINK-36076][minor][cdc-runtime] Set isSchemaChangeApplying as volatile for thread safe consideration
This closes #3556.

(cherry picked from commit d3473de4db)
5 months ago
Kunni 568888af75 [FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration
This closes #3553

(cherry picked from commit 7f08c6caba)
5 months ago
Kunni 74f58cd317 [FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink
This closes #3549.
5 months ago