Commit Graph

1190 Commits (dd865bf440b13b34fde40d4644bad7e517fa70f7)
 

Author SHA1 Message Date
yuxiqian 51c679a914
[FLINK-36596][transform] Fix unable to schema evolve with project-less transform rules
This closes  #3665.
3 months ago
MOBIN 5db16ba30c
[FLINK-36093][transform] Fix preTransformoperator wrongly filters columns belong to different transforms
This closes #3572
3 months ago
ConradJam 13248faa22
[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp
This closes #3332

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
Shawn Huang d9ceee050b
[FLINK-36699][cdc-common] fix nullability when converting cdc data type to flink data type (#3713) 3 months ago
Kunni ae986ab3f6
[FLINK-36609][pipeline-connector][paimon] Add partition columns to primary keys
This closes  #3641.
3 months ago
yuxiqian b5ab385b8c
[FLINK-36461][transform] Fix schema evolution failure with un-transformed tables
This closes  #3632.
3 months ago
Runkang He ba74c7c45f
[FLINK-36681][mysql-cdc][docs] Fix the wrong chunks splitting query in incremental snapshot reading section
This closes  #3703.
3 months ago
Kunni f38341b02e
[FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
This closes #3652.
3 months ago
Timi 8b8330e245
[FLINK-36678][docs][deploy] Fix the typo in Flink CDC YARN deployment documentation
This closes #3706.
3 months ago
Junbo wang ff77a490bd
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
This closes  #3639
3 months ago
North Lin 8647fe4986
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColunEvent
This closes  #3622.
3 months ago
yuxiqian 57a1a7df93
[FLINK-36408][pipeline-connector][mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision (#3625) 3 months ago
Kunni ecfee702dc
[FLINK-36560][pipeline-connector][paimon] Fix the issue that timestamp_ltz field is not correctly converted
This closes  #3648.
3 months ago
Sergei Morozov e15bf6f04a
[FLINK-36407][runtime] Shut down coordinatorExecutor upon closing SchemaRegistry (#3624) 3 months ago
Runkang He be9b52750c
[FLINK-36572][pipeline-connector][starrocks] Fix the issue that the local time zone is wrongly set
This closes  #3655.
3 months ago
wudi 7f6d9115ae
[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error (#3678) 3 months ago
yuxiqian 5184c010fd
[hotfix][transform][minor] Fix potential code conflict that SUBSTR built-in function is 1-based index now
This closes #3696
3 months ago
Xin Gong d5f1b9ace8
[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase (#3602) 3 months ago
yuxiqian 5d58769fe8
[FLINK-36105][flink-cdc-cli] Fix unable to restore from checkpoint with Flink 1.20 (#3564) 3 months ago
MOBIN 1d2cfd789e
[FLINK-35985][transform] Correct the substring function in transform rule
This closes #3537.
3 months ago
yuxiqian d620c5805e
[FLINK-35982][transform] Fix transform metadata failure when projection block is missed
This closes #3592.
3 months ago
yuxiqian 93c985150c
[FLINK-36221][docs] Add CAST function documentations (#3596) 3 months ago
yuxiqian 4df3d92721
[FLINK-36514][cdc-cli] Fix unable to override exclude schema types in lenient mode
This closes #3637.

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
3 months ago
yuxiqian 84f97ed4c1
[FLINK-36474][route] Support merging timestamp columns when routing
This closes  #3636.
3 months ago
Junbo wang e692e7b4bc
[FLINK-36052][docs][cdc-pipeline-connector/es] Add flink cdc pipeline elasticsearch connector docs
This closes #3649.

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
3 months ago
Hongshun Wang 086bd9996a
[FLINK-36618][cdc-connector][postgres] Improve PostgresDialect.discoverDataCollections to reduce the bootstrap time
This closes #3672.
3 months ago
North Lin c42b925251
[FLINK-35544][docs][deploy] Add deployment documentations for Kubernetes Operator
This closes #3392.
3 months ago
Hongshun Wang aa4f15a636
[FLINK-36174][cdc-cli] CDC yaml without pipeline should not throw exception. (#3588) 3 months ago
lzshlzsh 2a5828c0ac
[FLINK-35291][runtime] Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme (#3289)
Co-authored-by: liuzeshan <liuzeshan@bytedance.com>
3 months ago
Kunni f24399cf5a
[FLINK-36211][pipeline-connector/kafka] shade org.apache.flink.streaming.connectors.kafka to avoid conflict with flink-connector-kafka jar. (#3595) 3 months ago
Shawn Huang ecce75949a
[FLINK-36463][cdc-connector][mysql] Forbid to override some debezium options (#3631) 3 months ago
yuxiqian d5f549f91f
[FLINK-36326][cdc-connector][mysql] Send BinlogSplitUpdateRequestEvent only once to fix auto scan newly-added table failure (#3613)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
yuxiqian 0222d39b64
[FLINK-36214][build] Downgrade scala-maven-plugin version to 4.8.0 to keep compatibility with Java 8 (#3594) 3 months ago
yuxiqian dd69756d3f
[hotfix][ci] Fix ci failure in new GitHub runner images (#3645)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
4 months ago
gongzhongqiang e8251310ed [hotfix][ci] Optimize CI performance by implementing parallel execution 4 months ago
yuxiqian daf27fa7a8 [hotfix][test] Reorganize test cases 4 months ago
yuxiqian a1781f432d
[FLINK-36151][docs] Add schema evolution related docs
This closes #3575.
4 months ago
gongzhongqiang 2616c0ecd7
[hotfix][tests] Fix oracle e2e test with ARM docker image without a database initial (#3634) 4 months ago
Vincent-Woo 4b13c49163
[FLINK-34738][cdc][docs-zh] "Deployment - YARN" Page for Flink CDC Chinese Documentation (#3205)
* [FLINK-34738][cdc][docs-zh] "Deployment - YARN" Page for Flink CDC Chinese Documentation

* [FLINK-34738][cdc][docs-zh] Optimization for "Deployment - YARN" Page's Chinese Documentation
4 months ago
yuxiqian 17c0dc4ad4
[hotfix][CI] Fix Stale label automatically removed without update activity
This closes #3621.
4 months ago
gongzhongqiang a5b666a325
[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture (#3600) 4 months ago
Qingsheng Ren 4b4b8ea5bb
[FLINK-36226][cdc][docs] Build 3.2 docs and mark it as stable (#3597) 5 months ago
yuxiqian 73977c127b
[FLINK-36183] Fix lenient schema evolution failure with route blocks (#3583) 5 months ago
yuxiqian 06fc939569
[FLINK-36184][transform] Fix transform operator swallows schema changes from tables not present in transform rules (#3589) 5 months ago
yuxiqian cb1b232794
[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup
This closes  #3580
5 months ago
yuxiqian 0e9a176b08
[hotfix][pipeline-connector/mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax
This closes  #3579.
5 months ago
yuxiqian a876af2589
[minor][cdc-runtime] Run schema coordinator logic asynchronously to avoid blocking the main thread
This closes #3557
5 months ago
Hongshun Wang afe9c3c0ad
[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true
This closes  #3573.
5 months ago
Kunni 3c1517f70f
[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent
This closes #3570.
5 months ago
yuxiqian 0df63e26e8
[hotfix][cdc-runtime] Keep upstream pending requests in order to avoid checkpoint hanging & state inconsistency in timestamp startup mode
This closes  #3576.
5 months ago