Commit Graph

218 Commits (8e6c361f961966c25c9c34ffecdfc87cf2b599a3)

Author SHA1 Message Date
yuxiqian 8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
This closes #3691.
3 months ago
ConradJam 13248faa22
[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp
This closes #3332

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
Kunni ae986ab3f6
[FLINK-36609][pipeline-connector][paimon] Add partition columns to primary keys
This closes  #3641.
4 months ago
Kunni f38341b02e
[FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
This closes #3652.
4 months ago
Junbo wang ff77a490bd
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
This closes  #3639
4 months ago
North Lin 8647fe4986
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColunEvent
This closes  #3622.
4 months ago
yuxiqian 57a1a7df93
[FLINK-36408][pipeline-connector][mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision (#3625) 4 months ago
Kunni ecfee702dc
[FLINK-36560][pipeline-connector][paimon] Fix the issue that timestamp_ltz field is not correctly converted
This closes  #3648.
4 months ago
Runkang He be9b52750c
[FLINK-36572][pipeline-connector][starrocks] Fix the issue that the local time zone is wrongly set
This closes  #3655.
4 months ago
wudi 7f6d9115ae
[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error (#3678) 4 months ago
Xin Gong d5f1b9ace8
[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase (#3602) 4 months ago
yuxiqian 84f97ed4c1
[FLINK-36474][route] Support merging timestamp columns when routing
This closes  #3636.
4 months ago
Junbo wang e692e7b4bc
[FLINK-36052][docs][cdc-pipeline-connector/es] Add flink cdc pipeline elasticsearch connector docs
This closes #3649.

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
4 months ago
Hongshun Wang 086bd9996a
[FLINK-36618][cdc-connector][postgres] Improve PostgresDialect.discoverDataCollections to reduce the bootstrap time
This closes #3672.
4 months ago
Kunni f24399cf5a
[FLINK-36211][pipeline-connector/kafka] shade org.apache.flink.streaming.connectors.kafka to avoid conflict with flink-connector-kafka jar. (#3595) 4 months ago
Shawn Huang ecce75949a
[FLINK-36463][cdc-connector][mysql] Forbid to override some debezium options (#3631) 4 months ago
yuxiqian d5f549f91f
[FLINK-36326][cdc-connector][mysql] Send BinlogSplitUpdateRequestEvent only once to fix auto scan newly-added table failure (#3613)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
4 months ago
yuxiqian daf27fa7a8 [hotfix][test] Reorganize test cases 4 months ago
gongzhongqiang a5b666a325
[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture (#3600) 5 months ago
yuxiqian cb1b232794
[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup
This closes  #3580
6 months ago
yuxiqian 0e9a176b08
[hotfix][pipeline-connector/mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax
This closes  #3579.
6 months ago
Hongshun Wang afe9c3c0ad
[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true
This closes  #3573.
6 months ago
Kunni 3c1517f70f
[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent
This closes #3570.
6 months ago
Jiabao Sun aea2b6aa9c
[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run (#3555) 6 months ago
Sergei Morozov 52f2019469
[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp
This closes #3561.
6 months ago
yuxiqian ee843e2f24
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
This closes #3563.

Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>
6 months ago
Kunni 565032e3af
[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-table.enabled option for MySQL Source
This closes  #3560.
6 months ago
Hongshun Wang 6205a5a0f1
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
This closes #3558.
6 months ago
Kevin Wang 77c63385d9
[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart (#3548)
Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>
6 months ago
MOBIN aedccb698e
[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCommittableChannelComputer Topology name
This closes #3559
6 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
6 months ago
Kunni 7f08c6caba
[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration
This closes #3553
6 months ago
Kunni 0470fdbbc1
[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink
This closes #3549
6 months ago
He Wang cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439) 6 months ago
proletarians c5396fbf29
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version
This closes  #3542.
7 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 7 months ago
wuzexian 8137f9d746 [FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions
This closes #3495.
7 months ago
wuzexian ac14dba9fb [FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline 7 months ago
Junbo wang 15ab85860b
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column (#3490)
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
7 months ago
Kunni 64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
This closes  #3499.
7 months ago
Kunni 3bb1f3ca45
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit
This closes #3504.
7 months ago
Kunni e0d6d1d1a8
[FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option to make sure the same record sending to the same partition. (#3522) 7 months ago
Hongshun Wang 4bf5a395a5
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly
This closes #3519.
7 months ago
Hang Ruan 07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511) 7 months ago
North Lin 09f36a4a05
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. (#3411)
Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com>
Co-authored-by: north.lin <north.lin@yunlsp.com>
7 months ago
yuxiqian b937db25d5
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling (#3506) 7 months ago
Kunni 9d6154f123
[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink (#3461) 7 months ago
hk__lrzy 21fade0e22
[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. (#3352)
Co-authored-by: haoke <haoke@bytedance.com>
7 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
7 months ago
lvyanquan 4561a8a32b [FLINK-34638][cdc-common] Support column with default value 7 months ago