Commit Graph

186 Commits (0470fdbbc13a4281083488274e891a74cc8e81a8)

Author SHA1 Message Date
Kunni 0470fdbbc1
[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink
This closes #3549
6 months ago
He Wang cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439) 6 months ago
proletarians c5396fbf29
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version
This closes  #3542.
7 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 7 months ago
wuzexian 8137f9d746 [FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions
This closes #3495.
7 months ago
wuzexian ac14dba9fb [FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline 7 months ago
Junbo wang 15ab85860b
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column (#3490)
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
7 months ago
Kunni 64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
This closes  #3499.
7 months ago
Kunni 3bb1f3ca45
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit
This closes #3504.
7 months ago
Kunni e0d6d1d1a8
[FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option to make sure the same record sending to the same partition. (#3522) 7 months ago
Hongshun Wang 4bf5a395a5
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly
This closes #3519.
7 months ago
Hang Ruan 07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511) 7 months ago
North Lin 09f36a4a05
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. (#3411)
Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com>
Co-authored-by: north.lin <north.lin@yunlsp.com>
7 months ago
yuxiqian b937db25d5
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling (#3506) 7 months ago
Kunni 9d6154f123
[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink (#3461) 7 months ago
hk__lrzy 21fade0e22
[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. (#3352)
Co-authored-by: haoke <haoke@bytedance.com>
7 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
7 months ago
lvyanquan 4561a8a32b [FLINK-34638][cdc-common] Support column with default value 7 months ago
gongzhongqiang 1778ef685a Revert "[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available "
This reverts commit 3315be3c8f.
7 months ago
Wink 7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
This closes #3449.

Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
7 months ago
yuxiqian 3315be3c8f
[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available
This closes #3508.
7 months ago
lipl f6d1d4810a
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly (#3497)
* resolve conficts

* polish code to trigger ci

---------

Co-authored-by: Kael <kael@fts.dev>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
7 months ago
Thorne 986f37b307
[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file (#3432) 7 months ago
Hongshun Wang 0c49959f67
[FLINK-35524][cdc-base] Clear connections pools when reader exist. (#3388) 7 months ago
Hongshun Wang 47f5660055
[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter (#3319) 7 months ago
yuxiqian a39959f4b3
[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris pipeline sink
This closes  #3473
7 months ago
Junbo wang b15a226ccd
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2
This closes #3335

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
7 months ago
yuxiqian 241eb03a74
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0
This closes #3489.
7 months ago
SeungMin 91fc7bb506
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key
This closes #3448.
7 months ago
Zhongmin Qiao ea71b2302d
[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set before call getBinlogPosition method
This closes #3488.
7 months ago
ChengJie1053 313bace106
[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchema doc description
This closes #3443.
7 months ago
gongzhongqiang c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481) 7 months ago
Xin Gong 332e1f330d
[minor][cdc-connector][sqlserver] Fix some typos (#3421) 7 months ago
ChengJie1053 9a97182fbb
[minor][cdc-connector][mysql] Code optimization for constants
This closes #3385
7 months ago
ChengJie1053 2d50e43137
[minor][cdc-connector][postgres] PostgresDialect removes useless code
This closes #3416.
7 months ago
Joao Boto 94a0415475
[FLINK-34883] Fix postgres uuid column as PK (#3282)
* [FLINK-34883] Fix postgres uuid column as PK

* [FLINK-34883] Fix column comment.
8 months ago
skylines a2539f5cfa
[hotfix][docs][postgres] Remove unsupported erroneous example code
This closes #3464
8 months ago
Xin Gong 2d1eb0aff1
[FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add table (#3203)
* [cdc-connector][oracle] Oracle cdc support newly add table

* [cdc-connector][oracle] Fix code style

* [cdc-connector][oracle] Address comment
8 months ago
ouyangwulin 302a691225
[FLINK-35354] Support host mapping in Flink tikv cdc (#3336)
* [FLINK-35337][cdc] Keep up with the latest version of tikv client

* [FLINK-35354]Support host mapping in Flink tikv cdc

* [FLINK-35354] Add doc for host mapping feature

* [FLINK-35354] fixed annotation import
8 months ago
Shawn Huang 80920aaa28
[FLINK-35297][mysql] Add validation for option connect.timeout because of HikariConfig limitation (#3295) 8 months ago
yux 2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options 9 months ago
North Lin c958daf8ab
[FLINK-35540][cdc-common] Fix table missed when database and table are with the same name
This closes  #3396.
9 months ago
yux 17ff659ff7
[hotfix][build] Remove test-jar from parent pom and only add to necessary modules
This closes  #3397.

Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
9 months ago
Xin Gong e2ccc836a0
[FLINK-34908][pipeline-connector][doris] Fix MySQL to doris pipeline will lose precision for timestamp type
This closes  #3207.
9 months ago
yuxiqian 1a360635c7 [FLINK-35092][cdc][starrocks] Add starrocks integration test cases 9 months ago
yuxiqian 8eb7e53965 [FLINK-35120][doris] Add Doris integration test cases 9 months ago
joyCurry30 8a7fdd5ae3
[minor][cdc-connector][paimon] Remove duplicate interface implements 9 months ago
joyCurry30 0214166049
[FLINK-35325][cdc-connector][paimon] Support specify column order when adding new columns to a table
This closes #3323.
9 months ago
Muhammet Orazov 5b28d1a579
[FLINK-35129][postgres] Introduce scan.lsn-commit.checkpoints-num-delay option to control LSN offset commit lazily
This close #3349.
9 months ago
joyCurry30 0e8b2c7cc5
[FLINK-35430][cdc-connector][kafka] Pass the time zone infor to JsonSerializationSchema
This closes  #3359.
9 months ago