Commit Graph

1237 Commits (866f0abe59021701b521b90b86dad2722d666ef4)
 

Author SHA1 Message Date
yuxiqian 44dafe33bd
[FLINK-35813][cdc-runtime] Do not clear state field in TransformSchemaOperator until operator closed
This closes #3469.
6 months ago
yuxiqian 3315be3c8f
[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available
This closes #3508.
6 months ago
lipl f6d1d4810a
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly (#3497)
* resolve conficts

* polish code to trigger ci

---------

Co-authored-by: Kael <kael@fts.dev>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
6 months ago
Thorne 986f37b307
[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file (#3432) 6 months ago
Hongshun Wang 0c49959f67
[FLINK-35524][cdc-base] Clear connections pools when reader exist. (#3388) 6 months ago
Hongshun Wang 47f5660055
[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter (#3319) 6 months ago
yuxiqian 8f2939e913
[hotfix][ci] Migrate to Docker Compose V2 (#3505) 6 months ago
Wink 1388cf9906
[FLINK-34877][cdc] Support type cast conversion in pipeline transform
This closes #3357.
7 months ago
yuxiqian a39959f4b3
[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris pipeline sink
This closes  #3473
7 months ago
Leonard Xu 85bfd6ae52
[docs][minor] Add transform piece for pipeline example
This closes  #3496
7 months ago
yuxiqian 5917f78704
[FLINK-35736][test] Add migration test scripts & CI workflows
This closes #3447
7 months ago
Junbo wang b15a226ccd
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2
This closes #3335

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
7 months ago
yuxiqian 241eb03a74
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0
This closes #3489.
7 months ago
yuxiqian 768d528d9c
[minor][test] Add Flink CDC 3.1.1 version to migration test version list
This closes #3426.
7 months ago
SeungMin 91fc7bb506
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key
This closes #3448.
7 months ago
Zhongmin Qiao ea71b2302d
[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set before call getBinlogPosition method
This closes #3488.
7 months ago
ChengJie1053 313bace106
[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchema doc description
This closes #3443.
7 months ago
gongzhongqiang c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481) 7 months ago
Kunni fcb4cd8f6c
[FLINK-35871][doc] Add missed "snapshot" mode to mysql connector startup options
This closes #3484.
7 months ago
Leonard Xu 26ff6d2a08 [FLINK-35237][cdc-common] Improve the interfaces and reorganize the directory. 7 months ago
鼎昕 9a4dede3fe [FLINK-35237][cdc-common] Allow Sink to choose HashFunction in PrePartitionOperator 7 months ago
FangXiangmin ec0becd6fa
[docs][minor] Specify the lib directory of Flink CDC in quick start docs
This closes #3479.

Co-authored-by: fangxiangmin <fangxiangmin>
Co-authored-by: Leonard Xu <leonard@apache.org>
Co-authored-by: yux <34335406+yuxiqian@users.noreply.github.com>
7 months ago
Xin Gong 332e1f330d
[minor][cdc-connector][sqlserver] Fix some typos (#3421) 7 months ago
ChengJie1053 9a97182fbb
[minor][cdc-connector][mysql] Code optimization for constants
This closes #3385
7 months ago
Kunni 274401e81b
[FLINK-35758][doc][cdc-connector][mysql] Add missed scan.startup.timestamp-millis option for mysql connector
This closes  #3453.
7 months ago
ChengJie1053 2d50e43137
[minor][cdc-connector][postgres] PostgresDialect removes useless code
This closes #3416.
7 months ago
Joao Boto 94a0415475
[FLINK-34883] Fix postgres uuid column as PK (#3282)
* [FLINK-34883] Fix postgres uuid column as PK

* [FLINK-34883] Fix column comment.
7 months ago
yux 11deb62637
[build][CI] Introduce automated PR governance workflows
This closes  #3466
7 months ago
skylines a2539f5cfa
[hotfix][docs][postgres] Remove unsupported erroneous example code
This closes #3464
7 months ago
Xin Gong 2d1eb0aff1
[FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add table (#3203)
* [cdc-connector][oracle] Oracle cdc support newly add table

* [cdc-connector][oracle] Fix code style

* [cdc-connector][oracle] Address comment
7 months ago
Jiabao Sun 137dc1b2e6
[minor][cdc][docs] Optimize markdown formats in doris quickstart doc
This closes #3324.
7 months ago
yuxiqian a098ddacba
[FLINK-35781][cli] Provide a default parallelism 1 for pipeline jobs
This closes #3458.
7 months ago
yuxiqian ad1f554c0e
[FLINK-35647][route] Support symbol replacement to enrich routing rules
This closes #3428.

Co-authored-by: 张田 <zhang_tian@inspur.com>
Co-authored-by: yangshuaitong <duguhoney@gmail.com>
7 months ago
ouyangwulin 302a691225
[FLINK-35354] Support host mapping in Flink tikv cdc (#3336)
* [FLINK-35337][cdc] Keep up with the latest version of tikv client

* [FLINK-35354]Support host mapping in Flink tikv cdc

* [FLINK-35354] Add doc for host mapping feature

* [FLINK-35354] fixed annotation import
7 months ago
Hongshun Wang ca1470d5dd
[FLINK-35281][cdc-common] FlinkEnvironmentUtils#addJar add each jar only once (#3301) 7 months ago
yux 0723009a69
[FLINK-35700][cli] Loosen CDC pipeline options validation
This closes  #3435.
8 months ago
yux 3441a1e2ab
[FLINK-35648][runtime] Allow applying multiple route rules for one single source table (#3425) 8 months ago
yux 239debc028
[hotfix][ci] Add new pipeline connectors into labeler.yml 8 months ago
Laffery 06bf14359a
[docs][minor] Optimize styles of the Flink CDC index page
This closes  #3420
8 months ago
Shawn Huang 80920aaa28
[FLINK-35297][mysql] Add validation for option connect.timeout because of HikariConfig limitation (#3295) 8 months ago
yux 2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options 8 months ago
North Lin c958daf8ab
[FLINK-35540][cdc-common] Fix table missed when database and table are with the same name
This closes  #3396.
8 months ago
GOODBOY008 7d35f3c1d3 [FLINK-35545][doc] Revert dbz doc 2.0 back to 1.9 8 months ago
GOODBOY008 4efb1d78ca [FLINK-35545][doc] Miss 3.1.0 version in snapshot flink-cdc doc version list 8 months ago
yux 17ff659ff7
[hotfix][build] Remove test-jar from parent pom and only add to necessary modules
This closes  #3397.

Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
8 months ago
Junbo wang d8f905f23e
[hotfix][ci] PIPELINE_CONNECTORS stage should include pipeline connector paimon
This closes #3344.
8 months ago
Hongshun Wang ed4cd40afc
[hotfix][cdc-composor] Adjust test of cdc composer from junit4 to junit5 8 months ago
Xin Gong e2ccc836a0
[FLINK-34908][pipeline-connector][doris] Fix MySQL to doris pipeline will lose precision for timestamp type
This closes  #3207.
8 months ago
yuxiqian 1a360635c7 [FLINK-35092][cdc][starrocks] Add starrocks integration test cases 8 months ago
yuxiqian 8eb7e53965 [FLINK-35120][doris] Add Doris integration test cases 8 months ago