Commit Graph

1154 Commits (c2e301222cba4120e4eded48de3c7d2e17700766)
 

Author SHA1 Message Date
Hang Ruan 07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511) 6 months ago
North Lin 09f36a4a05
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. (#3411)
Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com>
Co-authored-by: north.lin <north.lin@yunlsp.com>
6 months ago
yuxiqian b937db25d5
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling (#3506) 6 months ago
ConradJam d6b687b61d
[FLINK-34853] Submit CDC Job To Flink K8S Native Application Mode (#3093) 6 months ago
yuxiqian 81d916fc73
[FLINK-35272][cdc-runtime] Transform supports omitting and renaming computed column
This closes #3285.
6 months ago
Wink 2dabfc0815
[FLINK-35730][cdc-cli] PipelineDefinitionParser supports parsing pipeline def in text format
This closes #3444.
6 months ago
yuxiqian af02ce1bc9
[build][e2e] Separate Pipeline and Source E2e tests and cover flink 1.20 version
This closes #3514.
6 months ago
Kunni 9d6154f123
[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink (#3461) 6 months ago
hk__lrzy 21fade0e22
[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. (#3352)
Co-authored-by: haoke <haoke@bytedance.com>
6 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
6 months ago
yuxiqian 54c6a0b207
[hotfix][e2e] Add missing default values field in E2e test
This closes #3516.
6 months ago
Leonard Xu 03a2ae3ca7 [FLINK-35893][cdc-runtime] Write CURRENT_VERSION of TableChangeInfo to state
This closes #2944.
6 months ago
lvyanquan 4561a8a32b [FLINK-34638][cdc-common] Support column with default value 6 months ago
gongzhongqiang f06cc1f31b [hotfix][ci] Clean up disk space 6 months ago
gongzhongqiang 1778ef685a Revert "[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available "
This reverts commit 3315be3c8f.
6 months ago
Wink 7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
This closes #3449.

Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
Hongshun Wang d76beecdb0
[FLINK-35234][minor][cdc-common] Fix potential NPE in ConfigurationUtils
This closes #3255.
6 months ago
yuxiqian 44dafe33bd
[FLINK-35813][cdc-runtime] Do not clear state field in TransformSchemaOperator until operator closed
This closes #3469.
6 months ago
yuxiqian 3315be3c8f
[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available
This closes #3508.
6 months ago
lipl f6d1d4810a
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly (#3497)
* resolve conficts

* polish code to trigger ci

---------

Co-authored-by: Kael <kael@fts.dev>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
6 months ago
Thorne 986f37b307
[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file (#3432) 6 months ago
Hongshun Wang 0c49959f67
[FLINK-35524][cdc-base] Clear connections pools when reader exist. (#3388) 6 months ago
Hongshun Wang 47f5660055
[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter (#3319) 6 months ago
yuxiqian 8f2939e913
[hotfix][ci] Migrate to Docker Compose V2 (#3505) 6 months ago
Wink 1388cf9906
[FLINK-34877][cdc] Support type cast conversion in pipeline transform
This closes #3357.
6 months ago
yuxiqian a39959f4b3
[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris pipeline sink
This closes  #3473
6 months ago
Leonard Xu 85bfd6ae52
[docs][minor] Add transform piece for pipeline example
This closes  #3496
6 months ago
yuxiqian 5917f78704
[FLINK-35736][test] Add migration test scripts & CI workflows
This closes #3447
6 months ago
Junbo wang b15a226ccd
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2
This closes #3335

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
6 months ago
yuxiqian 241eb03a74
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0
This closes #3489.
6 months ago
yuxiqian 768d528d9c
[minor][test] Add Flink CDC 3.1.1 version to migration test version list
This closes #3426.
6 months ago
SeungMin 91fc7bb506
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key
This closes #3448.
6 months ago
Zhongmin Qiao ea71b2302d
[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set before call getBinlogPosition method
This closes #3488.
6 months ago
ChengJie1053 313bace106
[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchema doc description
This closes #3443.
6 months ago
gongzhongqiang c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481) 6 months ago
Kunni fcb4cd8f6c
[FLINK-35871][doc] Add missed "snapshot" mode to mysql connector startup options
This closes #3484.
6 months ago
Leonard Xu 26ff6d2a08 [FLINK-35237][cdc-common] Improve the interfaces and reorganize the directory. 6 months ago
鼎昕 9a4dede3fe [FLINK-35237][cdc-common] Allow Sink to choose HashFunction in PrePartitionOperator 6 months ago
FangXiangmin ec0becd6fa
[docs][minor] Specify the lib directory of Flink CDC in quick start docs
This closes #3479.

Co-authored-by: fangxiangmin <fangxiangmin>
Co-authored-by: Leonard Xu <leonard@apache.org>
Co-authored-by: yux <34335406+yuxiqian@users.noreply.github.com>
7 months ago
Xin Gong 332e1f330d
[minor][cdc-connector][sqlserver] Fix some typos (#3421) 7 months ago
ChengJie1053 9a97182fbb
[minor][cdc-connector][mysql] Code optimization for constants
This closes #3385
7 months ago
Kunni 274401e81b
[FLINK-35758][doc][cdc-connector][mysql] Add missed scan.startup.timestamp-millis option for mysql connector
This closes  #3453.
7 months ago
ChengJie1053 2d50e43137
[minor][cdc-connector][postgres] PostgresDialect removes useless code
This closes #3416.
7 months ago
Joao Boto 94a0415475
[FLINK-34883] Fix postgres uuid column as PK (#3282)
* [FLINK-34883] Fix postgres uuid column as PK

* [FLINK-34883] Fix column comment.
7 months ago
yux 11deb62637
[build][CI] Introduce automated PR governance workflows
This closes  #3466
7 months ago
skylines a2539f5cfa
[hotfix][docs][postgres] Remove unsupported erroneous example code
This closes #3464
7 months ago
Xin Gong 2d1eb0aff1
[FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add table (#3203)
* [cdc-connector][oracle] Oracle cdc support newly add table

* [cdc-connector][oracle] Fix code style

* [cdc-connector][oracle] Address comment
7 months ago
Jiabao Sun 137dc1b2e6
[minor][cdc][docs] Optimize markdown formats in doris quickstart doc
This closes #3324.
7 months ago
yuxiqian a098ddacba
[FLINK-35781][cli] Provide a default parallelism 1 for pipeline jobs
This closes #3458.
7 months ago
yuxiqian ad1f554c0e
[FLINK-35647][route] Support symbol replacement to enrich routing rules
This closes #3428.

Co-authored-by: 张田 <zhang_tian@inspur.com>
Co-authored-by: yangshuaitong <duguhoney@gmail.com>
7 months ago