Commit Graph

77 Commits (92b5483e17c034dbd2c1da4dd829f27087e74b71)

Author SHA1 Message Date
proletarians c5396fbf29
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version
This closes  #3542.
6 months ago
wuzexian 8137f9d746 [FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions
This closes #3495.
6 months ago
wuzexian ac14dba9fb [FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline 6 months ago
Junbo wang 15ab85860b
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column (#3490)
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
6 months ago
Kunni 64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
This closes  #3499.
6 months ago
Kunni 3bb1f3ca45
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit
This closes #3504.
6 months ago
Kunni e0d6d1d1a8
[FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option to make sure the same record sending to the same partition. (#3522) 6 months ago
Hang Ruan 07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511) 6 months ago
North Lin 09f36a4a05
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. (#3411)
Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com>
Co-authored-by: north.lin <north.lin@yunlsp.com>
6 months ago
Kunni 9d6154f123
[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink (#3461) 6 months ago
hk__lrzy 21fade0e22
[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. (#3352)
Co-authored-by: haoke <haoke@bytedance.com>
6 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
6 months ago
lvyanquan 4561a8a32b [FLINK-34638][cdc-common] Support column with default value 6 months ago
gongzhongqiang 1778ef685a Revert "[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available "
This reverts commit 3315be3c8f.
6 months ago
Wink 7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
This closes #3449.

Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
yuxiqian 3315be3c8f
[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available
This closes #3508.
6 months ago
yuxiqian a39959f4b3
[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris pipeline sink
This closes  #3473
6 months ago
Junbo wang b15a226ccd
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2
This closes #3335

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
6 months ago
yux 2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options 8 months ago
North Lin c958daf8ab
[FLINK-35540][cdc-common] Fix table missed when database and table are with the same name
This closes  #3396.
8 months ago
yux 17ff659ff7
[hotfix][build] Remove test-jar from parent pom and only add to necessary modules
This closes  #3397.

Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
8 months ago
Xin Gong e2ccc836a0
[FLINK-34908][pipeline-connector][doris] Fix MySQL to doris pipeline will lose precision for timestamp type
This closes  #3207.
8 months ago
yuxiqian 1a360635c7 [FLINK-35092][cdc][starrocks] Add starrocks integration test cases 8 months ago
yuxiqian 8eb7e53965 [FLINK-35120][doris] Add Doris integration test cases 8 months ago
joyCurry30 8a7fdd5ae3
[minor][cdc-connector][paimon] Remove duplicate interface implements 8 months ago
joyCurry30 0214166049
[FLINK-35325][cdc-connector][paimon] Support specify column order when adding new columns to a table
This closes #3323.
8 months ago
joyCurry30 0e8b2c7cc5
[FLINK-35430][cdc-connector][kafka] Pass the time zone infor to JsonSerializationSchema
This closes  #3359.
8 months ago
Kunni ec643c9dd7
[FLINK-35235][pipeline-connector][kafka] Fix missing dependencies in the uber jar of Kafka pipeline sink 10 months ago
Kunni ef2eece256
[pipeline-connector][paimon] add paimon pipeline data sink connector. (#2916) 10 months ago
yux 01ec7da989
[FLINK-35055][cdc] Exclude connector dependencies with questionable licenses from fat jar packages (#3212) 10 months ago
Kunni 253ef9256b
[pipeline-connector][kafka] Add kafka pipeline data sink connector. (#2938) 10 months ago
yux 5e52d8620c
[FLINK-35102][cdc][doris-sink] Correct Doris connector varchar type mapping
This closes #3224.
10 months ago
Thorne 0d797a6021
[FLINK-34903][cdc][mysql] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables (#3186) 10 months ago
Kunni d4ed7db8dc
[FLINK-35127][cdc][values] Remove HybridSource from ValuesSource to avoid CI failure. (#3237) 10 months ago
Hongshun Wang 025653d772
[hotfix] run mvn spotless to fix code style violations. (#3219) 10 months ago
Qishang Zhong 18dd51fe22
[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BINARY data type of Add column DDL (#3145) 10 months ago
Hongshun Wang abb98ee257
[FLINK-34690] Cast decimal to VARCHAR as primary key in starrocks sink (#3150) 10 months ago
Hongshun Wang 8c5437a1f1
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction (#3204) 10 months ago
wenmo bcad5d9d11 [cdc-runtime] Introduce TransformSchemaOperator and TransformDataOperator to support transformation 10 months ago
xleoken 5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110) 11 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
Hongshun Wang 7ea197242f
[debezium] Upgrade to Debezium 1.9.8.Final(#3033) (#3034) 1 year ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Kunni 9abf2cf900
[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not included in capturedTableFilter (#2986)
This closes #2981
1 year ago
Hongshun Wang 3bf886b94d [cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source (#2901) 1 year ago
He Wang f3762a1b30
[pipeline-connector][mysql] fix timestamp with timezone format (#2952)
* fix ts with tz parser

* test timestamp with default value

* fix related test

* use timestamp string in test cases
1 year ago
张田 1b643026fe
[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector (#2895) 1 year ago
Kunni 812c33d27b
[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe (#2954) 1 year ago
joyCurry30 055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886) 1 year ago