138 Commits (e7964b160c1df3861571ba2199ba04d91d887ff2)

Author	SHA1	Message	Date
yuxiqian	cb1b232794	[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup ... This closes #3580	6 months ago
yuxiqian	0e9a176b08	[hotfix][pipeline-connector/mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax ... This closes #3579.	6 months ago
Hongshun Wang	afe9c3c0ad	[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true ... This closes #3573.	6 months ago
Kunni	3c1517f70f	[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent ... This closes #3570.	6 months ago
yuxiqian	ee843e2f24	[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent ... This closes #3563. Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>	6 months ago
Kunni	565032e3af	[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-table.enabled option for MySQL Source ... This closes #3560.	6 months ago
Hongshun Wang	6205a5a0f1	[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown ... This closes #3558.	6 months ago
MOBIN	aedccb698e	[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCommittableChannelComputer Topology name ... This closes #3559	6 months ago
yuxiqian	78fda8b5ab	[FLINK-35243][cdc-common] Extends more schema change event types support ... This close #3521.	6 months ago
Kunni	7f08c6caba	[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration ... This closes #3553	6 months ago
Kunni	0470fdbbc1	[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink ... This closes #3549	6 months ago
proletarians	c5396fbf29	[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version ... This closes #3542.	6 months ago
wuzexian	8137f9d746	[FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions ... This closes #3495.	7 months ago
wuzexian	ac14dba9fb	[FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline	7 months ago
Junbo wang	15ab85860b	[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column (#3490) ... Co-authored-by: wangjunbo <wangjunbo@qiyi.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	7 months ago
Kunni	64f996b504	[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink ... This closes #3499.	7 months ago
Kunni	3bb1f3ca45	[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit ... This closes #3504.	7 months ago
Kunni	e0d6d1d1a8	[FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option to make sure the same record sending to the same partition. (#3522)	7 months ago
Hang Ruan	07446d1f9d	[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511)	7 months ago
North Lin	09f36a4a05	[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. (#3411) ... Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com> Co-authored-by: north.lin <north.lin@yunlsp.com>	7 months ago
Kunni	9d6154f123	[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink (#3461)	7 months ago
hk__lrzy	21fade0e22	[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. (#3352) ... Co-authored-by: haoke <haoke@bytedance.com>	7 months ago
yuxiqian	5ed9e05bdf	[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior ... This closes #3339.	7 months ago
lvyanquan	4561a8a32b	[FLINK-34638][cdc-common] Support column with default value	7 months ago
gongzhongqiang	1778ef685a	Revert "[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available " ... This reverts commit 3315be3c8f.	7 months ago
Wink	7ca11359d7	[FLINK-35743][cdc-runtime] Correct the temporal function semantics ... This closes #3449. Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com> Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	7 months ago
yuxiqian	3315be3c8f	[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available ... This closes #3508.	7 months ago
yuxiqian	a39959f4b3	[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris pipeline sink ... This closes #3473	7 months ago
Junbo wang	b15a226ccd	[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2 ... This closes #3335 Co-authored-by: wangjunbo <wangjunbo@qiyi.com>	7 months ago
yux	2bd2e4ce24	[FLINK-35121][common] Adds validation for pipeline definition options	9 months ago
North Lin	c958daf8ab	[FLINK-35540][cdc-common] Fix table missed when database and table are with the same name ... This closes #3396.	9 months ago
yux	17ff659ff7	[hotfix][build] Remove test-jar from parent pom and only add to necessary modules ... This closes #3397. Co-authored-by: Qingsheng Ren <renqschn@gmail.com>	9 months ago
Xin Gong	e2ccc836a0	[FLINK-34908][pipeline-connector][doris] Fix MySQL to doris pipeline will lose precision for timestamp type ... This closes #3207.	9 months ago
yuxiqian	1a360635c7	[FLINK-35092][cdc][starrocks] Add starrocks integration test cases	9 months ago
yuxiqian	8eb7e53965	[FLINK-35120][doris] Add Doris integration test cases	9 months ago
joyCurry30	8a7fdd5ae3	[minor][cdc-connector][paimon] Remove duplicate interface implements	9 months ago
joyCurry30	0214166049	[FLINK-35325][cdc-connector][paimon] Support specify column order when adding new columns to a table ... This closes #3323.	9 months ago
joyCurry30	0e8b2c7cc5	[FLINK-35430][cdc-connector][kafka] Pass the time zone infor to JsonSerializationSchema ... This closes #3359.	9 months ago
Kunni	ec643c9dd7	[FLINK-35235][pipeline-connector][kafka] Fix missing dependencies in the uber jar of Kafka pipeline sink	10 months ago
Kunni	ef2eece256	[pipeline-connector][paimon] add paimon pipeline data sink connector. (#2916)	10 months ago
yux	01ec7da989	[FLINK-35055][cdc] Exclude connector dependencies with questionable licenses from fat jar packages (#3212)	10 months ago
Kunni	253ef9256b	[pipeline-connector][kafka] Add kafka pipeline data sink connector. (#2938)	10 months ago
yux	5e52d8620c	[FLINK-35102][cdc][doris-sink] Correct Doris connector varchar type mapping ... This closes #3224.	10 months ago
Thorne	0d797a6021	[FLINK-34903][cdc][mysql] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables (#3186)	10 months ago
Kunni	d4ed7db8dc	[FLINK-35127][cdc][values] Remove HybridSource from ValuesSource to avoid CI failure. (#3237)	10 months ago
Hongshun Wang	025653d772	[hotfix] run mvn spotless to fix code style violations. (#3219)	11 months ago
Qishang Zhong	18dd51fe22	[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BINARY data type of Add column DDL (#3145)	11 months ago
Hongshun Wang	abb98ee257	[FLINK-34690] Cast decimal to VARCHAR as primary key in starrocks sink (#3150)	11 months ago
Hongshun Wang	8c5437a1f1	[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction (#3204)	11 months ago
wenmo	bcad5d9d11	[cdc-runtime] Introduce TransformSchemaOperator and TransformDataOperator to support transformation	11 months ago
xleoken	5f4f86fb31	[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110)	11 months ago
Hang Ruan	e10c8691ad	[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink ... This closes #3089.	12 months ago
Hang Ruan	eeb4bab92d	[FLINK-34184][cdc][license] Update Copyright from Ververica to Apache	12 months ago
Hongshun Wang	7ea197242f	[debezium] Upgrade to Debezium 1.9.8.Final(#3033) (#3034)	1 year ago
joyCurry30	c98f899af8	[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888)	1 year ago
Kunni	9abf2cf900	[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not included in capturedTableFilter (#2986) ... This closes #2981	1 year ago
Hongshun Wang	3bf886b94d	[cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source (#2901)	1 year ago
He Wang	f3762a1b30	[pipeline-connector][mysql] fix timestamp with timezone format (#2952) ... * fix ts with tz parser * test timestamp with default value * fix related test * use timestamp string in test cases	1 year ago
张田	1b643026fe	[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector (#2895)	1 year ago
Kunni	812c33d27b	[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe (#2954)	1 year ago
joyCurry30	055b0af477	[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886)	1 year ago
Hongshun Wang	f15faac298	[docs] Fix overview docs to remove prefix of pipeline options (#2833)	1 year ago
PengFei Li	72bcb1df02	[pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks (#2829)	1 year ago
gongzhongqiang	c484bb447c	[build][hotfix] Remove duplicate dependency (#2828)	1 year ago
Qingsheng Ren	daceb42168	[build] Use ${project.version} instead of ${revision} for dependency version ... This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies	1 year ago
Jiabao Sun	8a08ded410	[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820) ... This closes #2820.	1 year ago
Jiabao Sun	7d7c1af553	[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816)	1 year ago
Jiabao Sun	8c75db145d	[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema (#2811)	1 year ago
Leonard Xu	0eae214183	[pipeline-connector][mysql] Enable send schema change by default (#2815) ... This closes #2815.	1 year ago
PengFei Li	33b7c85093	[pipeline-connector][starrocks] Add starrocks pipeline connector (#2765) ... This closes #2645.	1 year ago
Kunni	4abd86a500	[pipeline-connector][doris] add doris pipeline connector. (#2810) ... Co-authored-by: wudi <676366545@qq.com>	1 year ago
Jiabao Sun	8ca3091805	[cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema	1 year ago
Jiabao Sun	08c5dfed83	[cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector ... Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	1 year ago
Jiabao Sun	174282d3ef	[cdc-pipeline-connector][mysql] Support more mysql types	1 year ago
Hang Ruan	ec3d558485	[cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector	1 year ago
Hang Ruan	10ccbde023	[cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent	1 year ago
Jiabao Sun	d0cce26b76	[cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource	1 year ago
Leonard Xu	95921d5620	[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797) ... This closes #2797.	1 year ago
Qingsheng Ren	173deb5248	[cdc-composer] Add common and runtime JAR when submit (#2795) ... This closes #2795.	1 year ago
Qingsheng Ren	cc9d368b63	[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776) ... This closes #2766.	1 year ago
Kunni	a81d4a16b9	[cdc-common] Introduce createFieldGetters method in SchemaUtils to build FieldGetters of given Schema. (#2762) ... This closes #2762.	1 year ago
Kunni	8edf2a60f0	[cdc-pipeline-connector][values] Avoid using `default` as name of namespace and schema. (#2774)	1 year ago
Kunni	4a5f2161aa	[cdc-pipeline-connector][values] Add event set MULTI_SPLITS_SINGLE_TABLE to mock source with multiple splits (#2737) ... This closes #2737.	1 year ago
Hang Ruan	70614be28c	[3.0][cdc-common] Introduce BinaryRecordDataGenerator to help to create BinaryRecordData ... This closes #2734.	1 year ago
Hang Ruan	cad7424a1d	[3.0][cdc-common] Use BinaryRecordData in DataChangeEvent instead of GenericRecordData	1 year ago
lvyanquan	b4deda97be	[cdc-pipeline-connector][values] Introduce `values` cdc pipeline connector ... This closes #2675.	1 year ago
joyCurry30	d01f0a9791	[pom] Use ${revision} replace specific version. (#2623)	1 year ago
Leonard Xu	82a652ca6f	[3.0][kickoff] Introduce basic modules for Flink CDC 3.0 ... This closes #2610	1 year ago