Commit Graph

48 Commits (bc7031bd71b7d8267e490ade2e05add5cdc902b8)

Author SHA1 Message Date
yux 01ec7da989
[FLINK-35055][cdc] Exclude connector dependencies with questionable licenses from fat jar packages (#3212) 9 months ago
Kunni 253ef9256b
[pipeline-connector][kafka] Add kafka pipeline data sink connector. (#2938) 9 months ago
yux 5e52d8620c
[FLINK-35102][cdc][doris-sink] Correct Doris connector varchar type mapping
This closes #3224.
10 months ago
Thorne 0d797a6021
[FLINK-34903][cdc][mysql] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables (#3186) 10 months ago
Kunni d4ed7db8dc
[FLINK-35127][cdc][values] Remove HybridSource from ValuesSource to avoid CI failure. (#3237) 10 months ago
Hongshun Wang 025653d772
[hotfix] run mvn spotless to fix code style violations. (#3219) 10 months ago
Qishang Zhong 18dd51fe22
[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BINARY data type of Add column DDL (#3145) 10 months ago
Hongshun Wang abb98ee257
[FLINK-34690] Cast decimal to VARCHAR as primary key in starrocks sink (#3150) 10 months ago
Hongshun Wang 8c5437a1f1
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction (#3204) 10 months ago
wenmo bcad5d9d11 [cdc-runtime] Introduce TransformSchemaOperator and TransformDataOperator to support transformation 10 months ago
xleoken 5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110) 10 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
Hongshun Wang 7ea197242f
[debezium] Upgrade to Debezium 1.9.8.Final(#3033) (#3034) 1 year ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Kunni 9abf2cf900
[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not included in capturedTableFilter (#2986)
This closes #2981
1 year ago
Hongshun Wang 3bf886b94d [cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source (#2901) 1 year ago
He Wang f3762a1b30
[pipeline-connector][mysql] fix timestamp with timezone format (#2952)
* fix ts with tz parser

* test timestamp with default value

* fix related test

* use timestamp string in test cases
1 year ago
张田 1b643026fe
[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector (#2895) 1 year ago
Kunni 812c33d27b
[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe (#2954) 1 year ago
joyCurry30 055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886) 1 year ago
Hongshun Wang f15faac298
[docs] Fix overview docs to remove prefix of pipeline options (#2833) 1 year ago
PengFei Li 72bcb1df02
[pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks (#2829) 1 year ago
gongzhongqiang c484bb447c
[build][hotfix] Remove duplicate dependency (#2828) 1 year ago
Qingsheng Ren daceb42168 [build] Use ${project.version} instead of ${revision} for dependency version
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Jiabao Sun 8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820)
This closes #2820.
1 year ago
Jiabao Sun 7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816) 1 year ago
Jiabao Sun 8c75db145d
[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema (#2811) 1 year ago
Leonard Xu 0eae214183
[pipeline-connector][mysql] Enable send schema change by default (#2815)
This closes #2815.
1 year ago
PengFei Li 33b7c85093 [pipeline-connector][starrocks] Add starrocks pipeline connector (#2765)
This closes #2645.
1 year ago
Kunni 4abd86a500
[pipeline-connector][doris] add doris pipeline connector. (#2810)
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Jiabao Sun 8ca3091805 [cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema 1 year ago
Jiabao Sun 08c5dfed83 [cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun 174282d3ef [cdc-pipeline-connector][mysql] Support more mysql types 1 year ago
Hang Ruan ec3d558485 [cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector 1 year ago
Hang Ruan 10ccbde023 [cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent 1 year ago
Jiabao Sun d0cce26b76 [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource 1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Qingsheng Ren 173deb5248
[cdc-composer] Add common and runtime JAR when submit (#2795)
This closes #2795.
1 year ago
Qingsheng Ren cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776)
This closes #2766.
1 year ago
Kunni a81d4a16b9
[cdc-common] Introduce createFieldGetters method in SchemaUtils to build FieldGetters of given Schema. (#2762)
This closes #2762.
1 year ago
Kunni 8edf2a60f0
[cdc-pipeline-connector][values] Avoid using `default` as name of namespace and schema. (#2774) 1 year ago
Kunni 4a5f2161aa
[cdc-pipeline-connector][values] Add event set MULTI_SPLITS_SINGLE_TABLE to mock source with multiple splits (#2737)
This closes #2737.
1 year ago
Hang Ruan 70614be28c [3.0][cdc-common] Introduce BinaryRecordDataGenerator to help to create BinaryRecordData
This closes #2734.
1 year ago
Hang Ruan cad7424a1d [3.0][cdc-common] Use BinaryRecordData in DataChangeEvent instead of GenericRecordData 1 year ago
lvyanquan b4deda97be [cdc-pipeline-connector][values] Introduce `values` cdc pipeline connector
This closes #2675.
1 year ago
joyCurry30 d01f0a9791
[pom] Use ${revision} replace specific version. (#2623) 1 year ago
Leonard Xu 82a652ca6f
[3.0][kickoff] Introduce basic modules for Flink CDC 3.0
This closes #2610
1 year ago