Commit Graph

63 Commits (71414d8f7d8a13ec6fc090f9de87f030c41a79ed)

Author SHA1 Message Date
Qingsheng Ren f522308206 [hotfix] Change parent POM's artifact ID to flink-cdc-parent 9 months ago
Qingsheng Ren 38a1782ecc [hotfix] Remove test-jar from parent pom and only add to necessary modules 9 months ago
Kunni c1e1aa48d9
[FLINK-34648][cdc] Avoid RPC timeout when applying SchemaChangeEvent to downstream external systems
This closes  #3128.
9 months ago
Kunni ef2eece256
[pipeline-connector][paimon] add paimon pipeline data sink connector. (#2916) 9 months ago
Qingsheng Ren 6017b16528
[FLINK-34653][cdc][route] Support table merging with route rules
This closes  #3129.
10 months ago
Qishang Zhong 18dd51fe22
[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BINARY data type of Add column DDL (#3145) 10 months ago
xleoken 6510e670fa
[FLINK-34959][cdc] Update old flink-cdc-connectors artifactId (#3200) 10 months ago
wenmo c92903016d [cdc-common] Introduce partitionKeys into schema and add related util classes 10 months ago
Qishang Zhong d099603ef1
[FLINK-34948][cdc][common] Fix cdc RowType can not convert to Flink type 10 months ago
xleoken 5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110) 10 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Kunni 146ed9d0be
[hotfix][cdc-common] Fix NoSuchMethodError of CollectionUtil.newHashMapWithExpectedSize
This closes #2943
1 year ago
joyCurry30 055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886) 1 year ago
Qingsheng Ren 9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options (#2821)
This closes #2821.
1 year ago
Kunni 4abd86a500
[pipeline-connector][doris] add doris pipeline connector. (#2810)
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Hang Ruan 1766e82d7c [3.0][cdc-common & runtime] Remove useless flink imports 1 year ago
Jiabao Sun 174282d3ef [cdc-pipeline-connector][mysql] Support more mysql types 1 year ago
Jiabao Sun d0cce26b76 [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource 1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Hang Ruan e435004eda
[cdc-common][hotfix] Remove useless flink imports (#2803)
This closes #2803.
1 year ago
Kunni b60322bef7
[pipeline-common] Use column name to check whether the schema contains specific column or not. (#2801)
This closes #2801.
1 year ago
Qingsheng Ren 2bde0beaec [cdc-common] Introduce AssertJ-style assertion system for Flink CDC data structures 1 year ago
Kunni a81d4a16b9
[cdc-common] Introduce createFieldGetters method in SchemaUtils to build FieldGetters of given Schema. (#2762)
This closes #2762.
1 year ago
Kunni 3806c72ef8
[cdc-common] add PublicEvolving annotation to SchemaUtils (#2756) 1 year ago
gongzhongqiang 0cdfd36c08
[3.0][cdc-composer] Introduce pipeline.name config to support custom flink job name (#2768)
Co-authored-by: Leonard Xu <leonard@apache.org>
This closes #2769.
1 year ago
Hang Ruan 70614be28c [3.0][cdc-common] Introduce BinaryRecordDataGenerator to help to create BinaryRecordData
This closes #2734.
1 year ago
Hang Ruan cad7424a1d [3.0][cdc-common] Use BinaryRecordData in DataChangeEvent instead of GenericRecordData 1 year ago
Hang Ruan ac9bab3dce [3.0][cdc-common] Introduce binaryRecordData to avoid type serialization and improve performance as well
This closes #2748.
1 year ago
gongzhongqiang 9c3c7faae4
[cdc-common] Introduce TableFilter to filter table objects from given TableId pattern (#2673)
This closes #2669.
1 year ago
Qingsheng Ren 1973f64aa3 [cdc-common] MetadataApplier should extends Serializable
This closes #2743
1 year ago
Qingsheng Ren 32de7776d2 [cdc-common] Define pipeline options and schema change behaviors
This closes #2740
1 year ago
Qingsheng Ren 6506ba788d [cdc-common] Support adding Column directly in schema builder
This closes #2739
1 year ago
lvyanquan 40184ae19f [3.0][cdc-common][minor] Add toString method for some classes. 1 year ago
Kunni be286110f1
[3.0][cdc-common] Add SchemaUtil to perform schema evolution (#2732)
This closes #2732.
1 year ago
Hang Ruan ace6080c93
[3.0][cdc-runtime] Provide SchemaOperator and SchemaRegistry to handle schema changes (#2685) 1 year ago
Hang Ruan 5223d6b69d [3.0][cdc-runtime][hotfix] Move type serializers to runtime module 1 year ago
Hang Ruan 74f032aad6 [3.0][cdc-common] Introduce data type for record field in DataChangeEvent 1 year ago
Hang Ruan fb9a8a4257 [3.0][cdc-common][minor] Improve public methods for schema event 1 year ago
Hang Ruan 9e149efcc1 [3.0][cdc-common][minor] Move FlushEvent to common module 1 year ago
joyCurry30 3a80de7676
[3.0][cdc-common] Use built-in ConfigOption for cdc-common module (#2716)
This closes #2716.
1 year ago
joyCurry30 a1b67a7585
[3.0][cdc-common] Add ConText for Source/Sink initialization. (#2672) 1 year ago
Hang Ruan af5a0cef3f
[3.0][cdc-common] Add TypeSerializer implementations (#2683) 1 year ago
Leonard Xu 00f8156671 [build] Add header copyright check for java files 1 year ago
Qingsheng Ren dab7ba4cb5
[common] Introduce Configuration and related utilities (#2681) 1 year ago
Leonard Xu 995d524416 [3.0][common] Use built-in API annotations to make common module free with flink
This closes #2695.
1 year ago
Leonard Xu ce4621a549 [3.0][common] Introduce built-in API annotations for project
This closes #2693.
1 year ago
Leonard Xu 4930698a9b
[3.0][cdc-common] Introduce internal data structures and generic implementations (#2688)
This closes #2651.
1 year ago
joyCurry30 de45676faa
[3.0][cdc-common] Change DataChangeEvent from interface to class, and add implementation for DataChangeEvent. (#2677)
* [3.0][cdc-common] Change DataChangeEvent from interface to class, and add implementation for DataChangeEvent.

* [3.0][cdc-common] Remove @param for code cleaning.

* [3.0][cdc-common] Make the DataChangeEvent constructor private.
1 year ago