Commit Graph

53 Commits (88c23b59a016d7b023992d2a8fb1865f46fed00d)

Author SHA1 Message Date
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Kunni 146ed9d0be
[hotfix][cdc-common] Fix NoSuchMethodError of CollectionUtil.newHashMapWithExpectedSize
This closes #2943
1 year ago
joyCurry30 055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886) 1 year ago
Qingsheng Ren 9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options (#2821)
This closes #2821.
1 year ago
Kunni 4abd86a500
[pipeline-connector][doris] add doris pipeline connector. (#2810)
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Hang Ruan 1766e82d7c [3.0][cdc-common & runtime] Remove useless flink imports 1 year ago
Jiabao Sun 174282d3ef [cdc-pipeline-connector][mysql] Support more mysql types 1 year ago
Jiabao Sun d0cce26b76 [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource 1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Hang Ruan e435004eda
[cdc-common][hotfix] Remove useless flink imports (#2803)
This closes #2803.
1 year ago
Kunni b60322bef7
[pipeline-common] Use column name to check whether the schema contains specific column or not. (#2801)
This closes #2801.
1 year ago
Qingsheng Ren 2bde0beaec [cdc-common] Introduce AssertJ-style assertion system for Flink CDC data structures 1 year ago
Kunni a81d4a16b9
[cdc-common] Introduce createFieldGetters method in SchemaUtils to build FieldGetters of given Schema. (#2762)
This closes #2762.
1 year ago
Kunni 3806c72ef8
[cdc-common] add PublicEvolving annotation to SchemaUtils (#2756) 1 year ago
gongzhongqiang 0cdfd36c08
[3.0][cdc-composer] Introduce pipeline.name config to support custom flink job name (#2768)
Co-authored-by: Leonard Xu <leonard@apache.org>
This closes #2769.
1 year ago
Hang Ruan 70614be28c [3.0][cdc-common] Introduce BinaryRecordDataGenerator to help to create BinaryRecordData
This closes #2734.
1 year ago
Hang Ruan cad7424a1d [3.0][cdc-common] Use BinaryRecordData in DataChangeEvent instead of GenericRecordData 1 year ago
Hang Ruan ac9bab3dce [3.0][cdc-common] Introduce binaryRecordData to avoid type serialization and improve performance as well
This closes #2748.
1 year ago
gongzhongqiang 9c3c7faae4
[cdc-common] Introduce TableFilter to filter table objects from given TableId pattern (#2673)
This closes #2669.
1 year ago
Qingsheng Ren 1973f64aa3 [cdc-common] MetadataApplier should extends Serializable
This closes #2743
1 year ago
Qingsheng Ren 32de7776d2 [cdc-common] Define pipeline options and schema change behaviors
This closes #2740
1 year ago
Qingsheng Ren 6506ba788d [cdc-common] Support adding Column directly in schema builder
This closes #2739
1 year ago
lvyanquan 40184ae19f [3.0][cdc-common][minor] Add toString method for some classes. 1 year ago
Kunni be286110f1
[3.0][cdc-common] Add SchemaUtil to perform schema evolution (#2732)
This closes #2732.
1 year ago
Hang Ruan ace6080c93
[3.0][cdc-runtime] Provide SchemaOperator and SchemaRegistry to handle schema changes (#2685) 1 year ago
Hang Ruan 5223d6b69d [3.0][cdc-runtime][hotfix] Move type serializers to runtime module 1 year ago
Hang Ruan 74f032aad6 [3.0][cdc-common] Introduce data type for record field in DataChangeEvent 1 year ago
Hang Ruan fb9a8a4257 [3.0][cdc-common][minor] Improve public methods for schema event 1 year ago
Hang Ruan 9e149efcc1 [3.0][cdc-common][minor] Move FlushEvent to common module 1 year ago
joyCurry30 3a80de7676
[3.0][cdc-common] Use built-in ConfigOption for cdc-common module (#2716)
This closes #2716.
1 year ago
joyCurry30 a1b67a7585
[3.0][cdc-common] Add ConText for Source/Sink initialization. (#2672) 1 year ago
Hang Ruan af5a0cef3f
[3.0][cdc-common] Add TypeSerializer implementations (#2683) 1 year ago
Leonard Xu 00f8156671 [build] Add header copyright check for java files 1 year ago
Qingsheng Ren dab7ba4cb5
[common] Introduce Configuration and related utilities (#2681) 1 year ago
Leonard Xu 995d524416 [3.0][common] Use built-in API annotations to make common module free with flink
This closes #2695.
1 year ago
Leonard Xu ce4621a549 [3.0][common] Introduce built-in API annotations for project
This closes #2693.
1 year ago
Leonard Xu 4930698a9b
[3.0][cdc-common] Introduce internal data structures and generic implementations (#2688)
This closes #2651.
1 year ago
joyCurry30 de45676faa
[3.0][cdc-common] Change DataChangeEvent from interface to class, and add implementation for DataChangeEvent. (#2677)
* [3.0][cdc-common] Change DataChangeEvent from interface to class, and add implementation for DataChangeEvent.

* [3.0][cdc-common] Remove @param for code cleaning.

* [3.0][cdc-common] Make the DataChangeEvent constructor private.
1 year ago
Kunni c52ccfa5c6
[3.0][cdc-common] Add SchemaChangeEvent implementations (#2664) 1 year ago
joyCurry30 2fa2787214
[3.0][cdc-common] Add GenericRecordData implementation for RecordData
This closes #2644.
1 year ago
Leonard Xu 8826e22932 [3.0][cdc-common] Keep columns in Schema in fixed order 1 year ago
Leonard Xu 5c2ff1ef78 [3.0][cdc-common] Use RecordData to represent before and after record. 1 year ago
Jiabao Sun b3e1e55e52
[3.0][cdc-common] Introduce Connector Factory APIs (#2661)
* [3.0][cdc-common] Introduce Connector Factory APIs

* Add PublicEvolving annotation
1 year ago
Jiabao Sun 4288cf6cae
[3.0][cdc-common] Add getTableSchema method for MetadataAccessor (#2650) 1 year ago
Leonard Xu 22bb4fd5c8
[3.0][cdc-common] Introduce Schema API for CDC 3.0
This closes ##2628.
1 year ago
Jiabao Sun 5481d436c6
[3.0][cdc-common] Introduce Event DataSink APIs for Flink CDC 3.0
This closes #2626.
1 year ago
Jiabao Sun 0f62d1d59d
[3.0][cdc-common] Introduce DataSource related APIs for Flink CDC 3.0
This closes #2625.
1 year ago
joyCurry30 d01f0a9791
[pom] Use ${revision} replace specific version. (#2623) 1 year ago