Commit Graph

40 Commits (f5223082068b890cc0627e5a44f5dbdcc6e9dd4d)

Author SHA1 Message Date
Qingsheng Ren f522308206 [hotfix] Change parent POM's artifact ID to flink-cdc-parent 10 months ago
Kunni c1e1aa48d9
[FLINK-34648][cdc] Avoid RPC timeout when applying SchemaChangeEvent to downstream external systems
This closes  #3128.
10 months ago
Qingsheng Ren 6017b16528
[FLINK-34653][cdc][route] Support table merging with route rules
This closes  #3129.
10 months ago
Hongshun Wang 8c5437a1f1
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction (#3204) 10 months ago
xleoken 6510e670fa
[FLINK-34959][cdc] Update old flink-cdc-connectors artifactId (#3200) 10 months ago
Leonard Xu 1d05abff87 [minor][cdc-common] Improve the java doc of translators
This closes #2937.
10 months ago
wenmo bcad5d9d11 [cdc-runtime] Introduce TransformSchemaOperator and TransformDataOperator to support transformation 10 months ago
wenmo f0c29f64f2 [cdc-composer] Introduce transform definition and parser 10 months ago
xleoken 5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110) 11 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Qingsheng Ren 6cb2ffe2fb
[cdc-cli][cdc-composer] Use "source-table" and "sink-table" as keywords of route (#2823) 1 year ago
Qingsheng Ren 9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options (#2821)
This closes #2821.
1 year ago
Qingsheng Ren daceb42168 [build] Use ${project.version} instead of ${revision} for dependency version
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Qingsheng Ren a328f9895a
[cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments (#2807)
This closes #2807.
1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Qingsheng Ren 3bf1428233 [cdc-composer][route][sink] Add name for route and improve name for sink 1 year ago
Leonard Xu a8f4ba8cc6 [cdc-composer][hotfix] Always chain operator by default 1 year ago
Leonard Xu f0c630d6f6 [cdc-composer][sink] Use correct name for sink operator 1 year ago
Qingsheng Ren 173deb5248
[cdc-composer] Add common and runtime JAR when submit (#2795)
This closes #2795.
1 year ago
Qingsheng Ren cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776)
This closes #2766.
1 year ago
Qingsheng Ren a771abef90 [cdc-composer] Add routing logic into the Flink composer 1 year ago
Qingsheng Ren f22ac3e788 [cdc-cli][cdc-composer] Use sourceTable and sinkTable as keyword in route definition 1 year ago
Kunni 99ffbe03d2
[cdc-composer] use DataSinkWriterOperatorFactory to replace all SinkWriterOperatorFactory. (#2773) 1 year ago
gongzhongqiang 0cdfd36c08
[3.0][cdc-composer] Introduce pipeline.name config to support custom flink job name (#2768)
Co-authored-by: Leonard Xu <leonard@apache.org>
This closes #2769.
1 year ago
Kunni 071523eae6
[hotfix][cdc-composer] Use correct factory to discovery DataSink (#2757)
This closes #2757.
1 year ago
Kunni a26607a027
[cdc-composer] Initialize context with existing config of SourceDef and SinkDef (#2749)
This closes #2749.
1 year ago
Qingsheng Ren f0bf38e0fe [cdc-composer] Implementation of Flink pipeline composer for chaining everything together
This closes #2609
1 year ago
Qingsheng Ren b52e88a43f [cdc-composer] Introduce partitioning related runtime functions and translator 1 year ago
Qingsheng Ren bf5914e6ac [cdc-composer] Introduce data sink and schema operator translators
This closes #2618
1 year ago
Qingsheng Ren 9e64b8f0b6 [cdc-composer] Introduce DataSourceTranslator for composing source
This closes #2617
1 year ago
Qingsheng Ren 5f0343e29e [cdc-composer] Add FlinkEnvironmentUtils for adding JAR to StreamExecutionEnvironment 1 year ago
joyCurry30 3a80de7676
[3.0][cdc-common] Use built-in ConfigOption for cdc-common module (#2716)
This closes #2716.
1 year ago
joyCurry30 a1b67a7585
[3.0][cdc-common] Add ConText for Source/Sink initialization. (#2672) 1 year ago
Qingsheng Ren dab7ba4cb5
[common] Introduce Configuration and related utilities (#2681) 1 year ago
gongzhongqiang 98c929e6e4
[composer] Connector factory and JAR discovery utilities (#2662) 1 year ago
Qingsheng Ren 99d1ad5e52
[flink-cdc-composer] Base interfaces and models for composer and pipeline definition (#2656)
* [flink-cdc-composer] Base interfaces and models for Flink CDC composer and pipeline definition

* [flink-cdc-composer] Flink implementation of composer and execution.

Note that Flink composer doesn't have any solid implementation now.
1 year ago
joyCurry30 d01f0a9791
[pom] Use ${revision} replace specific version. (#2623) 1 year ago
Leonard Xu 82a652ca6f
[3.0][kickoff] Introduce basic modules for Flink CDC 3.0
This closes #2610
1 year ago