Commit Graph

81 Commits (49dc957ac6e3f8bde4b6f91603a2e7735e5977ec)

Author SHA1 Message Date
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Qingsheng Ren 6cb2ffe2fb
[cdc-cli][cdc-composer] Use "source-table" and "sink-table" as keywords of route (#2823) 1 year ago
Qingsheng Ren 9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options (#2821)
This closes #2821.
1 year ago
Qingsheng Ren daceb42168 [build] Use ${project.version} instead of ${revision} for dependency version
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Qingsheng Ren a328f9895a
[cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments (#2807)
This closes #2807.
1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Qingsheng Ren 3bf1428233 [cdc-composer][route][sink] Add name for route and improve name for sink 1 year ago
Leonard Xu a8f4ba8cc6 [cdc-composer][hotfix] Always chain operator by default 1 year ago
Leonard Xu f0c630d6f6 [cdc-composer][sink] Use correct name for sink operator 1 year ago
Qingsheng Ren 173deb5248
[cdc-composer] Add common and runtime JAR when submit (#2795)
This closes #2795.
1 year ago
Qingsheng Ren cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776)
This closes #2766.
1 year ago
Qingsheng Ren a771abef90 [cdc-composer] Add routing logic into the Flink composer 1 year ago
Qingsheng Ren f22ac3e788 [cdc-cli][cdc-composer] Use sourceTable and sinkTable as keyword in route definition 1 year ago
Kunni 99ffbe03d2
[cdc-composer] use DataSinkWriterOperatorFactory to replace all SinkWriterOperatorFactory. (#2773) 1 year ago
gongzhongqiang 0cdfd36c08
[3.0][cdc-composer] Introduce pipeline.name config to support custom flink job name (#2768)
Co-authored-by: Leonard Xu <leonard@apache.org>
This closes #2769.
1 year ago
Kunni 071523eae6
[hotfix][cdc-composer] Use correct factory to discovery DataSink (#2757)
This closes #2757.
1 year ago
Kunni a26607a027
[cdc-composer] Initialize context with existing config of SourceDef and SinkDef (#2749)
This closes #2749.
1 year ago
Qingsheng Ren f0bf38e0fe [cdc-composer] Implementation of Flink pipeline composer for chaining everything together
This closes #2609
1 year ago
Qingsheng Ren b52e88a43f [cdc-composer] Introduce partitioning related runtime functions and translator 1 year ago
Qingsheng Ren bf5914e6ac [cdc-composer] Introduce data sink and schema operator translators
This closes #2618
1 year ago
Qingsheng Ren 9e64b8f0b6 [cdc-composer] Introduce DataSourceTranslator for composing source
This closes #2617
1 year ago
Qingsheng Ren 5f0343e29e [cdc-composer] Add FlinkEnvironmentUtils for adding JAR to StreamExecutionEnvironment 1 year ago
joyCurry30 3a80de7676
[3.0][cdc-common] Use built-in ConfigOption for cdc-common module (#2716)
This closes #2716.
1 year ago
joyCurry30 a1b67a7585
[3.0][cdc-common] Add ConText for Source/Sink initialization. (#2672) 1 year ago
Qingsheng Ren dab7ba4cb5
[common] Introduce Configuration and related utilities (#2681) 1 year ago
gongzhongqiang 98c929e6e4
[composer] Connector factory and JAR discovery utilities (#2662) 1 year ago
Qingsheng Ren 99d1ad5e52
[flink-cdc-composer] Base interfaces and models for composer and pipeline definition (#2656)
* [flink-cdc-composer] Base interfaces and models for Flink CDC composer and pipeline definition

* [flink-cdc-composer] Flink implementation of composer and execution.

Note that Flink composer doesn't have any solid implementation now.
1 year ago
joyCurry30 d01f0a9791
[pom] Use ${revision} replace specific version. (#2623) 1 year ago
Leonard Xu 82a652ca6f
[3.0][kickoff] Introduce basic modules for Flink CDC 3.0
This closes #2610
1 year ago