Commit Graph

64 Commits (2616c0ecd7ed609958efc4b33781090c90d2eece)

Author SHA1 Message Date
yuxiqian 73977c127b
[FLINK-36183] Fix lenient schema evolution failure with route blocks (#3583) 5 months ago
yuxiqian 2e938a92f5
[FLINK-36128][cdc-runtime] Fix potential unrecoverable in-flight data exception by promoting LENIENT as the default schema change behavior
This closes #3574.
5 months ago
yuxiqian 3837887819
[FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcarded transform rule
This closes #3557.
5 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
6 months ago
Hongshun Wang d3473de4db
[FLINK-36076][minor][cdc-runtime] Set isSchemaChangeApplying as volatile for thread safe consideration
This closes #3556.
6 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 6 months ago
yuxiqian 3cb91fb51a
[FLINK-35805][transform] Add __data_event_type__ metadata column
This closes  #3468
6 months ago
Kunni 64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
This closes  #3499.
6 months ago
Hongshun Wang 5284df571f
[FLINK-36023][cdc-composer] Flink CDC K8S Native Application Mode add wrong jar url (#3523) 6 months ago
Hongshun Wang b361db58ab
[FLINK-36007][[cdc-composer] Loading factory and added jar in one search
This close #3520.
6 months ago
yuxiqian e2bb917ad0
[FLINK-34876][transform] Support UDF functions in transform (#3465) 6 months ago
ConradJam d6b687b61d
[FLINK-34853] Submit CDC Job To Flink K8S Native Application Mode (#3093) 6 months ago
yuxiqian 81d916fc73
[FLINK-35272][cdc-runtime] Transform supports omitting and renaming computed column
This closes #3285.
6 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
6 months ago
Wink 7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
This closes #3449.

Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
gongzhongqiang c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481) 6 months ago
Leonard Xu 26ff6d2a08 [FLINK-35237][cdc-common] Improve the interfaces and reorganize the directory. 6 months ago
鼎昕 9a4dede3fe [FLINK-35237][cdc-common] Allow Sink to choose HashFunction in PrePartitionOperator 6 months ago
yuxiqian ad1f554c0e
[FLINK-35647][route] Support symbol replacement to enrich routing rules
This closes #3428.

Co-authored-by: 张田 <zhang_tian@inspur.com>
Co-authored-by: yangshuaitong <duguhoney@gmail.com>
7 months ago
Hongshun Wang ca1470d5dd
[FLINK-35281][cdc-common] FlinkEnvironmentUtils#addJar add each jar only once (#3301) 7 months ago
yux 0723009a69
[FLINK-35700][cli] Loosen CDC pipeline options validation
This closes  #3435.
7 months ago
yux 2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options 8 months ago
Hongshun Wang ed4cd40afc
[hotfix][cdc-composor] Adjust test of cdc composer from junit4 to junit5 8 months ago
yuxiqian 9a9603413c [FLINK-35415][base] Fix compatibility with Flink 1.19 8 months ago
Hongshun Wang 33891869a9
[FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink (#3233) 8 months ago
Kunni c1e1aa48d9
[FLINK-34648][cdc] Avoid RPC timeout when applying SchemaChangeEvent to downstream external systems
This closes  #3128.
9 months ago
Qingsheng Ren 6017b16528
[FLINK-34653][cdc][route] Support table merging with route rules
This closes  #3129.
10 months ago
Hongshun Wang 8c5437a1f1
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction (#3204) 10 months ago
xleoken 6510e670fa
[FLINK-34959][cdc] Update old flink-cdc-connectors artifactId (#3200) 10 months ago
Leonard Xu 1d05abff87 [minor][cdc-common] Improve the java doc of translators
This closes #2937.
10 months ago
wenmo bcad5d9d11 [cdc-runtime] Introduce TransformSchemaOperator and TransformDataOperator to support transformation 10 months ago
wenmo f0c29f64f2 [cdc-composer] Introduce transform definition and parser 10 months ago
xleoken 5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110) 10 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Qingsheng Ren 6cb2ffe2fb
[cdc-cli][cdc-composer] Use "source-table" and "sink-table" as keywords of route (#2823) 1 year ago
Qingsheng Ren 9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options (#2821)
This closes #2821.
1 year ago
Qingsheng Ren daceb42168 [build] Use ${project.version} instead of ${revision} for dependency version
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Qingsheng Ren a328f9895a
[cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments (#2807)
This closes #2807.
1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Qingsheng Ren 3bf1428233 [cdc-composer][route][sink] Add name for route and improve name for sink 1 year ago
Leonard Xu a8f4ba8cc6 [cdc-composer][hotfix] Always chain operator by default 1 year ago
Leonard Xu f0c630d6f6 [cdc-composer][sink] Use correct name for sink operator 1 year ago
Qingsheng Ren 173deb5248
[cdc-composer] Add common and runtime JAR when submit (#2795)
This closes #2795.
1 year ago
Qingsheng Ren cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776)
This closes #2766.
1 year ago
Qingsheng Ren a771abef90 [cdc-composer] Add routing logic into the Flink composer 1 year ago
Qingsheng Ren f22ac3e788 [cdc-cli][cdc-composer] Use sourceTable and sinkTable as keyword in route definition 1 year ago
Kunni 99ffbe03d2
[cdc-composer] use DataSinkWriterOperatorFactory to replace all SinkWriterOperatorFactory. (#2773) 1 year ago
gongzhongqiang 0cdfd36c08
[3.0][cdc-composer] Introduce pipeline.name config to support custom flink job name (#2768)
Co-authored-by: Leonard Xu <leonard@apache.org>
This closes #2769.
1 year ago