Commit Graph

84 Commits (17c0dc4ad48431203690412547e20503c08597c6)

Author SHA1 Message Date
yuxiqian 73977c127b
[FLINK-36183] Fix lenient schema evolution failure with route blocks (#3583) 6 months ago
yuxiqian 06fc939569
[FLINK-36184][transform] Fix transform operator swallows schema changes from tables not present in transform rules (#3589) 6 months ago
yuxiqian a876af2589
[minor][cdc-runtime] Run schema coordinator logic asynchronously to avoid blocking the main thread
This closes #3557
6 months ago
yuxiqian 0df63e26e8
[hotfix][cdc-runtime] Keep upstream pending requests in order to avoid checkpoint hanging & state inconsistency in timestamp startup mode
This closes  #3576.
6 months ago
yuxiqian 2e938a92f5
[FLINK-36128][cdc-runtime] Fix potential unrecoverable in-flight data exception by promoting LENIENT as the default schema change behavior
This closes #3574.
6 months ago
yuxiqian 060d2032e8
[hotfix][cdc-runtime] Fix schema registry hanging in multiple parallelism
This closes  #3567.
6 months ago
yuxiqian 3837887819
[FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcarded transform rule
This closes #3557.
6 months ago
yuxiqian ee843e2f24
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
This closes #3563.

Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>
6 months ago
Hongshun Wang 6205a5a0f1
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
This closes #3558.
6 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
6 months ago
Hongshun Wang d3473de4db
[FLINK-36076][minor][cdc-runtime] Set isSchemaChangeApplying as volatile for thread safe consideration
This closes #3556.
6 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 7 months ago
yuxiqian 3cb91fb51a
[FLINK-35805][transform] Add __data_event_type__ metadata column
This closes  #3468
7 months ago
yuxiqian 874ff4ff20
[hotfix][cdc-runtime] Invalidate cache correctly to avoid classloader leakage
This closes #3533
7 months ago
yuxiqian 104209558a [FLINK-36034][cdc-runtime] Get rid of Flink table planner dependency in cdc runtime module
This closes #3513.
7 months ago
yuxiqian 2885d12f57 [FLINK-35991][cdc-runtime] Resolve operator conflicts in transform SQL operator tables 7 months ago
MOBIN 17d21a957a
[FLINK-35984][cdc-runtime] Fix bug that metadata column name can not be used in transform rule
This closes  #3528.

Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
7 months ago
MOBIN 84ef9d5daa
[FLINK-35981][cdc-runtime] Transform supports referencing one column more than once
This closes  #3515.
7 months ago
yuxiqian e2bb917ad0
[FLINK-34876][transform] Support UDF functions in transform (#3465) 7 months ago
Hang Ruan 07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511) 7 months ago
yuxiqian 81d916fc73
[FLINK-35272][cdc-runtime] Transform supports omitting and renaming computed column
This closes #3285.
7 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
7 months ago
Leonard Xu 03a2ae3ca7 [FLINK-35893][cdc-runtime] Write CURRENT_VERSION of TableChangeInfo to state
This closes #2944.
7 months ago
lvyanquan 4561a8a32b [FLINK-34638][cdc-common] Support column with default value 7 months ago
Wink 7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
This closes #3449.

Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
7 months ago
yuxiqian 44dafe33bd
[FLINK-35813][cdc-runtime] Do not clear state field in TransformSchemaOperator until operator closed
This closes #3469.
7 months ago
Wink 1388cf9906
[FLINK-34877][cdc] Support type cast conversion in pipeline transform
This closes #3357.
7 months ago
Leonard Xu 26ff6d2a08 [FLINK-35237][cdc-common] Improve the interfaces and reorganize the directory. 7 months ago
鼎昕 9a4dede3fe [FLINK-35237][cdc-common] Allow Sink to choose HashFunction in PrePartitionOperator 7 months ago
yuxiqian ad1f554c0e
[FLINK-35647][route] Support symbol replacement to enrich routing rules
This closes #3428.

Co-authored-by: 张田 <zhang_tian@inspur.com>
Co-authored-by: yangshuaitong <duguhoney@gmail.com>
8 months ago
yux 3441a1e2ab
[FLINK-35648][runtime] Allow applying multiple route rules for one single source table (#3425) 8 months ago
yux 414720d1c5
[FLINK-35464][cdc] Fixes operator state backwards compatibility from CDC 3.0.x and add migration tests (#3369) 9 months ago
yux 88afc5f18d
[FLINK-35323][cdc-runtime] Fix transform failure when one rule matches multiple tables with incompatible schema
This closes  #3313.
9 months ago
yux f61f0f44bd
[FLINK-35264][cdc][runtime] Fix multiple transform rules do not take effect (#3280) 10 months ago
yanghuaiGit 23a67dcdb9
[FLINK-35255][cdc][runtime] DataSinkWriterOperator adds overrides for the snapshotState and processWatermark methods (#3271) 10 months ago
Wink 75a553eb92
[FLINK-34878][cdc][transform] Flink CDC pipeline transform supports CASE WHEN (#3228) 10 months ago
Wink 0108d0e5d1
[FLINK-35259][cdc][transform] Fix FlinkCDC pipeline transform can't deal timestamp field (#3278) 10 months ago
yux 6258bec5bb
[FLINK-35256][cdc][runtime] Fix transform node does not respect type nullability (#3272) 10 months ago
Qingsheng Ren 9cc3451ddf
[FLINK-35251][cdc][runtime] Fix bug of serializing derivation mapping in SchemaDerivation
This closes  #3267.
10 months ago
Kunni c1e1aa48d9
[FLINK-34648][cdc] Avoid RPC timeout when applying SchemaChangeEvent to downstream external systems
This closes  #3128.
10 months ago
Qingsheng Ren 6017b16528
[FLINK-34653][cdc][route] Support table merging with route rules
This closes  #3129.
11 months ago
Qishang Zhong 18dd51fe22
[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BINARY data type of Add column DDL (#3145) 11 months ago
Hongshun Wang 8c5437a1f1
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction (#3204) 11 months ago
xleoken 6510e670fa
[FLINK-34959][cdc] Update old flink-cdc-connectors artifactId (#3200) 11 months ago
wenmo a35b8dd44c [build] Optimize pom to solve the CI error 11 months ago
wenmo bcad5d9d11 [cdc-runtime] Introduce TransformSchemaOperator and TransformDataOperator to support transformation 11 months ago
xleoken 5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110) 11 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
12 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 12 months ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago