Commit Graph

86 Commits (5691b7bf977abd608dcf189359be602d93f2eadf)

Author SHA1 Message Date
MOBIN d83ccbeeb4
[FLINK-36754][transform] Projection should treated as an asterisk when projection expression is empty or null
This closes  #3749
2 weeks ago
yuxiqian e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
This closes  #3860
2 weeks ago
Wink 79e868b864
[FLINK-36741][transform] Fix the decimal precision and length lost during transform
This closes #3740
2 weeks ago
Kunni 1fb68a8d62
[FLINK-35325][transform] Skip insufficient_quota error when running test case using ad model. (#3849) 3 weeks ago
Kunni 7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
This closes #3846
3 weeks ago
Wink 49dc957ac6
[FLINK-36981][transform] Considering sharding tables with different schema in transform projection
This closes #3826.
3 weeks ago
yuxiqian 486ee6f805
[FLINK-36956][transform] Append NOT NULL attribute for Primary Key columns
This closes  #3815
3 weeks ago
yuxiqian 2e03f9ad49 [FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
This closes #3801
1 month ago
Hang Ruan a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform (#3758)
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
1 month ago
Hang Ruan c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform (#3804) 1 month ago
yuxiqian 2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range (#3785)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian b0a7d920b9
[FLINK-36866][transform] Fix unable to narrow casting on numeric values
This closes #3786.
1 month ago
yuxiqian 39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
This closes #3780.
2 months ago
Kunni 06154e9674
[FLINK-36525][transform] Support for AI Model Integration for Data Processing (#3753) 2 months ago
yuxiqian 4bd3a2347b
[FLINK-36565][transform] Route allows merging Decimals with various precisions
This closes #3651
3 months ago
yuxiqian 51c679a914
[FLINK-36596][transform] Fix unable to schema evolve with project-less transform rules
This closes  #3665.
3 months ago
MOBIN 5db16ba30c
[FLINK-36093][transform] Fix preTransformoperator wrongly filters columns belong to different transforms
This closes #3572
3 months ago
yuxiqian b5ab385b8c
[FLINK-36461][transform] Fix schema evolution failure with un-transformed tables
This closes  #3632.
3 months ago
North Lin 8647fe4986
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColunEvent
This closes  #3622.
3 months ago
yuxiqian 5184c010fd
[hotfix][transform][minor] Fix potential code conflict that SUBSTR built-in function is 1-based index now
This closes #3696
3 months ago
yuxiqian d620c5805e
[FLINK-35982][transform] Fix transform metadata failure when projection block is missed
This closes #3592.
3 months ago
yuxiqian 84f97ed4c1
[FLINK-36474][route] Support merging timestamp columns when routing
This closes  #3636.
3 months ago
yuxiqian 73977c127b
[FLINK-36183] Fix lenient schema evolution failure with route blocks (#3583) 5 months ago
yuxiqian 2e938a92f5
[FLINK-36128][cdc-runtime] Fix potential unrecoverable in-flight data exception by promoting LENIENT as the default schema change behavior
This closes #3574.
5 months ago
yuxiqian 3837887819
[FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcarded transform rule
This closes #3557.
5 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
5 months ago
Hongshun Wang d3473de4db
[FLINK-36076][minor][cdc-runtime] Set isSchemaChangeApplying as volatile for thread safe consideration
This closes #3556.
5 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 6 months ago
yuxiqian 3cb91fb51a
[FLINK-35805][transform] Add __data_event_type__ metadata column
This closes  #3468
6 months ago
Kunni 64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
This closes  #3499.
6 months ago
Hongshun Wang 5284df571f
[FLINK-36023][cdc-composer] Flink CDC K8S Native Application Mode add wrong jar url (#3523) 6 months ago
Hongshun Wang b361db58ab
[FLINK-36007][[cdc-composer] Loading factory and added jar in one search
This close #3520.
6 months ago
yuxiqian e2bb917ad0
[FLINK-34876][transform] Support UDF functions in transform (#3465) 6 months ago
ConradJam d6b687b61d
[FLINK-34853] Submit CDC Job To Flink K8S Native Application Mode (#3093) 6 months ago
yuxiqian 81d916fc73
[FLINK-35272][cdc-runtime] Transform supports omitting and renaming computed column
This closes #3285.
6 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
6 months ago
Wink 7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
This closes #3449.

Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
gongzhongqiang c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481) 6 months ago
Leonard Xu 26ff6d2a08 [FLINK-35237][cdc-common] Improve the interfaces and reorganize the directory. 6 months ago
鼎昕 9a4dede3fe [FLINK-35237][cdc-common] Allow Sink to choose HashFunction in PrePartitionOperator 6 months ago
yuxiqian ad1f554c0e
[FLINK-35647][route] Support symbol replacement to enrich routing rules
This closes #3428.

Co-authored-by: 张田 <zhang_tian@inspur.com>
Co-authored-by: yangshuaitong <duguhoney@gmail.com>
7 months ago
Hongshun Wang ca1470d5dd
[FLINK-35281][cdc-common] FlinkEnvironmentUtils#addJar add each jar only once (#3301) 7 months ago
yux 0723009a69
[FLINK-35700][cli] Loosen CDC pipeline options validation
This closes  #3435.
7 months ago
yux 2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options 8 months ago
Hongshun Wang ed4cd40afc
[hotfix][cdc-composor] Adjust test of cdc composer from junit4 to junit5 8 months ago
yuxiqian 9a9603413c [FLINK-35415][base] Fix compatibility with Flink 1.19 8 months ago
Hongshun Wang 33891869a9
[FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink (#3233) 8 months ago
Kunni c1e1aa48d9
[FLINK-34648][cdc] Avoid RPC timeout when applying SchemaChangeEvent to downstream external systems
This closes  #3128.
9 months ago
Qingsheng Ren 6017b16528
[FLINK-34653][cdc][route] Support table merging with route rules
This closes  #3129.
10 months ago
Hongshun Wang 8c5437a1f1
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction (#3204) 10 months ago