Commit Graph

109 Commits (master)

Author SHA1 Message Date
yuxiqian e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
This closes  #3860
2 weeks ago
yuxiqian 56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
This closes #3673
2 weeks ago
moses 4dc31d8c61
[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style
This closes  #3852
2 weeks ago
MOBIN a130718c96
[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20
This closes  #3784

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 weeks ago
Kunni 75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
This closes #3818

Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
3 weeks ago
Jzjsnow 630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
This closes #3802

Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
3 weeks ago
Jason Zhang 92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
This closes  #3254.
3 weeks ago
yuanoOo 6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
This closes #3360.
4 weeks ago
yuxiqian 2e03f9ad49 [FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
This closes #3801
1 month ago
Hang Ruan a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform (#3758)
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
1 month ago
Hang Ruan c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform (#3804) 1 month ago
yuxiqian 39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
This closes #3780.
2 months ago
Hongshun Wang 12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510) 2 months ago
ConradJam dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 (#3660)
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
MOBIN 5db16ba30c
[FLINK-36093][transform] Fix preTransformoperator wrongly filters columns belong to different transforms
This closes #3572
3 months ago
yuxiqian 84f97ed4c1
[FLINK-36474][route] Support merging timestamp columns when routing
This closes  #3636.
3 months ago
yuxiqian daf27fa7a8 [hotfix][test] Reorganize test cases 4 months ago
gongzhongqiang 2616c0ecd7
[hotfix][tests] Fix oracle e2e test with ARM docker image without a database initial (#3634) 4 months ago
gongzhongqiang a5b666a325
[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture (#3600) 4 months ago
yuxiqian 73977c127b
[FLINK-36183] Fix lenient schema evolution failure with route blocks (#3583) 5 months ago
yuxiqian 06fc939569
[FLINK-36184][transform] Fix transform operator swallows schema changes from tables not present in transform rules (#3589) 5 months ago
yuxiqian cb1b232794
[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup
This closes  #3580
5 months ago
yuxiqian 0df63e26e8
[hotfix][cdc-runtime] Keep upstream pending requests in order to avoid checkpoint hanging & state inconsistency in timestamp startup mode
This closes  #3576.
5 months ago
yuxiqian 2e938a92f5
[FLINK-36128][cdc-runtime] Fix potential unrecoverable in-flight data exception by promoting LENIENT as the default schema change behavior
This closes #3574.
5 months ago
yuxiqian 3837887819
[FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcarded transform rule
This closes #3557.
5 months ago
yuxiqian ee843e2f24
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
This closes #3563.

Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>
5 months ago
Hongshun Wang 6205a5a0f1
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
This closes #3558.
5 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
5 months ago
He Wang cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439) 6 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 6 months ago
yuxiqian 3cb91fb51a
[FLINK-35805][transform] Add __data_event_type__ metadata column
This closes  #3468
6 months ago
yuxiqian e2bb917ad0
[FLINK-34876][transform] Support UDF functions in transform (#3465) 6 months ago
yuxiqian 81d916fc73
[FLINK-35272][cdc-runtime] Transform supports omitting and renaming computed column
This closes #3285.
6 months ago
yuxiqian af02ce1bc9
[build][e2e] Separate Pipeline and Source E2e tests and cover flink 1.20 version
This closes #3514.
6 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
6 months ago
yuxiqian 54c6a0b207
[hotfix][e2e] Add missing default values field in E2e test
This closes #3516.
6 months ago
Wink 7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
This closes #3449.

Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
yuxiqian 241eb03a74
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0
This closes #3489.
6 months ago
Joao Boto 94a0415475
[FLINK-34883] Fix postgres uuid column as PK (#3282)
* [FLINK-34883] Fix postgres uuid column as PK

* [FLINK-34883] Fix column comment.
7 months ago
yuxiqian ad1f554c0e
[FLINK-35647][route] Support symbol replacement to enrich routing rules
This closes #3428.

Co-authored-by: 张田 <zhang_tian@inspur.com>
Co-authored-by: yangshuaitong <duguhoney@gmail.com>
7 months ago
yux 3441a1e2ab
[FLINK-35648][runtime] Allow applying multiple route rules for one single source table (#3425) 7 months ago
yux 17ff659ff7
[hotfix][build] Remove test-jar from parent pom and only add to necessary modules
This closes  #3397.

Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
8 months ago
yuxiqian 8eb7e53965 [FLINK-35120][doris] Add Doris integration test cases 8 months ago
yuxiqian d8a9c8c63e [FLINK-35316][base] Run E2e test cases with Flink 1.19 and latest patch versions 8 months ago
yux 88afc5f18d
[FLINK-35323][cdc-runtime] Fix transform failure when one rule matches multiple tables with incompatible schema
This closes  #3313.
8 months ago
yux f61f0f44bd
[FLINK-35264][cdc][runtime] Fix multiple transform rules do not take effect (#3280) 9 months ago
Leonard Xu 8deddab6eb [minor][cdc-connector][db2] Fix typos and improve the code style 9 months ago
gong 3385ae8fbc [cdc-connector][db2] Db2 support incremental source 9 months ago
yux de4be372f8
[hotfix][e2e] Fix pipeline e2e test cases failures (#3246) 9 months ago
Kunni bc7031bd71
[e2e][pipeline-connector][mysql] Add e2e test for mysql pipeline connector
This closes #2997.
9 months ago