Commit Graph

1240 Commits (3d77dfc9070a4fb3d86e525543eb7383a6003481)
 

Author SHA1 Message Date
yuxiqian 2e938a92f5
[FLINK-36128][cdc-runtime] Fix potential unrecoverable in-flight data exception by promoting LENIENT as the default schema change behavior
This closes #3574.
5 months ago
Jiabao Sun aea2b6aa9c
[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run (#3555) 5 months ago
yuxiqian 060d2032e8
[hotfix][cdc-runtime] Fix schema registry hanging in multiple parallelism
This closes  #3567.
5 months ago
Sergei Morozov 52f2019469
[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp
This closes #3561.
5 months ago
yuxiqian 3837887819
[FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcarded transform rule
This closes #3557.
5 months ago
yuxiqian ee843e2f24
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
This closes #3563.

Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>
5 months ago
Kunni 565032e3af
[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-table.enabled option for MySQL Source
This closes  #3560.
5 months ago
Hongshun Wang 6205a5a0f1
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
This closes #3558.
5 months ago
Kevin Wang 77c63385d9
[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart (#3548)
Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>
5 months ago
MOBIN aedccb698e
[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCommittableChannelComputer Topology name
This closes #3559
5 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
6 months ago
Hongshun Wang d3473de4db
[FLINK-36076][minor][cdc-runtime] Set isSchemaChangeApplying as volatile for thread safe consideration
This closes #3556.
6 months ago
Kunni 7f08c6caba
[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration
This closes #3553
6 months ago
Kunni 0470fdbbc1
[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink
This closes #3549
6 months ago
gongzhongqiang 92b5483e17
[minor][docs] Compress images to reduce file size and improve website load speed
This closes  #3551
6 months ago
He Wang cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439) 6 months ago
proletarians c5396fbf29
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version
This closes  #3542.
6 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 6 months ago
yuxiqian 3cb91fb51a
[FLINK-35805][transform] Add __data_event_type__ metadata column
This closes  #3468
6 months ago
yuxiqian 874ff4ff20
[hotfix][cdc-runtime] Invalidate cache correctly to avoid classloader leakage
This closes #3533
6 months ago
Qingsheng Ren ed832297a8
[release] Update version to 3.3-SNAPSHOT
This closes #3531.

Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
yuxiqian 104209558a [FLINK-36034][cdc-runtime] Get rid of Flink table planner dependency in cdc runtime module
This closes #3513.
6 months ago
yuxiqian 2885d12f57 [FLINK-35991][cdc-runtime] Resolve operator conflicts in transform SQL operator tables 6 months ago
wuzexian 8137f9d746 [FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions
This closes #3495.
6 months ago
wuzexian ac14dba9fb [FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline 6 months ago
Junbo wang 15ab85860b
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column (#3490)
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
6 months ago
Kunni 64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
This closes  #3499.
6 months ago
MOBIN 17d21a957a
[FLINK-35984][cdc-runtime] Fix bug that metadata column name can not be used in transform rule
This closes  #3528.

Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
Hongshun Wang 5284df571f
[FLINK-36023][cdc-composer] Flink CDC K8S Native Application Mode add wrong jar url (#3523) 6 months ago
Kunni 3bb1f3ca45
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit
This closes #3504.
6 months ago
gongzhongqiang b9c628d310
[hotfix][doc] Fix doris document dead links and typo
This closes #3527
6 months ago
MOBIN 84ef9d5daa
[FLINK-35981][cdc-runtime] Transform supports referencing one column more than once
This closes  #3515.
6 months ago
Hongshun Wang b361db58ab
[FLINK-36007][[cdc-composer] Loading factory and added jar in one search
This close #3520.
6 months ago
yuxiqian e2bb917ad0
[FLINK-34876][transform] Support UDF functions in transform (#3465) 6 months ago
Kunni e0d6d1d1a8
[FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option to make sure the same record sending to the same partition. (#3522) 6 months ago
Hongshun Wang 4bf5a395a5
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly
This closes #3519.
6 months ago
Hang Ruan 07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511) 6 months ago
North Lin 09f36a4a05
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. (#3411)
Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com>
Co-authored-by: north.lin <north.lin@yunlsp.com>
6 months ago
yuxiqian b937db25d5
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling (#3506) 6 months ago
ConradJam d6b687b61d
[FLINK-34853] Submit CDC Job To Flink K8S Native Application Mode (#3093) 6 months ago
yuxiqian 81d916fc73
[FLINK-35272][cdc-runtime] Transform supports omitting and renaming computed column
This closes #3285.
6 months ago
Wink 2dabfc0815
[FLINK-35730][cdc-cli] PipelineDefinitionParser supports parsing pipeline def in text format
This closes #3444.
6 months ago
yuxiqian af02ce1bc9
[build][e2e] Separate Pipeline and Source E2e tests and cover flink 1.20 version
This closes #3514.
6 months ago
Kunni 9d6154f123
[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink (#3461) 6 months ago
hk__lrzy 21fade0e22
[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. (#3352)
Co-authored-by: haoke <haoke@bytedance.com>
6 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
6 months ago
yuxiqian 54c6a0b207
[hotfix][e2e] Add missing default values field in E2e test
This closes #3516.
6 months ago
Leonard Xu 03a2ae3ca7 [FLINK-35893][cdc-runtime] Write CURRENT_VERSION of TableChangeInfo to state
This closes #2944.
6 months ago
lvyanquan 4561a8a32b [FLINK-34638][cdc-common] Support column with default value 6 months ago
gongzhongqiang f06cc1f31b [hotfix][ci] Clean up disk space 6 months ago