Commit Graph

1214 Commits (e2b8f70e0def66091c29fd8e5b75ccdfabfda932)
 

Author SHA1 Message Date
North Lin c42b925251
[FLINK-35544][docs][deploy] Add deployment documentations for Kubernetes Operator
This closes #3392.
3 months ago
Hongshun Wang aa4f15a636
[FLINK-36174][cdc-cli] CDC yaml without pipeline should not throw exception. (#3588) 3 months ago
lzshlzsh 2a5828c0ac
[FLINK-35291][runtime] Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme (#3289)
Co-authored-by: liuzeshan <liuzeshan@bytedance.com>
3 months ago
Kunni f24399cf5a
[FLINK-36211][pipeline-connector/kafka] shade org.apache.flink.streaming.connectors.kafka to avoid conflict with flink-connector-kafka jar. (#3595) 3 months ago
Shawn Huang ecce75949a
[FLINK-36463][cdc-connector][mysql] Forbid to override some debezium options (#3631) 3 months ago
yuxiqian d5f549f91f
[FLINK-36326][cdc-connector][mysql] Send BinlogSplitUpdateRequestEvent only once to fix auto scan newly-added table failure (#3613)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
yuxiqian 0222d39b64
[FLINK-36214][build] Downgrade scala-maven-plugin version to 4.8.0 to keep compatibility with Java 8 (#3594) 3 months ago
yuxiqian dd69756d3f
[hotfix][ci] Fix ci failure in new GitHub runner images (#3645)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
4 months ago
gongzhongqiang e8251310ed [hotfix][ci] Optimize CI performance by implementing parallel execution 4 months ago
yuxiqian daf27fa7a8 [hotfix][test] Reorganize test cases 4 months ago
yuxiqian a1781f432d
[FLINK-36151][docs] Add schema evolution related docs
This closes #3575.
4 months ago
gongzhongqiang 2616c0ecd7
[hotfix][tests] Fix oracle e2e test with ARM docker image without a database initial (#3634) 4 months ago
Vincent-Woo 4b13c49163
[FLINK-34738][cdc][docs-zh] "Deployment - YARN" Page for Flink CDC Chinese Documentation (#3205)
* [FLINK-34738][cdc][docs-zh] "Deployment - YARN" Page for Flink CDC Chinese Documentation

* [FLINK-34738][cdc][docs-zh] Optimization for "Deployment - YARN" Page's Chinese Documentation
4 months ago
yuxiqian 17c0dc4ad4
[hotfix][CI] Fix Stale label automatically removed without update activity
This closes #3621.
4 months ago
gongzhongqiang a5b666a325
[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture (#3600) 4 months ago
Qingsheng Ren 4b4b8ea5bb
[FLINK-36226][cdc][docs] Build 3.2 docs and mark it as stable (#3597) 5 months ago
yuxiqian 73977c127b
[FLINK-36183] Fix lenient schema evolution failure with route blocks (#3583) 5 months ago
yuxiqian 06fc939569
[FLINK-36184][transform] Fix transform operator swallows schema changes from tables not present in transform rules (#3589) 5 months ago
yuxiqian cb1b232794
[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup
This closes  #3580
5 months ago
yuxiqian 0e9a176b08
[hotfix][pipeline-connector/mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax
This closes  #3579.
5 months ago
yuxiqian a876af2589
[minor][cdc-runtime] Run schema coordinator logic asynchronously to avoid blocking the main thread
This closes #3557
5 months ago
Hongshun Wang afe9c3c0ad
[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true
This closes  #3573.
5 months ago
Kunni 3c1517f70f
[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent
This closes #3570.
5 months ago
yuxiqian 0df63e26e8
[hotfix][cdc-runtime] Keep upstream pending requests in order to avoid checkpoint hanging & state inconsistency in timestamp startup mode
This closes  #3576.
5 months ago
yuxiqian 2e938a92f5
[FLINK-36128][cdc-runtime] Fix potential unrecoverable in-flight data exception by promoting LENIENT as the default schema change behavior
This closes #3574.
5 months ago
Jiabao Sun aea2b6aa9c
[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run (#3555) 5 months ago
yuxiqian 060d2032e8
[hotfix][cdc-runtime] Fix schema registry hanging in multiple parallelism
This closes  #3567.
5 months ago
Sergei Morozov 52f2019469
[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp
This closes #3561.
5 months ago
yuxiqian 3837887819
[FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcarded transform rule
This closes #3557.
5 months ago
yuxiqian ee843e2f24
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
This closes #3563.

Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>
5 months ago
Kunni 565032e3af
[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-table.enabled option for MySQL Source
This closes  #3560.
5 months ago
Hongshun Wang 6205a5a0f1
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
This closes #3558.
5 months ago
Kevin Wang 77c63385d9
[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart (#3548)
Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>
5 months ago
MOBIN aedccb698e
[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCommittableChannelComputer Topology name
This closes #3559
5 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
5 months ago
Hongshun Wang d3473de4db
[FLINK-36076][minor][cdc-runtime] Set isSchemaChangeApplying as volatile for thread safe consideration
This closes #3556.
5 months ago
Kunni 7f08c6caba
[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration
This closes #3553
5 months ago
Kunni 0470fdbbc1
[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink
This closes #3549
5 months ago
gongzhongqiang 92b5483e17
[minor][docs] Compress images to reduce file size and improve website load speed
This closes  #3551
6 months ago
He Wang cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439) 6 months ago
proletarians c5396fbf29
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version
This closes  #3542.
6 months ago
Qingsheng Ren d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts (#3540) 6 months ago
yuxiqian 3cb91fb51a
[FLINK-35805][transform] Add __data_event_type__ metadata column
This closes  #3468
6 months ago
yuxiqian 874ff4ff20
[hotfix][cdc-runtime] Invalidate cache correctly to avoid classloader leakage
This closes #3533
6 months ago
Qingsheng Ren ed832297a8
[release] Update version to 3.3-SNAPSHOT
This closes #3531.

Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
6 months ago
yuxiqian 104209558a [FLINK-36034][cdc-runtime] Get rid of Flink table planner dependency in cdc runtime module
This closes #3513.
6 months ago
yuxiqian 2885d12f57 [FLINK-35991][cdc-runtime] Resolve operator conflicts in transform SQL operator tables 6 months ago
wuzexian 8137f9d746 [FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions
This closes #3495.
6 months ago
wuzexian ac14dba9fb [FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline 6 months ago
Junbo wang 15ab85860b
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column (#3490)
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
6 months ago