Commit Graph

1254 Commits (83ae36a854ffe37b5ea16a9cb0494b8651123f02)
 

Author SHA1 Message Date
Wink 83ae36a854
[FLINK-37201] [transform] Transform arithmetic function support nullable parameters and more numerical types
This closes #3881.
7 days ago
yuxiqian 858371c845
[FLINK-37306][tests] Fix MySQLSourceITCase failure in non-UTC timezone
This closes #3917
1 week ago
yohei yoshimuta 39608ed663
[FLINK-36945][cdc-connector/mysql] Support parsing rename multiple tables in one statement
This closes #3876.
2 weeks ago
Kunni b44e5708b8
[FLINK-36564][ci] Running CI in random timezone to expose more time related bugs
This closes  #3650
2 weeks ago
Kunni cd1fb6f980
[FLINK-37191][cdc-connector/mysql] Avoid back filling when lowWatermark is equal to highWatermark in BinlogSplit
This closes  #3902
2 weeks ago
yuxiqian 0a4c256433
[FLINK-37262][pipeline-connector/mysql] Fix missing PARSE_ONLINE_SCHEMA_CHANGES option in MySqlDataSourceFactory
This closes #3910
2 weeks ago
yuxiqian 82bf8a08ef
[tests][ci] Miscellaneous improvements on CI robustness
This closes #3911
2 weeks ago
Shawn Huang 6686bcb4ad
[hotfix][license] Update legacy license
This closes  #3908
2 weeks ago
911432 508dc51ccf
[FLINK-37287][docs] Add missed Apache Paimon 0.9 and Fixing typo on overview.md
This closes #3913
2 weeks ago
Junbo wang c28431832c
[FLINK-36698][pipeline-connector][elasticsearch] Elasticsearch Pipeline Sink supports index sharding
This closes #3723.

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
3 weeks ago
Kunni 7717779ebf
[FLINK-37231][docs] Add documentation for CDC Source metrics
This closes #3897
3 weeks ago
Kunni 8d54be65c0
[FLINK-37251][doc] Add pipeline connectors' download link in overview.md
This closes #3900
3 weeks ago
Kunni 6aeb5e8c9f
[FLINK-37224][docs] Add the missing documents and parameters of MongoDB CDC
This closes #3895
3 weeks ago
Kunni 1fa762dd63
[FLINK-37252][doc] Align Postgres CDC Connector Chinese docs with English version
This closes #3903
3 weeks ago
Kunni d1d334d13a
[FLINK-34729][docs] Translate "Core Concept" Pages of Flink CDC into Chinese
This closes #3901
3 weeks ago
qinghuan wang aeebf674ba
[FLINK-37233][docs] Update supported flink versions and sinks (#3899) 3 weeks ago
Hang Ruan 36da15a500
[hotfix][docs] Change docs in master to 3.4-SNAPSHOT (#3886) 1 month ago
gongzhongqiang f78c57f0ec
[hotfix][cdc][docs] Build 3.3 docs and mark it as stable (#3882) 1 month ago
Jason Zhang 10f503ffa4
[hotfix][docs][pipeline-connector/maxcompute] Fix maxcompute connector typo in examples section
This closes #3875
1 month ago
Hang Ruan bfcc46aede
[build] Update version to 3.4-SNAPSHOT and add release-3.3 docs
This closes #3870
1 month ago
Hang Ruan 606c9d20c6
[build] Update version to 3.4-SNAPSHOT and add release-3.3 docs
This closes #3870
1 month ago
yuxiqian 3e16a66972
[hotfix][build] Miscellaneous fixes on GHA workflows
This closes #3839
1 month ago
North Lin 8815f2b879
[FLINK-34865][pipeline-connector/mysql] Support sync newly added table's comment
This closes #3869
1 month ago
North Lin bbef6213a6
[hotfix][pipeline-connector][mysql] Fix missed optional option in MySqlDataSourceFactory
This closes #3867
1 month ago
Leonard Xu e81df946b9 [minor][ci] Set proper timeout for compile_and_test step of CI job 1 month ago
Seung-Min Lee a1c9c19d7d [FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase
This closes #3658
1 month ago
moses 947dffca31
[FLINK-37122][build] Try to be compatible with old flink version 1.18.x
This closes #3859
1 month ago
Olivier 7997f51c55
[FLINK-35067][cdc-connector][postgres] Adding metadata 'row_kind' for Postgres CDC Connector.
This closes #3716.

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
Kunni a16abd5d24
[FLINK-36913][pipeline-connector][kafka] Introduce option to define custom mapping from upstream table id to downstream topic name
This closes #3805
1 month ago
Leonard Xu 77785c1c08
[hotfix[cdc-runtime] Close MetadataApplier in SchemaRegistry when the job stops
This closes #3864
1 month ago
yuxiqian cf95dcab64
[hotfix][test] Make pipeline migration tests more robust
This closes #3866
1 month ago
wudi 2fa215e5c4
[FLINK-35600][pipeline-connector/mysql] Add timestamp for low and high watermark
This closes #3415
1 month ago
Kunni afd4a74c0a
[FLINK-35802][pipeline-connectors/mysql] Clean ChangeEventQueue to avoid deadlock when calling BinaryLogClient#disconnect method
This closes #3463
1 month ago
Petrichor 177da16fac
[FLINK-36351][pipeline-connector/doris] Support the conversion of Flink TIME type to Doris String type
This closes #3620
1 month ago
Jzjsnow 6b13868dd5
[FLINK-36620][cdc-cli] Add support for specifying the --flink-home parameter via an '=' character
This closes #3838
1 month ago
Thorne 087195a3a6
[FLINK-36224][docs] Add the version mapping between pipeline connectors and flink
This closes  #3598
1 month ago
Sergei Morozov 5691b7bf97
[FLINK-36406][cdc-runtime] Close MetadataApplier when the job stops
This closes  #3623
1 month ago
North Lin 9ad071c1fa
[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector (#3608)
* [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector

* reformat code

* Update MySqlPipelineITCase.java

* pass a boolean value instead of Properties

* uodate FAQ

* add a method to get tinyInt1isBit

* add new cdc config `treat-tinyint1-as-boolean`

* Update MySqlChunkSplitter.java

* change param name
1 month ago
Jason Zhang 47e5cd6d89
[hotfix][pipeline-connector][maxcompute] Fix MaxCompute Pipeline Connector tests by upgrading maxcompute-emulator
This closes  #3862
1 month ago
MOBIN d83ccbeeb4
[FLINK-36754][transform] Projection should treated as an asterisk when projection expression is empty or null
This closes  #3749
1 month ago
yuxiqian e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
This closes  #3860
1 month ago
North Lin b5d9673258
[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment
This closes #3482

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
Leonard Xu 50e6c82870 [build][minor] Upgrade the max file length from 3k to 4k 1 month ago
wenmo d77cf7fa75 [FLINK-36647][transform] Support Timestampdiff and Timestampadd function in cdc pipeline transform
This closes #3698
1 month ago
Wink 79e868b864
[FLINK-36741][transform] Fix the decimal precision and length lost during transform
This closes #3740
1 month ago
hiliuxg 8b554458d3
[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent
This closes #3824.

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
Wink 551bdf395d
[FLINK-36636][transform] Supports timestamp comparison in cdc pipeline transform
This closes #3677
1 month ago
Hongshun Wang bcd70df85c
[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat
This closes #3667
1 month ago
hiliuxg 6b65aed4c5
[FLINK-36974][cdc-cli] Support overwrite flink configuration via command line
This closes #3823

Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
1 month ago
yuxiqian 865e14bfd7
[FLINK-35634][build] Add CdcUp playground CLI scripts
This closes #3605
1 month ago