8815f2b879
[FLINK-34865][pipeline-connector/mysql] Support sync newly added table's comment
...
This closes #3869
1 month ago
bbef6213a6
[hotfix][pipeline-connector][mysql] Fix missed optional option in MySqlDataSourceFactory
...
This closes #3867
1 month ago
a1c9c19d7d
[FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase
...
This closes #3658
1 month ago
a16abd5d24
[FLINK-36913][pipeline-connector][kafka] Introduce option to define custom mapping from upstream table id to downstream topic name
...
This closes #3805
1 month ago
177da16fac
[FLINK-36351][pipeline-connector/doris] Support the conversion of Flink TIME type to Doris String type
...
This closes #3620
1 month ago
5691b7bf97
[FLINK-36406][cdc-runtime] Close MetadataApplier when the job stops
...
This closes #3623
1 month ago
9ad071c1fa
[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector ( #3608 )
...
* [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector
* reformat code
* Update MySqlPipelineITCase.java
* pass a boolean value instead of Properties
* uodate FAQ
* add a method to get tinyInt1isBit
* add new cdc config `treat-tinyint1-as-boolean`
* Update MySqlChunkSplitter.java
* change param name
1 month ago
47e5cd6d89
[hotfix][pipeline-connector][maxcompute] Fix MaxCompute Pipeline Connector tests by upgrading maxcompute-emulator
...
This closes #3862
1 month ago
e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
...
This closes #3860
1 month ago
b5d9673258
[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment
...
This closes #3482
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
79e868b864
[FLINK-36741][transform] Fix the decimal precision and length lost during transform
...
This closes #3740
1 month ago
8b554458d3
[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent
...
This closes #3824 .
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
0f675061e1
[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication
...
This closes #3728
1 month ago
56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
...
This closes #3673
1 month ago
4dc31d8c61
[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style
...
This closes #3852
1 month ago
32934393ce
[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon
...
This closes #3828 .
1 month ago
a130718c96
[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20
...
This closes #3784
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
...
This closes #3818
Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
1 month ago
39fd00ce49
[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes ( #3668 )
...
Co-authored-by: MOBIN-F <18814118038@163.com>
1 month ago
7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
...
This closes #3846
2 months ago
630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
...
This closes #3802
Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
2 months ago
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
2 months ago
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
2 months ago
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
2 months ago
98f9f15132
[hotfix][docs] Add missed enumeration in MySQL Source
...
This closes #3832
2 months ago
baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
...
This closes #3434 .
2 months ago
6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
...
This closes #3360 .
2 months ago
dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
...
This closes #3760
Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
2 months ago
9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case ( #3809 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
2e03f9ad49
[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
...
This closes #3801
2 months ago
a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform ( #3758 )
...
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
2 months ago
6d21941661
[hotfix] Fix Java 11 target compatibility & add tests ( #3633 )
...
* [hotfix] Fix Java 11 target compatibility
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
# Conflicts:
# .github/workflows/flink_cdc_java_8.yml
# .github/workflows/flink_cdc_migration_test_base.yml
# pom.xml
* fix: clarify GiHub workflow names
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
fd82126c7d
[FLINK-36878][pipeline-connector][kafka] Shade org.apache.kafka with org.apache.flink.kafka.shaded.org.apache.kafka instead of cdc path
...
This closes #3790 .
3 months ago
3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
...
This closes #3744 .
3 months ago
dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 ( #3660 )
...
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
...
This closes #3691 .
3 months ago
ae986ab3f6
[FLINK-36609][pipeline-connector][paimon] Add partition columns to primary keys
...
This closes #3641 .
4 months ago
f38341b02e
[FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
...
This closes #3652 .
4 months ago
ff77a490bd
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
...
This closes #3639
4 months ago
8647fe4986
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColunEvent
...
This closes #3622 .
4 months ago
57a1a7df93
[FLINK-36408][pipeline-connector][mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision ( #3625 )
4 months ago
ecfee702dc
[FLINK-36560][pipeline-connector][paimon] Fix the issue that timestamp_ltz field is not correctly converted
...
This closes #3648 .
4 months ago
be9b52750c
[FLINK-36572][pipeline-connector][starrocks] Fix the issue that the local time zone is wrongly set
...
This closes #3655 .
4 months ago
84f97ed4c1
[FLINK-36474][route] Support merging timestamp columns when routing
...
This closes #3636 .
4 months ago
e692e7b4bc
[FLINK-36052][docs][cdc-pipeline-connector/es] Add flink cdc pipeline elasticsearch connector docs
...
This closes #3649 .
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
4 months ago
f24399cf5a
[FLINK-36211][pipeline-connector/kafka] shade org.apache.flink.streaming.connectors.kafka to avoid conflict with flink-connector-kafka jar. ( #3595 )
4 months ago
cb1b232794
[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup
...
This closes #3580
6 months ago
0e9a176b08
[hotfix][pipeline-connector/mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax
...
This closes #3579 .
6 months ago
afe9c3c0ad
[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true
...
This closes #3573 .
6 months ago
3c1517f70f
[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent
...
This closes #3570 .
6 months ago
North Lin
Seung-Min Lee
Kunni
Petrichor
Sergei Morozov
Jason Zhang
yuxiqian
Wink
hiliuxg
Junbo wang
moses
MOBIN
Jzjsnow
Umesh Dangat
yuanoOo
stayrascal
Hang Ruan
ConradJam
Runkang He
Hongshun Wang