a16abd5d24
[FLINK-36913][pipeline-connector][kafka] Introduce option to define custom mapping from upstream table id to downstream topic name
...
This closes #3805
3 weeks ago
2fa215e5c4
[FLINK-35600][pipeline-connector/mysql] Add timestamp for low and high watermark
...
This closes #3415
3 weeks ago
afd4a74c0a
[FLINK-35802][pipeline-connectors/mysql] Clean ChangeEventQueue to avoid deadlock when calling BinaryLogClient#disconnect method
...
This closes #3463
3 weeks ago
177da16fac
[FLINK-36351][pipeline-connector/doris] Support the conversion of Flink TIME type to Doris String type
...
This closes #3620
3 weeks ago
5691b7bf97
[FLINK-36406][cdc-runtime] Close MetadataApplier when the job stops
...
This closes #3623
3 weeks ago
9ad071c1fa
[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector ( #3608 )
...
* [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector
* reformat code
* Update MySqlPipelineITCase.java
* pass a boolean value instead of Properties
* uodate FAQ
* add a method to get tinyInt1isBit
* add new cdc config `treat-tinyint1-as-boolean`
* Update MySqlChunkSplitter.java
* change param name
3 weeks ago
47e5cd6d89
[hotfix][pipeline-connector][maxcompute] Fix MaxCompute Pipeline Connector tests by upgrading maxcompute-emulator
...
This closes #3862
3 weeks ago
e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
...
This closes #3860
3 weeks ago
b5d9673258
[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment
...
This closes #3482
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 weeks ago
79e868b864
[FLINK-36741][transform] Fix the decimal precision and length lost during transform
...
This closes #3740
3 weeks ago
8b554458d3
[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent
...
This closes #3824 .
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 weeks ago
bcd70df85c
[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat
...
This closes #3667
3 weeks ago
0f675061e1
[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication
...
This closes #3728
3 weeks ago
56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
...
This closes #3673
3 weeks ago
4dc31d8c61
[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style
...
This closes #3852
3 weeks ago
32934393ce
[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon
...
This closes #3828 .
4 weeks ago
a130718c96
[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20
...
This closes #3784
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
4 weeks ago
75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
...
This closes #3818
Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
4 weeks ago
39fd00ce49
[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes ( #3668 )
...
Co-authored-by: MOBIN-F <18814118038@163.com>
4 weeks ago
085684b773
[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished ( #3793 )
4 weeks ago
7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
...
This closes #3846
4 weeks ago
630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
...
This closes #3802
Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
4 weeks ago
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
4 weeks ago
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
4 weeks ago
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
1 month ago
98f9f15132
[hotfix][docs] Add missed enumeration in MySQL Source
...
This closes #3832
1 month ago
baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
...
This closes #3434 .
1 month ago
6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
...
This closes #3360 .
1 month ago
dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
...
This closes #3760
Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
1 month ago
ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` ( #3831 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case ( #3809 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
2e03f9ad49
[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
...
This closes #3801
2 months ago
a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform ( #3758 )
...
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
2 months ago
6d21941661
[hotfix] Fix Java 11 target compatibility & add tests ( #3633 )
...
* [hotfix] Fix Java 11 target compatibility
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
# Conflicts:
# .github/workflows/flink_cdc_java_8.yml
# .github/workflows/flink_cdc_migration_test_base.yml
# pom.xml
* fix: clarify GiHub workflow names
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
...
This closes #3647 .
2 months ago
0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. ( #3797 )
2 months ago
12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously ( #3510 )
2 months ago
b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
...
This closes #3794 .
2 months ago
0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] ( #3755 )
2 months ago
2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
...
This closes #3792
2 months ago
fd82126c7d
[FLINK-36878][pipeline-connector][kafka] Shade org.apache.kafka with org.apache.flink.kafka.shaded.org.apache.kafka instead of cdc path
...
This closes #3790 .
2 months ago
ee9cd828c3
[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics ( #3619 )
...
Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
26f5880fbf
[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases ( #3712 )
2 months ago
23e8149e6a
[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit ( #3763 )
2 months ago
1d4e366969
[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions
...
This closes #3754
3 months ago
d0b2fe38a2
[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 ( #3748 )
3 months ago
3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
...
This closes #3744 .
3 months ago
01a1e5fba5
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type ( #3683 )
3 months ago
dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 ( #3660 )
...
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
...
This closes #3691 .
3 months ago
Kunni
wudi
Petrichor
Sergei Morozov
North Lin
Jason Zhang
yuxiqian
Wink
hiliuxg
Hongshun Wang
Junbo wang
moses
MOBIN
Shawn Huang
Jzjsnow
Umesh Dangat
yuanoOo
stayrascal
Hang Ruan
ouyangwulin
Xin Gong
liuxiaodong
Leonard Xu
ConradJam