Commit Graph

154 Commits (4a69557245aa3f55e159229c19fe453fd47936a6)

Author SHA1 Message Date
yuxiqian 39fd00ce49
[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes (#3668)
Co-authored-by: MOBIN-F <18814118038@163.com>
1 month ago
Shawn Huang 085684b773
[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished (#3793) 1 month ago
yuanoOo 6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
This closes #3360.
2 months ago
yuxiqian ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` (#3831)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
yuxiqian 6d21941661
[hotfix] Fix Java 11 target compatibility & add tests (#3633)
* [hotfix] Fix Java 11 target compatibility

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

# Conflicts:
#	.github/workflows/flink_cdc_java_8.yml
#	.github/workflows/flink_cdc_migration_test_base.yml
#	pom.xml

* fix: clarify GiHub workflow names

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
yuxiqian dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
This closes  #3647.
2 months ago
ouyangwulin 0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797) 2 months ago
Hongshun Wang 12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510) 2 months ago
Sergei Morozov b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
This closes #3794.
2 months ago
Xin Gong 0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] (#3755) 3 months ago
yuxiqian 2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
This closes #3792
3 months ago
liuxiaodong ee9cd828c3
[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics (#3619)
Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
yuxiqian 26f5880fbf
[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases (#3712) 3 months ago
Hang Ruan 23e8149e6a
[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit (#3763) 3 months ago
Xin Gong 1d4e366969
[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions
This closes  #3754
3 months ago
Leonard Xu d0b2fe38a2
[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 (#3748) 3 months ago
Leonard Xu 01a1e5fba5
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type (#3683) 3 months ago
ConradJam dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 (#3660)
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
ConradJam 13248faa22
[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp
This closes #3332

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
wudi 7f6d9115ae
[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error (#3678) 4 months ago
Xin Gong d5f1b9ace8
[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase (#3602) 4 months ago
Hongshun Wang 086bd9996a
[FLINK-36618][cdc-connector][postgres] Improve PostgresDialect.discoverDataCollections to reduce the bootstrap time
This closes #3672.
4 months ago
Shawn Huang ecce75949a
[FLINK-36463][cdc-connector][mysql] Forbid to override some debezium options (#3631) 4 months ago
yuxiqian d5f549f91f
[FLINK-36326][cdc-connector][mysql] Send BinlogSplitUpdateRequestEvent only once to fix auto scan newly-added table failure (#3613)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
4 months ago
yuxiqian daf27fa7a8 [hotfix][test] Reorganize test cases 4 months ago
gongzhongqiang a5b666a325
[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture (#3600) 5 months ago
Hongshun Wang afe9c3c0ad
[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true
This closes  #3573.
6 months ago
Jiabao Sun aea2b6aa9c
[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run (#3555) 6 months ago
Sergei Morozov 52f2019469
[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp
This closes #3561.
6 months ago
Kevin Wang 77c63385d9
[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart (#3548)
Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>
6 months ago
He Wang cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439) 6 months ago
Hongshun Wang 4bf5a395a5
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly
This closes #3519.
7 months ago
yuxiqian b937db25d5
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling (#3506) 7 months ago
lipl f6d1d4810a
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly (#3497)
* resolve conficts

* polish code to trigger ci

---------

Co-authored-by: Kael <kael@fts.dev>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
7 months ago
Thorne 986f37b307
[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file (#3432) 7 months ago
Hongshun Wang 0c49959f67
[FLINK-35524][cdc-base] Clear connections pools when reader exist. (#3388) 7 months ago
Hongshun Wang 47f5660055
[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter (#3319) 7 months ago
yuxiqian 241eb03a74
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0
This closes #3489.
7 months ago
SeungMin 91fc7bb506
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key
This closes #3448.
7 months ago
Zhongmin Qiao ea71b2302d
[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set before call getBinlogPosition method
This closes #3488.
7 months ago
ChengJie1053 313bace106
[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchema doc description
This closes #3443.
7 months ago
gongzhongqiang c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481) 7 months ago
Xin Gong 332e1f330d
[minor][cdc-connector][sqlserver] Fix some typos (#3421) 7 months ago
ChengJie1053 9a97182fbb
[minor][cdc-connector][mysql] Code optimization for constants
This closes #3385
7 months ago
ChengJie1053 2d50e43137
[minor][cdc-connector][postgres] PostgresDialect removes useless code
This closes #3416.
7 months ago
Joao Boto 94a0415475
[FLINK-34883] Fix postgres uuid column as PK (#3282)
* [FLINK-34883] Fix postgres uuid column as PK

* [FLINK-34883] Fix column comment.
8 months ago
skylines a2539f5cfa
[hotfix][docs][postgres] Remove unsupported erroneous example code
This closes #3464
8 months ago
Xin Gong 2d1eb0aff1
[FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add table (#3203)
* [cdc-connector][oracle] Oracle cdc support newly add table

* [cdc-connector][oracle] Fix code style

* [cdc-connector][oracle] Address comment
8 months ago
ouyangwulin 302a691225
[FLINK-35354] Support host mapping in Flink tikv cdc (#3336)
* [FLINK-35337][cdc] Keep up with the latest version of tikv client

* [FLINK-35354]Support host mapping in Flink tikv cdc

* [FLINK-35354] Add doc for host mapping feature

* [FLINK-35354] fixed annotation import
8 months ago
Shawn Huang 80920aaa28
[FLINK-35297][mysql] Add validation for option connect.timeout because of HikariConfig limitation (#3295) 8 months ago