flink-cdc-connectors

Commit Graph

Author	SHA1	Message	Date
Seung-Min Lee	a1c9c19d7d	[FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase This closes #3658	3 weeks ago
Olivier	7997f51c55	[FLINK-35067][cdc-connector][postgres] Adding metadata 'row_kind' for Postgres CDC Connector. This closes #3716. Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	3 weeks ago
wudi	2fa215e5c4	[FLINK-35600][pipeline-connector/mysql] Add timestamp for low and high watermark This closes #3415	3 weeks ago
Kunni	afd4a74c0a	[FLINK-35802][pipeline-connectors/mysql] Clean ChangeEventQueue to avoid deadlock when calling BinaryLogClient#disconnect method This closes #3463	3 weeks ago
North Lin	9ad071c1fa	[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector (#3608 ) * [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector * reformat code * Update MySqlPipelineITCase.java * pass a boolean value instead of Properties * uodate FAQ * add a method to get tinyInt1isBit * add new cdc config `treat-tinyint1-as-boolean` * Update MySqlChunkSplitter.java * change param name	3 weeks ago
yuxiqian	e2b8f70e0d	[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs This closes #3860	3 weeks ago
Hongshun Wang	bcd70df85c	[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat This closes #3667	3 weeks ago
yuxiqian	39fd00ce49	[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes (#3668 ) Co-authored-by: MOBIN-F <18814118038@163.com>	4 weeks ago
Shawn Huang	085684b773	[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished (#3793 )	4 weeks ago
yuanoOo	6a345aaa80	[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC This closes #3360.	1 month ago
yuxiqian	ddb5f00df5	[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` (#3831 ) Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	1 month ago
yuxiqian	6d21941661	[hotfix] Fix Java 11 target compatibility & add tests (#3633 ) * [hotfix] Fix Java 11 target compatibility Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> # Conflicts: # .github/workflows/flink_cdc_java_8.yml # .github/workflows/flink_cdc_migration_test_base.yml # pom.xml * fix: clarify GiHub workflow names Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> --------- Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	dfbaf617e2	[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18 This closes #3647.	2 months ago
ouyangwulin	0b0bb02023	[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797 )	2 months ago
Hongshun Wang	12cf22f7b4	[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510 )	2 months ago
Sergei Morozov	b50d1728e0	[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source This closes #3794.	2 months ago
Xin Gong	0037c4379e	[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] (#3755 )	2 months ago
yuxiqian	2e54caf9dd	[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests This closes #3792	2 months ago
liuxiaodong	ee9cd828c3	[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics (#3619 ) Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	2 months ago
yuxiqian	26f5880fbf	[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases (#3712 )	2 months ago
Hang Ruan	23e8149e6a	[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit (#3763 )	2 months ago
Xin Gong	1d4e366969	[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions This closes #3754	3 months ago
Leonard Xu	d0b2fe38a2	[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 (#3748 )	3 months ago
Leonard Xu	01a1e5fba5	[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type (#3683 )	3 months ago
ConradJam	dd79a02f0f	[FLINK-36586][build] Update flink version to 1.19 (#3660 ) Co-authored-by: ConradJam <czy006@apache.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	3 months ago
ConradJam	13248faa22	[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp This closes #3332 Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	3 months ago
wudi	7f6d9115ae	[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error (#3678 )	3 months ago
Xin Gong	d5f1b9ace8	[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase (#3602 )	3 months ago
Hongshun Wang	086bd9996a	[FLINK-36618][cdc-connector][postgres] Improve PostgresDialect.discoverDataCollections to reduce the bootstrap time This closes #3672.	3 months ago
Shawn Huang	ecce75949a	[FLINK-36463][cdc-connector][mysql] Forbid to override some debezium options (#3631 )	4 months ago
yuxiqian	d5f549f91f	[FLINK-36326][cdc-connector][mysql] Send BinlogSplitUpdateRequestEvent only once to fix auto scan newly-added table failure (#3613 ) Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	4 months ago
yuxiqian	daf27fa7a8	[hotfix][test] Reorganize test cases	4 months ago
gongzhongqiang	a5b666a325	[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture (#3600 )	5 months ago
Hongshun Wang	afe9c3c0ad	[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true This closes #3573.	5 months ago
Jiabao Sun	aea2b6aa9c	[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run (#3555 )	6 months ago
Sergei Morozov	52f2019469	[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp This closes #3561.	6 months ago
Kevin Wang	77c63385d9	[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart (#3548 ) Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>	6 months ago
He Wang	cbb33bb870	[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439 )	6 months ago
Hongshun Wang	4bf5a395a5	[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly This closes #3519.	6 months ago
yuxiqian	b937db25d5	[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling (#3506 )	6 months ago
lipl	f6d1d4810a	[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly (#3497 ) * resolve conficts * polish code to trigger ci --------- Co-authored-by: Kael <kael@fts.dev> Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>	6 months ago
Thorne	986f37b307	[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file (#3432 )	6 months ago
Hongshun Wang	0c49959f67	[FLINK-35524][cdc-base] Clear connections pools when reader exist. (#3388 )	6 months ago
Hongshun Wang	47f5660055	[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter (#3319 )	6 months ago
yuxiqian	241eb03a74	[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0 This closes #3489.	7 months ago
SeungMin	91fc7bb506	[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key This closes #3448.	7 months ago
Zhongmin Qiao	ea71b2302d	[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set before call getBinlogPosition method This closes #3488.	7 months ago
ChengJie1053	313bace106	[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchema doc description This closes #3443.	7 months ago
gongzhongqiang	c5f391cf6a	[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481 )	7 months ago
Xin Gong	332e1f330d	[minor][cdc-connector][sqlserver] Fix some typos (#3421 )	7 months ago

1 2 3 4

161 Commits (bbef6213a6759b8049e2f11888ef38aaabe71cf1)