flink-cdc-connectors

Commit Graph

Author	SHA1	Message	Date
gongzhongqiang	e7964b160c	[FLINK-36086] Add EVENT_SERIAL_NO_KEY for record event processed in state for fix repeat read event after restart during one transaction	3 days ago
gongzhongqiang	1a68e2cc83	[FLINK-36086] Add test for sqlserver restart during one transaction and add new version SourceSplitSerializer	3 days ago
gongzhongqiang	12890f8bdb	[FLINK-36086] Set isSnapshotCompleted only immediately after snapshot Co-authored-by: Sergei Morozov <morozov@tut.by>	3 days ago
Ferenc Csaky	0211a136cf	[FLINK-37152][build] Update Flink version to 1.20 This closes #3868.	5 days ago
yuxiqian	858371c845	[FLINK-37306][tests] Fix MySQLSourceITCase failure in non-UTC timezone This closes #3917	1 week ago
yohei yoshimuta	39608ed663	[FLINK-36945][cdc-connector/mysql] Support parsing rename multiple tables in one statement This closes #3876.	2 weeks ago
Kunni	cd1fb6f980	[FLINK-37191][cdc-connector/mysql] Avoid back filling when lowWatermark is equal to highWatermark in BinlogSplit This closes #3902	2 weeks ago
yuxiqian	0a4c256433	[FLINK-37262][pipeline-connector/mysql] Fix missing PARSE_ONLINE_SCHEMA_CHANGES option in MySqlDataSourceFactory This closes #3910	2 weeks ago
yuxiqian	82bf8a08ef	[tests][ci] Miscellaneous improvements on CI robustness This closes #3911	2 weeks ago
Shawn Huang	6686bcb4ad	[hotfix][license] Update legacy license This closes #3908	2 weeks ago
Seung-Min Lee	a1c9c19d7d	[FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase This closes #3658	1 month ago
Olivier	7997f51c55	[FLINK-35067][cdc-connector][postgres] Adding metadata 'row_kind' for Postgres CDC Connector. This closes #3716. Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	1 month ago
wudi	2fa215e5c4	[FLINK-35600][pipeline-connector/mysql] Add timestamp for low and high watermark This closes #3415	1 month ago
Kunni	afd4a74c0a	[FLINK-35802][pipeline-connectors/mysql] Clean ChangeEventQueue to avoid deadlock when calling BinaryLogClient#disconnect method This closes #3463	1 month ago
North Lin	9ad071c1fa	[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector (#3608 ) * [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector * reformat code * Update MySqlPipelineITCase.java * pass a boolean value instead of Properties * uodate FAQ * add a method to get tinyInt1isBit * add new cdc config `treat-tinyint1-as-boolean` * Update MySqlChunkSplitter.java * change param name	1 month ago
yuxiqian	e2b8f70e0d	[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs This closes #3860	1 month ago
Hongshun Wang	bcd70df85c	[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat This closes #3667	1 month ago
yuxiqian	39fd00ce49	[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes (#3668 ) Co-authored-by: MOBIN-F <18814118038@163.com>	1 month ago
Shawn Huang	085684b773	[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished (#3793 )	1 month ago
yuanoOo	6a345aaa80	[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC This closes #3360.	2 months ago
yuxiqian	ddb5f00df5	[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` (#3831 ) Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	6d21941661	[hotfix] Fix Java 11 target compatibility & add tests (#3633 ) * [hotfix] Fix Java 11 target compatibility Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> # Conflicts: # .github/workflows/flink_cdc_java_8.yml # .github/workflows/flink_cdc_migration_test_base.yml # pom.xml * fix: clarify GiHub workflow names Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> --------- Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	dfbaf617e2	[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18 This closes #3647.	2 months ago
ouyangwulin	0b0bb02023	[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797 )	2 months ago
Hongshun Wang	12cf22f7b4	[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510 )	2 months ago
Sergei Morozov	b50d1728e0	[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source This closes #3794.	2 months ago
Xin Gong	0037c4379e	[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] (#3755 )	2 months ago
yuxiqian	2e54caf9dd	[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests This closes #3792	3 months ago
liuxiaodong	ee9cd828c3	[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics (#3619 ) Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	3 months ago
yuxiqian	26f5880fbf	[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases (#3712 )	3 months ago
Hang Ruan	23e8149e6a	[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit (#3763 )	3 months ago
Xin Gong	1d4e366969	[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions This closes #3754	3 months ago
Leonard Xu	d0b2fe38a2	[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 (#3748 )	3 months ago
Leonard Xu	01a1e5fba5	[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type (#3683 )	3 months ago
ConradJam	dd79a02f0f	[FLINK-36586][build] Update flink version to 1.19 (#3660 ) Co-authored-by: ConradJam <czy006@apache.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	3 months ago
ConradJam	13248faa22	[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp This closes #3332 Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	3 months ago
wudi	7f6d9115ae	[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error (#3678 )	4 months ago
Xin Gong	d5f1b9ace8	[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase (#3602 )	4 months ago
Hongshun Wang	086bd9996a	[FLINK-36618][cdc-connector][postgres] Improve PostgresDialect.discoverDataCollections to reduce the bootstrap time This closes #3672.	4 months ago
Shawn Huang	ecce75949a	[FLINK-36463][cdc-connector][mysql] Forbid to override some debezium options (#3631 )	4 months ago
yuxiqian	d5f549f91f	[FLINK-36326][cdc-connector][mysql] Send BinlogSplitUpdateRequestEvent only once to fix auto scan newly-added table failure (#3613 ) Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	4 months ago
yuxiqian	daf27fa7a8	[hotfix][test] Reorganize test cases	4 months ago
gongzhongqiang	a5b666a325	[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture (#3600 )	5 months ago
Hongshun Wang	afe9c3c0ad	[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true This closes #3573.	6 months ago
Jiabao Sun	aea2b6aa9c	[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run (#3555 )	6 months ago
Sergei Morozov	52f2019469	[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp This closes #3561.	6 months ago
Kevin Wang	77c63385d9	[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart (#3548 ) Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>	6 months ago
He Wang	cbb33bb870	[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network (#3439 )	6 months ago
Hongshun Wang	4bf5a395a5	[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly This closes #3519.	7 months ago
yuxiqian	b937db25d5	[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling (#3506 )	7 months ago

1 2 3 4

171 Commits (e7964b160c1df3861571ba2199ba04d91d887ff2)