193 Commits (release-2.3)

Author	SHA1	Message	Date
Junwang Zhao	eb230bf30c	[mysql] Serialize isSuspended flag for MySqlBinlogSplit (#996)	3 years ago
Leonard Xu	1d7fdac24e	[build] Bump version to 2.3-SNAPSHOT	3 years ago
yexianxun	31c6659d2a	[cdc-base] The first version of Incremental Snapshot Framework abstraction	3 years ago
Junwang Zhao	f2bdd47079	[mysql] Suspend SourceReader eagerly to reduce restoration time ... This closes #973.	3 years ago
Leonard Xu	dfdee07669	[test][e2e] Clean up database resources for every e2e tests.	3 years ago
Junwang Zhao	2d47b15782	[hotfix][mysql] Avoid schema isn't known error when scanNewlyAddedTable enabled (#965)	3 years ago
gongzhongqiang	a96e70a996	[mysql][polardbx] Remove debug print code in PolardbxSourceTCase (#968) ... This closes #968.	3 years ago
ehui	41a5463437	[mysql] Split snapshot chunks asynchronously (#931)	3 years ago
Leonard Xu	b911dd2a1b	[tidb] The first draft of tidb cdc connector	3 years ago
hele.kc	410e4fae57	[mysql] Fallback to build schema by 'desc table' case when parsing DDL failure (#949)	3 years ago
Paul Zhang	580391b6ee	[mysql] Allow custom JDBC URL parameters in MySQL CDC source (#921)	3 years ago
Qingsheng Ren	2a704e551c	[mysql] Improve mysql heartbeat feature and tests ... This closes #927.	3 years ago
camelusluo	3cb6a815dc	[mysql] Original implementation of mysql heartbeat feature	3 years ago
Junwang Zhao	2ff83fd86d	[hotfix][mysql] Fix MySqlSourceReader#snapshotState should return unfinishedSplits (#926) ... Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>	3 years ago
Dian Qi	64e3408b20	[hotfix][mysql] Fix the binlog position didn't update when emit DDL (#925)	3 years ago
Paul Zhang	8002de4a5b	[common] Allow user to pass custom JsonConverter configs in JsonDebeziumDeserializationSchema (#615)	3 years ago
Leonard Xu	16ec365523	[mysql] Improve the test to cover table with varbinary primary key (#879) ... This closes #879.	3 years ago
fangpc	18cbde8afb	[mysql] Support primary key with varbinary type (#879)	3 years ago
Leonard Xu	c77275cb68	[hotfix][minor] Fix the test code typo	3 years ago
Leonard Xu	2ad6714442	[mysql] Fix ArrayIndexOutOfBoundsException in mysql binlog read phase (#911)	3 years ago
gongzhongqiang	1b34887c08	[common] Use ResolvedSchema instead of deprecated TableSchema API (#782)	3 years ago
wangxiaojing	b21466a848	[common] Make Flink CDC Compatible with Flink 1.14	3 years ago
元组	e70e0f1b68	[hotfix][mysql] Rename method from dispatchHighWatermark to dispatchBinlogEndEvent (#810) ... This closes #810.	3 years ago
Junwang Zhao	7455ad63ab	[mysql] Use READ type for all records in snapshot reading (#842)	3 years ago
Leonard Xu	8a9d821dc7	[mysql] Rewrite the newly added table tests to cover more cases (#777) ... This closes #777.	3 years ago
Leonard Xu	c94791fd14	[mysql] Improve newly added tables process	3 years ago
元组	c21aa91e5d	[mysql] Support capture newly added tables for existed pipeline	3 years ago
luoyuxia	5511904b62	[mysql] add test to cover the datatype GeomCollection that's synonymous with GeometryCollection for mysql8 (#822)	3 years ago
gongzhongqiang	5c7e2602be	[sqlserver] Add SqlServer cdc connector (#662) ... Co-authored-by: Leonard Xu <leonard@apache.org>	3 years ago
hiscat	fab9dcaf90	[hotfix] Fix MySqlSource comment typo (#793)	3 years ago
taox	c584ecf04c	[mysql] Support MySQL 5.6 (#396) ... Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	3 years ago
Leonard Xu	8368bfb4de	[build] Switch to Log4j 2 by default (#791)	3 years ago
Leonard Xu	3b20f9319d	[hotfix][mysql] Fix message timestamp of snapshot record to 0L (#752)	3 years ago
Jiabao Sun	5c924eea6d	[hotfix][mysql] Set minimum connection pool size to 1 (#692)	3 years ago
Jark Wu	c97968e637	[build] Remove override definition of maven-surefire-plugin in connectors pom (#673)	3 years ago
Xianxun Ye	7712f9825f	[hotfix] Fix the parameter typo in java doc (#651)	3 years ago
Tuple	56112e9b7c	[mysql] Add a method to get MySqlSourceConfigFactory from MySqlSource (#648)	3 years ago
Leonard Xu	456e2a435c	[mysql] Set default driver class name for PooledDataSource (#659)	3 years ago
Tuple	cf50566f34	[mysql] Fix there is duplicate records outputted when keep updating table during snapshot read (#592) ... Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>	3 years ago
Leonard Xu	6174c7e690	[build] Bump version to 2.2-SNAPSHOT	3 years ago
gongzhongqiang	dc5a0c20df	[mysql] Reading a null column with default value defined should return null instead of default value (#555)	3 years ago
Leonard Xu	7ae20a1277	[mysql] Optimize the dynamic chunk size calculation for table with dense distribution (#599)	3 years ago
Leonard Xu	997651427f	[hotfix][mysql] Fix number overflow in ObjectUtils.minus (#598)	3 years ago
Leonard Xu	39944c9ecd	[docs] Add metadata column example for mysql-cdc and mongodb-cdc connector	3 years ago
Leonard Xu	75276235dc	[mysql] Skip ddl events in snapshot split normalization (#577)	3 years ago
Leonard Xu	4b15614c45	[mysql] Support dynamic chunk size for evenly distribution table	3 years ago
Leonard Xu	e0095458a1	[mysql][minor] Use 'table.include.list' key instead of legacy key 'table.whitelist' in SnapshotSplitReader	3 years ago
Leonard Xu	aa3e282cfd	[mysql] Set server time zone information for connection pool factory (#566)	3 years ago
tuple	e7ed77f74b	[mysql] Polish binlog offset compare semantic (#543)	3 years ago
gongzhongqiang	0bd39e5310	[postgres] Support metadata columns for postgres-cdc connector (#500) ... Co-authored-by: Leonard Xu <xbjtdcq@163.com>	3 years ago
Leonard Xu	51f5a90eb3	[mysql] Reduce the connection usage in table discovery process	3 years ago
Leonard Xu	930efd9ce4	[mysql] Introduce Jdbc connection pools	3 years ago
luoyuxia	eeae69cdf9	[mysql] support all mysql data types (#438) ... This closes #438	3 years ago
Leonard Xu	63a071cb82	[mysql] Support binlog split with huge snapshot split meta	3 years ago
Leonard Xu	2bc715e76a	[mysql] Support tables with different split key	3 years ago
luoyuxia	5cf940d160	[mysql] Validate the regex pattern of database-name and table-name in table factory (#526)	3 years ago
mincwang	98ab02fed2	[docs] Use new MySqlSource API in documentation ... Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	3 years ago
Leonard Xu	0f1b493d6a	[hotfix][mysql] Correct the usage of includeSchemaChanges parameter (#501)	3 years ago
Leonard Xu	5ce7adb619	[mysql] Expose MySqlSource API that supports incremental snapshot (#495) ... Co-authored-by: Jark Wu <jark@apache.org>	3 years ago
Jark Wu	12f27acda2	[mysql] Support metadata columns for mysql-cdc connector (#496)	3 years ago
luoyuxia	64fc3e34b5	[common] Support to read tables of inconsistent schema (#494)	3 years ago
Leonard Xu	004d1768ac	[mysql] Support wide table with huge number of columns	3 years ago
Leonard Xu	f0dede1934	[tests] Correct the argument order of assertArrayEqualInOrder/assertArrayEqualAnyOrder	3 years ago
Leonard Xu	ee3d7f4584	[tests] Introduce assertEqualsInOrder/assertEqualsInAnyOrder methods for test ... this closes #437	3 years ago
Leonard Xu	d89373b294	[tests] Improve the unstable test testStartupFromLatestOffset in MySqlConnectorITCase	3 years ago
Leonard Xu	a785efab5a	[mysql] Fix the restoration failure when checkpoint happened in one MySQL transaction	3 years ago
Leonard Xu	22f2ac8a75	[mysql] Optimization that skips the binlog read if the low watermark equals high watermark	3 years ago
luoyuxia	cfe3d3e400	[mysql] Add source metrics for MySqlParallelSource ... Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	3 years ago
Leonard Xu	d4d4eb32e2	[mysql] Use min/max of split key and row count to describe the distribution of table ... this closes #392	3 years ago
Leonard Xu	70a0e80d86	[mysql] Fix the ClassCastException in RecordUtils ... this closes #330	3 years ago
mincwang	7f12859304	[common] Support json deserialization schema	4 years ago
Leonard Xu	c52576f6d4	[mysql] Improve the tests code	4 years ago
Leonard Xu	15985d9269	[mysql] Fix the MySqlSnapshotSplitAssigner may assign duplicate splits	4 years ago
Leonard Xu	a6eccf5789	[mysql] Add tests to check mysql-cdc works well under various timezones (#367) ... Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>	4 years ago
Leonard Xu	a26096910e	[mysql] Optimize the checkpoint be optional under single parallelism (#365) ... Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>	4 years ago
taox	e34ff84a43	[mysql] Correct the initial binlog offset for MySqlHybridSplitAssigner ... Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>	4 years ago
Jiabao Sun	d76b17495e	[mysql] Add default value for 'database.history.instance.name' in MySqlParallelSource ... This closes #326	4 years ago
ili zh	28faecdf04	[mysql] Improve the code format in SignalEventDispatcher	4 years ago
gongzhongqiang	08e9c756e1	[docs] Update the debezium document link to version 1.5	4 years ago
manmao	23bdc7a95b	[postgres] Fix Validator didn't implement Serializable ... Co-authored-by: mao.man@rootcloud.com <mao.man@rootcloud.com>	4 years ago
Leonard Xu	9ee80c5239	[build] Bump version to 2.1-SNAPSHOT	4 years ago
Leonard Xu	7b5f6aab9c	[mysql] Forbid using problematic startup options earliest-offset/specific-offset/timestamp	4 years ago
Shengkai	2f644007e2	[mysql] Validate MySQL server configuration (version, binlog_format, binlog_row_image) before start job ... This closes #211	4 years ago
Leonard Xu	8162dc7ae3	[build] Rename group.id and packge name from 'com.alibaba.ververica' to 'com.ververica' (#287)	4 years ago
Leonard Xu	848a6bfefc	[debezium] Avoid uncompleted state of schema history when engine stop before checkpoint ... * This close (#282)	4 years ago
Jark Wu	5180bc984f	[mysql] Refactor split assigner and simplify chunk splitting (#283)	4 years ago
Leonard Xu	2edf6d3778	[mysql] Enable single server id for MySqlParallelSource	4 years ago
Leonard Xu	e894b0a69e	[mysql] Keep the global order of between snapshot records and binlog records	4 years ago
Leonard Xu	8638720d71	[mysql] Support latest-offset mode for MySqlParallelSource	4 years ago
Leonard Xu	75c01c530e	[mysql] Simplify the options for Mysql Source	4 years ago
Jark Wu	ff6b638262	[mysql] Improve split state and enumerator state structure	4 years ago
Jark Wu	7d369548b0	[mysql] Move MySqlSplitReader from 'split' to 'reader' package	4 years ago
Jark Wu	a42f6ae61c	[mysql] Simplify EmbeddedFlinkDatabaseHistory to not record schema changes	4 years ago
Leonard Xu	ae54f0b11a	[mysql] Throw underlying debezium reader exception	4 years ago
Leonard Xu	35c636224d	[mysql] Make every subtask used different database history	4 years ago
Leonard Xu	a0e5e7a65b	[mysql] Optimize the data structure of split and splitState ... This closes #268	4 years ago
Leonard Xu	5542233278	[mysql] Add JM/TM failover tests to check checkpoint works fine	4 years ago
Jark Wu	c4a7d6ad56	[build] Bump version to 2.0-SNAPSHOT	4 years ago
Jark Wu	ce2ee32521	[mysql][test] Rename "custom.sql" to "customer.sql"	4 years ago
Jark Wu	e9e78f10d6	[mysql] Refactor class names to use "MySql" prefix instead of "MySQL"	4 years ago