225 Commits (53ff798ef6ef393d0f6ed7f8136ec5940ff4279c)

Author	SHA1	Message	Date
empcl	cf8a2f4b07	[hotfix][docs] Fix comment typo in MysqlSnapshotSplit (#1513) ... Co-authored-by: chenlei677 <chenlei677@jd.com>	3 years ago
Leonard Xu	72c806cb9d	[mysql] Let all records of one snapshot split don't cross checkpoints (#1505) ... This closes #1505.	3 years ago
Sergey Nuyanzin	9f97e06f32	[tests] Remove usage of deprecated EnvironmentSettings.Builder#useBlinkPlanner (#1493) ... This closes #1493.	3 years ago
Leonard Xu	238305b2d9	[cdc-base][mysql] Fix split key comparison when may contain different types (#1499) ... This closes #1496.	3 years ago
Kyle Dong	b3ebf3da69	[mysql] Use local timezone as the default value of 'server-time-zone' option (#1407) ... This closes #1406.	3 years ago
Leonard Xu	cfbd00fa34	[mysql][polardbx] Stop container timely in tests (#1468)	3 years ago
Hang Ruan	7c9b30276d	[mysql][ploardbx] Support all charsets in column level (#1166) ... This closes #1166.	3 years ago
lidoudou1993	6a2f470ae3	[mysql][minor] Skip capture newly added tables according snapshotassigner's status (#1449) ... Co-authored-by: lidoudou3 <lidoudou1@jd.com>	3 years ago
Leonard Xu	638474d6c7	[polardbx][test] Bump the polardb-x image version from 2.0.1 to 2.10 (#1423)	3 years ago
Hang Ruan	6a56985fa8	[hotfix][test] Fix MySqlSourceITCase failure due to StreamExecutionEnvironment#getConfiguration returned unmodifiable object (#1446)	3 years ago
Hang Ruan	2bb5b6f625	[test] Fix tests missed 'update_before' records if the primary keys of source and sink are different (#1451)	3 years ago
Hang Ruan	9e6549c67e	[polardbx][test] Rename PolardbxSourceTCase to PolardbxSourceITCase (#1447)	3 years ago
Hang Ruan	a5dd0c0a14	[mysql] Enable pass custom jdbc properties for debezium mysql connection (#1217) ... This closes #674	3 years ago
Matrix42	c96926b6ec	[mysql] Release the debezium reader thread resources after reading finished (#1358) ... This closes #1350.	3 years ago
Leonard Xu	70ebfefa9c	[hotfix][mysql] Fix compile error due to merge conflict	3 years ago
Hang Ruan	96c84d9c65	[mysql] Generates multiple chunks when approximate row count is bigger than chunk size (#1193) ... This closes #1191.	3 years ago
Hang Ruan	0d1ce7a702	[mysql] Introduce 'scan.incremental.snapshot.chunk.key-column' option to support splitting table by custom column (#1415) ... This closes #1108.	3 years ago
lzshlzsh	74f0a65355	[mysql] Optimize pure binlog phase check logic to improve performance (#1392) ... Co-authored-by: sammieliu <sammieliu@tencent.com>	3 years ago
Leonard Xu	a10ae4624e	[build] Use correct year and copyright owner in license files (#1390) ... This closes #1389.	3 years ago
gongzhongqiang	e7238f2407	[mysql] Fix dead loop when splitting chunks. (#1107)	3 years ago
Sergey Nuyanzin	2f3c872306	[build] Bump Flink version to 1.14.4 (#1284) ... This closes #1284	3 years ago
ehui	1fdf28fe49	[mysql] Adopt streaming merge during snapshotSplit scan to avoid OOM (#1219) ... This closes #1219	3 years ago
jiabao.sun	ccaaf4695d	[mysql] Connection pool id should contains username (#1328)	3 years ago
jiabao.sun	146135ebfb	[dbz] Patch for DBZ-5126 to fix memory leak problem. (#939)	3 years ago
gongzhongqiang	55e4ae57e5	[hotfix][docs] Fix typo in java docs. (#1305) ... This closes #1305.	3 years ago
ruanhang1993	85a6515245	[mysql] Support optional numeric unsigned zerofill types (#1197) ... Co-authored-by: bangjiang.xbj <bangjiang.xbj@alibaba-inc.com>	3 years ago
Qingsheng Ren	9c905f6dd1	[mysql] Add heartbeatInterval field to equals() and hashCode() (#1116)	3 years ago
Qingsheng Ren	47e005ab47	[mysql] Catch and hold exception in chunk splitter thread and rethrow in getNext() (#1109)	3 years ago
camelus	c0aca57a8f	[mysql] Use the gtid set firstly when compare the binlog offset (#761) ... Co-authored-by: camelusluo <camelusluo@tencent.com>	3 years ago
Leonard Xu	7eb9247122	[mysql] Throw RuntimeException timely in snapshot scan phase (#1098)	3 years ago
Qingsheng Ren	f9a8c403c8	[common] Apply filter on ResolvedSchema to keep physical columns only (#1092)	3 years ago
Leonard Xu	59b310a24c	[common] Bump debezium version to 1.6.4.Final	3 years ago
Junwang Zhao	eb230bf30c	[mysql] Serialize isSuspended flag for MySqlBinlogSplit (#996)	3 years ago
Leonard Xu	1d7fdac24e	[build] Bump version to 2.3-SNAPSHOT	3 years ago
yexianxun	31c6659d2a	[cdc-base] The first version of Incremental Snapshot Framework abstraction	3 years ago
Junwang Zhao	f2bdd47079	[mysql] Suspend SourceReader eagerly to reduce restoration time ... This closes #973.	3 years ago
Leonard Xu	dfdee07669	[test][e2e] Clean up database resources for every e2e tests.	3 years ago
Junwang Zhao	2d47b15782	[hotfix][mysql] Avoid schema isn't known error when scanNewlyAddedTable enabled (#965)	3 years ago
gongzhongqiang	a96e70a996	[mysql][polardbx] Remove debug print code in PolardbxSourceTCase (#968) ... This closes #968.	3 years ago
ehui	41a5463437	[mysql] Split snapshot chunks asynchronously (#931)	3 years ago
Leonard Xu	b911dd2a1b	[tidb] The first draft of tidb cdc connector	3 years ago
hele.kc	410e4fae57	[mysql] Fallback to build schema by 'desc table' case when parsing DDL failure (#949)	3 years ago
Paul Zhang	580391b6ee	[mysql] Allow custom JDBC URL parameters in MySQL CDC source (#921)	3 years ago
Qingsheng Ren	2a704e551c	[mysql] Improve mysql heartbeat feature and tests ... This closes #927.	3 years ago
camelusluo	3cb6a815dc	[mysql] Original implementation of mysql heartbeat feature	3 years ago
Junwang Zhao	2ff83fd86d	[hotfix][mysql] Fix MySqlSourceReader#snapshotState should return unfinishedSplits (#926) ... Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>	3 years ago
Dian Qi	64e3408b20	[hotfix][mysql] Fix the binlog position didn't update when emit DDL (#925)	3 years ago
Paul Zhang	8002de4a5b	[common] Allow user to pass custom JsonConverter configs in JsonDebeziumDeserializationSchema (#615)	3 years ago
Leonard Xu	16ec365523	[mysql] Improve the test to cover table with varbinary primary key (#879) ... This closes #879.	3 years ago
fangpc	18cbde8afb	[mysql] Support primary key with varbinary type (#879)	3 years ago
Leonard Xu	c77275cb68	[hotfix][minor] Fix the test code typo	3 years ago
Leonard Xu	2ad6714442	[mysql] Fix ArrayIndexOutOfBoundsException in mysql binlog read phase (#911)	3 years ago
gongzhongqiang	1b34887c08	[common] Use ResolvedSchema instead of deprecated TableSchema API (#782)	3 years ago
wangxiaojing	b21466a848	[common] Make Flink CDC Compatible with Flink 1.14	3 years ago
元组	e70e0f1b68	[hotfix][mysql] Rename method from dispatchHighWatermark to dispatchBinlogEndEvent (#810) ... This closes #810.	3 years ago
Junwang Zhao	7455ad63ab	[mysql] Use READ type for all records in snapshot reading (#842)	3 years ago
Leonard Xu	8a9d821dc7	[mysql] Rewrite the newly added table tests to cover more cases (#777) ... This closes #777.	3 years ago
Leonard Xu	c94791fd14	[mysql] Improve newly added tables process	3 years ago
元组	c21aa91e5d	[mysql] Support capture newly added tables for existed pipeline	3 years ago
luoyuxia	5511904b62	[mysql] add test to cover the datatype GeomCollection that's synonymous with GeometryCollection for mysql8 (#822)	3 years ago
gongzhongqiang	5c7e2602be	[sqlserver] Add SqlServer cdc connector (#662) ... Co-authored-by: Leonard Xu <leonard@apache.org>	3 years ago
hiscat	fab9dcaf90	[hotfix] Fix MySqlSource comment typo (#793)	3 years ago
taox	c584ecf04c	[mysql] Support MySQL 5.6 (#396) ... Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	3 years ago
Leonard Xu	8368bfb4de	[build] Switch to Log4j 2 by default (#791)	3 years ago
Leonard Xu	3b20f9319d	[hotfix][mysql] Fix message timestamp of snapshot record to 0L (#752)	3 years ago
Jiabao Sun	5c924eea6d	[hotfix][mysql] Set minimum connection pool size to 1 (#692)	3 years ago
Jark Wu	c97968e637	[build] Remove override definition of maven-surefire-plugin in connectors pom (#673)	3 years ago
Xianxun Ye	7712f9825f	[hotfix] Fix the parameter typo in java doc (#651)	3 years ago
Tuple	56112e9b7c	[mysql] Add a method to get MySqlSourceConfigFactory from MySqlSource (#648)	3 years ago
Leonard Xu	456e2a435c	[mysql] Set default driver class name for PooledDataSource (#659)	3 years ago
Tuple	cf50566f34	[mysql] Fix there is duplicate records outputted when keep updating table during snapshot read (#592) ... Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>	3 years ago
Leonard Xu	6174c7e690	[build] Bump version to 2.2-SNAPSHOT	3 years ago
gongzhongqiang	dc5a0c20df	[mysql] Reading a null column with default value defined should return null instead of default value (#555)	3 years ago
Leonard Xu	7ae20a1277	[mysql] Optimize the dynamic chunk size calculation for table with dense distribution (#599)	3 years ago
Leonard Xu	997651427f	[hotfix][mysql] Fix number overflow in ObjectUtils.minus (#598)	3 years ago
Leonard Xu	39944c9ecd	[docs] Add metadata column example for mysql-cdc and mongodb-cdc connector	3 years ago
Leonard Xu	75276235dc	[mysql] Skip ddl events in snapshot split normalization (#577)	3 years ago
Leonard Xu	4b15614c45	[mysql] Support dynamic chunk size for evenly distribution table	3 years ago
Leonard Xu	e0095458a1	[mysql][minor] Use 'table.include.list' key instead of legacy key 'table.whitelist' in SnapshotSplitReader	3 years ago
Leonard Xu	aa3e282cfd	[mysql] Set server time zone information for connection pool factory (#566)	3 years ago
tuple	e7ed77f74b	[mysql] Polish binlog offset compare semantic (#543)	3 years ago
gongzhongqiang	0bd39e5310	[postgres] Support metadata columns for postgres-cdc connector (#500) ... Co-authored-by: Leonard Xu <xbjtdcq@163.com>	3 years ago
Leonard Xu	51f5a90eb3	[mysql] Reduce the connection usage in table discovery process	3 years ago
Leonard Xu	930efd9ce4	[mysql] Introduce Jdbc connection pools	3 years ago
luoyuxia	eeae69cdf9	[mysql] support all mysql data types (#438) ... This closes #438	3 years ago
Leonard Xu	63a071cb82	[mysql] Support binlog split with huge snapshot split meta	3 years ago
Leonard Xu	2bc715e76a	[mysql] Support tables with different split key	3 years ago
luoyuxia	5cf940d160	[mysql] Validate the regex pattern of database-name and table-name in table factory (#526)	3 years ago
mincwang	98ab02fed2	[docs] Use new MySqlSource API in documentation ... Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	3 years ago
Leonard Xu	0f1b493d6a	[hotfix][mysql] Correct the usage of includeSchemaChanges parameter (#501)	3 years ago
Leonard Xu	5ce7adb619	[mysql] Expose MySqlSource API that supports incremental snapshot (#495) ... Co-authored-by: Jark Wu <jark@apache.org>	3 years ago
Jark Wu	12f27acda2	[mysql] Support metadata columns for mysql-cdc connector (#496)	3 years ago
luoyuxia	64fc3e34b5	[common] Support to read tables of inconsistent schema (#494)	3 years ago
Leonard Xu	004d1768ac	[mysql] Support wide table with huge number of columns	3 years ago
Leonard Xu	f0dede1934	[tests] Correct the argument order of assertArrayEqualInOrder/assertArrayEqualAnyOrder	3 years ago
Leonard Xu	ee3d7f4584	[tests] Introduce assertEqualsInOrder/assertEqualsInAnyOrder methods for test ... this closes #437	4 years ago
Leonard Xu	d89373b294	[tests] Improve the unstable test testStartupFromLatestOffset in MySqlConnectorITCase	4 years ago
Leonard Xu	a785efab5a	[mysql] Fix the restoration failure when checkpoint happened in one MySQL transaction	4 years ago
Leonard Xu	22f2ac8a75	[mysql] Optimization that skips the binlog read if the low watermark equals high watermark	4 years ago
luoyuxia	cfe3d3e400	[mysql] Add source metrics for MySqlParallelSource ... Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	4 years ago