Commit Graph

168 Commits (6a2f470ae381d6311e3baa706690a195ebbb788d)

Author SHA1 Message Date
lidoudou1993 6a2f470ae3
[mysql][minor] Skip capture newly added tables according snapshotassigner's status (#1449)
Co-authored-by: lidoudou3 <lidoudou1@jd.com>
3 years ago
Leonard Xu 638474d6c7 [polardbx][test] Bump the polardb-x image version from 2.0.1 to 2.10 (#1423) 3 years ago
Hang Ruan 6a56985fa8
[hotfix][test] Fix MySqlSourceITCase failure due to StreamExecutionEnvironment#getConfiguration returned unmodifiable object (#1446) 3 years ago
Hang Ruan 2bb5b6f625
[test] Fix tests missed 'update_before' records if the primary keys of source and sink are different (#1451) 3 years ago
Hang Ruan 9e6549c67e
[polardbx][test] Rename PolardbxSourceTCase to PolardbxSourceITCase (#1447) 3 years ago
Hang Ruan a5dd0c0a14
[mysql] Enable pass custom jdbc properties for debezium mysql connection (#1217)
This closes #674
3 years ago
Matrix42 c96926b6ec
[mysql] Release the debezium reader thread resources after reading finished (#1358)
This closes #1350.
3 years ago
Leonard Xu 70ebfefa9c [hotfix][mysql] Fix compile error due to merge conflict 3 years ago
Hang Ruan 96c84d9c65
[mysql] Generates multiple chunks when approximate row count is bigger than chunk size (#1193)
This closes #1191.
3 years ago
Hang Ruan 0d1ce7a702
[mysql] Introduce 'scan.incremental.snapshot.chunk.key-column' option to support splitting table by custom column (#1415)
This closes #1108.
3 years ago
lzshlzsh 74f0a65355
[mysql] Optimize pure binlog phase check logic to improve performance (#1392)
Co-authored-by: sammieliu <sammieliu@tencent.com>
3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390)
This closes #1389.
3 years ago
gongzhongqiang e7238f2407
[mysql] Fix dead loop when splitting chunks. (#1107) 3 years ago
Sergey Nuyanzin 2f3c872306
[build] Bump Flink version to 1.14.4 (#1284)
This closes #1284
3 years ago
ehui 1fdf28fe49
[mysql] Adopt streaming merge during snapshotSplit scan to avoid OOM (#1219)
This closes #1219
3 years ago
jiabao.sun ccaaf4695d [mysql] Connection pool id should contains username (#1328) 3 years ago
jiabao.sun 146135ebfb [dbz] Patch for DBZ-5126 to fix memory leak problem. (#939) 3 years ago
gongzhongqiang 55e4ae57e5
[hotfix][docs] Fix typo in java docs. (#1305)
This closes #1305.
3 years ago
ruanhang1993 85a6515245
[mysql] Support optional numeric unsigned zerofill types (#1197)
Co-authored-by: bangjiang.xbj <bangjiang.xbj@alibaba-inc.com>
3 years ago
Qingsheng Ren 9c905f6dd1
[mysql] Add heartbeatInterval field to equals() and hashCode() (#1116) 3 years ago
Qingsheng Ren 47e005ab47
[mysql] Catch and hold exception in chunk splitter thread and rethrow in getNext() (#1109) 3 years ago
camelus c0aca57a8f
[mysql] Use the gtid set firstly when compare the binlog offset (#761)
Co-authored-by: camelusluo <camelusluo@tencent.com>
3 years ago
Leonard Xu 7eb9247122
[mysql] Throw RuntimeException timely in snapshot scan phase (#1098) 3 years ago
Qingsheng Ren f9a8c403c8
[common] Apply filter on ResolvedSchema to keep physical columns only (#1092) 3 years ago
Leonard Xu 59b310a24c [common] Bump debezium version to 1.6.4.Final 3 years ago
Junwang Zhao eb230bf30c
[mysql] Serialize isSuspended flag for MySqlBinlogSplit (#996) 3 years ago
Leonard Xu 1d7fdac24e [build] Bump version to 2.3-SNAPSHOT 3 years ago
yexianxun 31c6659d2a [cdc-base] The first version of Incremental Snapshot Framework abstraction 3 years ago
Junwang Zhao f2bdd47079
[mysql] Suspend SourceReader eagerly to reduce restoration time
This closes #973.
3 years ago
Leonard Xu dfdee07669 [test][e2e] Clean up database resources for every e2e tests. 3 years ago
Junwang Zhao 2d47b15782
[hotfix][mysql] Avoid schema isn't known error when scanNewlyAddedTable enabled (#965) 3 years ago
gongzhongqiang a96e70a996
[mysql][polardbx] Remove debug print code in PolardbxSourceTCase (#968)
This closes #968.
3 years ago
ehui 41a5463437
[mysql] Split snapshot chunks asynchronously (#931) 3 years ago
Leonard Xu b911dd2a1b [tidb] The first draft of tidb cdc connector 3 years ago
hele.kc 410e4fae57
[mysql] Fallback to build schema by 'desc table' case when parsing DDL failure (#949) 3 years ago
Paul Zhang 580391b6ee
[mysql] Allow custom JDBC URL parameters in MySQL CDC source (#921) 3 years ago
Qingsheng Ren 2a704e551c [mysql] Improve mysql heartbeat feature and tests
This closes #927.
3 years ago
camelusluo 3cb6a815dc [mysql] Original implementation of mysql heartbeat feature 3 years ago
Junwang Zhao 2ff83fd86d
[hotfix][mysql] Fix MySqlSourceReader#snapshotState should return unfinishedSplits (#926)
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>
3 years ago
Dian Qi 64e3408b20
[hotfix][mysql] Fix the binlog position didn't update when emit DDL (#925) 3 years ago
Paul Zhang 8002de4a5b
[common] Allow user to pass custom JsonConverter configs in JsonDebeziumDeserializationSchema (#615) 3 years ago
Leonard Xu 16ec365523 [mysql] Improve the test to cover table with varbinary primary key (#879)
This closes #879.
3 years ago
fangpc 18cbde8afb [mysql] Support primary key with varbinary type (#879) 3 years ago
Leonard Xu c77275cb68 [hotfix][minor] Fix the test code typo 3 years ago
Leonard Xu 2ad6714442
[mysql] Fix ArrayIndexOutOfBoundsException in mysql binlog read phase (#911) 3 years ago
gongzhongqiang 1b34887c08
[common] Use ResolvedSchema instead of deprecated TableSchema API (#782) 3 years ago
wangxiaojing b21466a848 [common] Make Flink CDC Compatible with Flink 1.14 3 years ago
元组 e70e0f1b68 [hotfix][mysql] Rename method from dispatchHighWatermark to dispatchBinlogEndEvent (#810)
This closes #810.
3 years ago
Junwang Zhao 7455ad63ab
[mysql] Use READ type for all records in snapshot reading (#842) 3 years ago
Leonard Xu 8a9d821dc7 [mysql] Rewrite the newly added table tests to cover more cases (#777)
This closes #777.
3 years ago