Commit Graph

82 Commits (c06300ce720d82b319f69a7e74b7f977408d2340)

Author SHA1 Message Date
Leonard Xu 004d1768ac
[mysql] Support wide table with huge number of columns 3 years ago
Leonard Xu f0dede1934
[tests] Correct the argument order of assertArrayEqualInOrder/assertArrayEqualAnyOrder 3 years ago
Leonard Xu ee3d7f4584
[tests] Introduce assertEqualsInOrder/assertEqualsInAnyOrder methods for test
this closes #437
3 years ago
Leonard Xu d89373b294 [tests] Improve the unstable test testStartupFromLatestOffset in MySqlConnectorITCase 3 years ago
Leonard Xu a785efab5a [mysql] Fix the restoration failure when checkpoint happened in one MySQL transaction 3 years ago
Leonard Xu 22f2ac8a75 [mysql] Optimization that skips the binlog read if the low watermark equals high watermark 3 years ago
luoyuxia cfe3d3e400
[mysql] Add source metrics for MySqlParallelSource
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 years ago
Leonard Xu d4d4eb32e2
[mysql] Use min/max of split key and row count to describe the distribution of table
this closes  #392
3 years ago
Leonard Xu 70a0e80d86
[mysql] Fix the ClassCastException in RecordUtils
this closes #330
3 years ago
mincwang 7f12859304
[common] Support json deserialization schema 3 years ago
Leonard Xu c52576f6d4 [mysql] Improve the tests code 3 years ago
Leonard Xu 15985d9269 [mysql] Fix the MySqlSnapshotSplitAssigner may assign duplicate splits 3 years ago
Leonard Xu a6eccf5789
[mysql] Add tests to check mysql-cdc works well under various timezones (#367)
Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>
4 years ago
Leonard Xu a26096910e
[mysql] Optimize the checkpoint be optional under single parallelism (#365)
Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>
4 years ago
taox e34ff84a43
[mysql] Correct the initial binlog offset for MySqlHybridSplitAssigner
Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>
4 years ago
Jiabao Sun d76b17495e
[mysql] Add default value for 'database.history.instance.name' in MySqlParallelSource
This closes #326
4 years ago
ili zh 28faecdf04
[mysql] Improve the code format in SignalEventDispatcher 4 years ago
gongzhongqiang 08e9c756e1
[docs] Update the debezium document link to version 1.5 4 years ago
manmao 23bdc7a95b
[postgres] Fix Validator didn't implement Serializable
Co-authored-by: mao.man@rootcloud.com <mao.man@rootcloud.com>
4 years ago
Leonard Xu 9ee80c5239 [build] Bump version to 2.1-SNAPSHOT 4 years ago
Leonard Xu 7b5f6aab9c [mysql] Forbid using problematic startup options earliest-offset/specific-offset/timestamp 4 years ago
Shengkai 2f644007e2
[mysql] Validate MySQL server configuration (version, binlog_format, binlog_row_image) before start job
This closes #211
4 years ago
Leonard Xu 8162dc7ae3
[build] Rename group.id and packge name from 'com.alibaba.ververica' to 'com.ververica' (#287) 4 years ago
Leonard Xu 848a6bfefc
[debezium] Avoid uncompleted state of schema history when engine stop before checkpoint
* This close (#282)
4 years ago
Jark Wu 5180bc984f
[mysql] Refactor split assigner and simplify chunk splitting (#283) 4 years ago
Leonard Xu 2edf6d3778 [mysql] Enable single server id for MySqlParallelSource 4 years ago
Leonard Xu e894b0a69e
[mysql] Keep the global order of between snapshot records and binlog records 4 years ago
Leonard Xu 8638720d71 [mysql] Support latest-offset mode for MySqlParallelSource 4 years ago
Leonard Xu 75c01c530e [mysql] Simplify the options for Mysql Source 4 years ago
Jark Wu ff6b638262
[mysql] Improve split state and enumerator state structure 4 years ago
Jark Wu 7d369548b0
[mysql] Move MySqlSplitReader from 'split' to 'reader' package 4 years ago
Jark Wu a42f6ae61c
[mysql] Simplify EmbeddedFlinkDatabaseHistory to not record schema changes 4 years ago
Leonard Xu ae54f0b11a
[mysql] Throw underlying debezium reader exception 4 years ago
Leonard Xu 35c636224d
[mysql] Make every subtask used different database history 4 years ago
Leonard Xu a0e5e7a65b
[mysql] Optimize the data structure of split and splitState
This closes #268
4 years ago
Leonard Xu 5542233278 [mysql] Add JM/TM failover tests to check checkpoint works fine 4 years ago
Jark Wu c4a7d6ad56 [build] Bump version to 2.0-SNAPSHOT 4 years ago
Jark Wu ce2ee32521 [mysql][test] Rename "custom.sql" to "customer.sql" 4 years ago
Jark Wu e9e78f10d6 [mysql] Refactor class names to use "MySql" prefix instead of "MySQL" 4 years ago
Jark Wu 6827aad0a4 [mysql] Use LOG instead of LOGGER as Logger variable name 4 years ago
Jark Wu 6e5e14dc34 [mysql] Rename BinlogPosition to BinlogOffset 4 years ago
Leonard Xu 5786506394
[mysql] Support binlog reader merge optimization
This close #256
4 years ago
Leonard Xu 6231e990c0
[mysql] Support numeric type optimization for split boundary calculation
This close  (#248)
4 years ago
Leonard Xu c6ca6c1874 [mysql] Support new Source in SQL 4 years ago
Leonard Xu dd3826be11 [mysql] Use SchemaRecord for MySQL cdc source 4 years ago
Leonard Xu 1a81915cd1 [mysql] Support table with combined primary key 4 years ago
Leonard Xu 088dc5c049 [mysql] Add more tests for assigner and new Source 4 years ago
Leonard Xu a781a88817 [mysql] First draft for MySQL-CDC 2.0 4 years ago
Jiabao Sun ff9bf31b19
[common] Fix ClassCastException in type conversion
[common] Fix ClassCastException in type conversion, this close(#226)
4 years ago
Shengkai fcea3d14f7
[common] Fix schema history run out of memory
Fix schema history run out of memory, this close (#207)

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
4 years ago