Commit Graph

73 Commits (27812cfd17c78d79147522da503afce225eda709)

Author SHA1 Message Date
Leonard Xu f9b1d8d727
[hotfix][docs] Fix MySql upper case typo in documentation (#502) 3 years ago
Leonard Xu b0101370c6 [tests] Fix the imports in MySqlSourceITCase 3 years ago
Leonard Xu f64805a083 [mysql] Support wide table with huge number of columns 3 years ago
Leonard Xu e5eca5066d [tests] Correct the argument order of assertArrayEqualInOrder/assertArrayEqualAnyOrder 3 years ago
Leonard Xu 669b0916f7 [tests] Introduce assertEqualsInOrder/assertEqualsInAnyOrder methods for test
this closes #437
3 years ago
Leonard Xu 49caad1c6e [tests] Improve the unstable test testStartupFromLatestOffset in MySqlConnectorITCase 3 years ago
Leonard Xu 9cf5fac725 [mysql] Fix the restoration failure when checkpoint happened in one MySQL transaction 3 years ago
Leonard Xu 4b21ac6a98 [mysql] Optimization that skips the binlog read if the low watermark equals high watermark 3 years ago
luoyuxia ccb73e013b [mysql] Add source metrics for MySqlParallelSource
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 years ago
Leonard Xu 27001d8421 [mysql] Use min/max of split key and row count to describe the distribution of table
this closes  #392
3 years ago
Leonard Xu 851dcc66b4 [mysql] Fix the ClassCastException in RecordUtils
this closes #330
3 years ago
Leonard Xu 42d20b6538 [mysql] Improve the tests code 4 years ago
Leonard Xu 42dd29cd63 [mysql] Fix the MySqlSnapshotSplitAssigner may assign duplicate splits 4 years ago
Leonard Xu a34b617964 [mysql] Add tests to check mysql-cdc works well under various timezones 4 years ago
Leonard Xu e80fe54441 [mysql] Optimize the checkpoint be optional under single parallelism (#365)
Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>
4 years ago
taox 32a7e34e87
[mysql] Correct the initial binlog offset for MySqlHybridSplitAssigner 4 years ago
Jiabao Sun 1675d6345c
[mysql] Add default value for 'database.history.instance.name' in MySqlParallelSource 4 years ago
ili zh 73d110e4c6
[mysql] Improve the code format in SignalEventDispatcher 4 years ago
gongzhongqiang e32fb1e7fc
[docs] Update the debezium document link to version 1.5 4 years ago
manmao 28bc91f7d1
[postgres] Fix Validator didn't implement Serializable
Co-authored-by: mao.man@rootcloud.com <mao.man@rootcloud.com>
4 years ago
Leonard Xu 7b5f6aab9c [mysql] Forbid using problematic startup options earliest-offset/specific-offset/timestamp 4 years ago
Shengkai 2f644007e2
[mysql] Validate MySQL server configuration (version, binlog_format, binlog_row_image) before start job
This closes #211
4 years ago
Leonard Xu 8162dc7ae3
[build] Rename group.id and packge name from 'com.alibaba.ververica' to 'com.ververica' (#287) 4 years ago
Leonard Xu 848a6bfefc
[debezium] Avoid uncompleted state of schema history when engine stop before checkpoint
* This close (#282)
4 years ago
Jark Wu 5180bc984f
[mysql] Refactor split assigner and simplify chunk splitting (#283) 4 years ago
Leonard Xu 2edf6d3778 [mysql] Enable single server id for MySqlParallelSource 4 years ago
Leonard Xu e894b0a69e
[mysql] Keep the global order of between snapshot records and binlog records 4 years ago
Leonard Xu 8638720d71 [mysql] Support latest-offset mode for MySqlParallelSource 4 years ago
Leonard Xu 75c01c530e [mysql] Simplify the options for Mysql Source 4 years ago
Jark Wu ff6b638262
[mysql] Improve split state and enumerator state structure 4 years ago
Jark Wu 7d369548b0
[mysql] Move MySqlSplitReader from 'split' to 'reader' package 4 years ago
Jark Wu a42f6ae61c
[mysql] Simplify EmbeddedFlinkDatabaseHistory to not record schema changes 4 years ago
Leonard Xu ae54f0b11a
[mysql] Throw underlying debezium reader exception 4 years ago
Leonard Xu 35c636224d
[mysql] Make every subtask used different database history 4 years ago
Leonard Xu a0e5e7a65b
[mysql] Optimize the data structure of split and splitState
This closes #268
4 years ago
Leonard Xu 5542233278 [mysql] Add JM/TM failover tests to check checkpoint works fine 4 years ago
Jark Wu ce2ee32521 [mysql][test] Rename "custom.sql" to "customer.sql" 4 years ago
Jark Wu e9e78f10d6 [mysql] Refactor class names to use "MySql" prefix instead of "MySQL" 4 years ago
Jark Wu 6827aad0a4 [mysql] Use LOG instead of LOGGER as Logger variable name 4 years ago
Jark Wu 6e5e14dc34 [mysql] Rename BinlogPosition to BinlogOffset 4 years ago
Leonard Xu 5786506394
[mysql] Support binlog reader merge optimization
This close #256
4 years ago
Leonard Xu 6231e990c0
[mysql] Support numeric type optimization for split boundary calculation
This close  (#248)
4 years ago
Leonard Xu c6ca6c1874 [mysql] Support new Source in SQL 4 years ago
Leonard Xu dd3826be11 [mysql] Use SchemaRecord for MySQL cdc source 4 years ago
Leonard Xu 1a81915cd1 [mysql] Support table with combined primary key 4 years ago
Leonard Xu 088dc5c049 [mysql] Add more tests for assigner and new Source 4 years ago
Leonard Xu a781a88817 [mysql] First draft for MySQL-CDC 2.0 4 years ago
Jiabao Sun ff9bf31b19
[common] Fix ClassCastException in type conversion
[common] Fix ClassCastException in type conversion, this close(#226)
4 years ago
Shengkai fcea3d14f7
[common] Fix schema history run out of memory
Fix schema history run out of memory, this close (#207)

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
4 years ago
Leonard Xu 5195647576
[debezium] Bump debezium version to 1.5.2.Final (#205)
* [debezium] Upgrade the Debezium to 1.5.2.Final
Co-authored-by: Shengkai <1059623455@qq.com>
4 years ago