Commit Graph

103 Commits (dc5a0c20df87072d5a0b50ab9b2d1e4e028a84d7)

Author SHA1 Message Date
gongzhongqiang dc5a0c20df
[mysql] Reading a null column with default value defined should return null instead of default value (#555) 3 years ago
Leonard Xu 7ae20a1277
[mysql] Optimize the dynamic chunk size calculation for table with dense distribution (#599) 3 years ago
Leonard Xu 997651427f
[hotfix][mysql] Fix number overflow in ObjectUtils.minus (#598) 3 years ago
Leonard Xu 39944c9ecd [docs] Add metadata column example for mysql-cdc and mongodb-cdc connector 3 years ago
Leonard Xu 75276235dc
[mysql] Skip ddl events in snapshot split normalization (#577) 3 years ago
Leonard Xu 4b15614c45 [mysql] Support dynamic chunk size for evenly distribution table 3 years ago
Leonard Xu e0095458a1 [mysql][minor] Use 'table.include.list' key instead of legacy key 'table.whitelist' in SnapshotSplitReader 3 years ago
Leonard Xu aa3e282cfd
[mysql] Set server time zone information for connection pool factory (#566) 3 years ago
tuple e7ed77f74b
[mysql] Polish binlog offset compare semantic (#543) 3 years ago
gongzhongqiang 0bd39e5310
[postgres] Support metadata columns for postgres-cdc connector (#500)
Co-authored-by: Leonard Xu <xbjtdcq@163.com>
3 years ago
Leonard Xu 51f5a90eb3 [mysql] Reduce the connection usage in table discovery process 3 years ago
Leonard Xu 930efd9ce4 [mysql] Introduce Jdbc connection pools 3 years ago
luoyuxia eeae69cdf9
[mysql] support all mysql data types (#438)
This closes #438
3 years ago
Leonard Xu 63a071cb82 [mysql] Support binlog split with huge snapshot split meta 3 years ago
Leonard Xu 2bc715e76a [mysql] Support tables with different split key 3 years ago
luoyuxia 5cf940d160
[mysql] Validate the regex pattern of database-name and table-name in table factory (#526) 3 years ago
mincwang 98ab02fed2
[docs] Use new MySqlSource API in documentation
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 years ago
Leonard Xu 0f1b493d6a
[hotfix][mysql] Correct the usage of includeSchemaChanges parameter (#501) 3 years ago
Leonard Xu 5ce7adb619
[mysql] Expose MySqlSource API that supports incremental snapshot (#495)
Co-authored-by: Jark Wu <jark@apache.org>
3 years ago
Jark Wu 12f27acda2
[mysql] Support metadata columns for mysql-cdc connector (#496) 3 years ago
luoyuxia 64fc3e34b5
[common] Support to read tables of inconsistent schema (#494) 3 years ago
Leonard Xu 004d1768ac
[mysql] Support wide table with huge number of columns 3 years ago
Leonard Xu f0dede1934
[tests] Correct the argument order of assertArrayEqualInOrder/assertArrayEqualAnyOrder 3 years ago
Leonard Xu ee3d7f4584
[tests] Introduce assertEqualsInOrder/assertEqualsInAnyOrder methods for test
this closes #437
3 years ago
Leonard Xu d89373b294 [tests] Improve the unstable test testStartupFromLatestOffset in MySqlConnectorITCase 3 years ago
Leonard Xu a785efab5a [mysql] Fix the restoration failure when checkpoint happened in one MySQL transaction 3 years ago
Leonard Xu 22f2ac8a75 [mysql] Optimization that skips the binlog read if the low watermark equals high watermark 3 years ago
luoyuxia cfe3d3e400
[mysql] Add source metrics for MySqlParallelSource
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 years ago
Leonard Xu d4d4eb32e2
[mysql] Use min/max of split key and row count to describe the distribution of table
this closes  #392
3 years ago
Leonard Xu 70a0e80d86
[mysql] Fix the ClassCastException in RecordUtils
this closes #330
3 years ago
mincwang 7f12859304
[common] Support json deserialization schema 4 years ago
Leonard Xu c52576f6d4 [mysql] Improve the tests code 4 years ago
Leonard Xu 15985d9269 [mysql] Fix the MySqlSnapshotSplitAssigner may assign duplicate splits 4 years ago
Leonard Xu a6eccf5789
[mysql] Add tests to check mysql-cdc works well under various timezones (#367)
Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>
4 years ago
Leonard Xu a26096910e
[mysql] Optimize the checkpoint be optional under single parallelism (#365)
Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>
4 years ago
taox e34ff84a43
[mysql] Correct the initial binlog offset for MySqlHybridSplitAssigner
Co-authored-by: Leonard Xu <xbjtdcq@gmailcom>
4 years ago
Jiabao Sun d76b17495e
[mysql] Add default value for 'database.history.instance.name' in MySqlParallelSource
This closes #326
4 years ago
ili zh 28faecdf04
[mysql] Improve the code format in SignalEventDispatcher 4 years ago
gongzhongqiang 08e9c756e1
[docs] Update the debezium document link to version 1.5 4 years ago
manmao 23bdc7a95b
[postgres] Fix Validator didn't implement Serializable
Co-authored-by: mao.man@rootcloud.com <mao.man@rootcloud.com>
4 years ago
Leonard Xu 9ee80c5239 [build] Bump version to 2.1-SNAPSHOT 4 years ago
Leonard Xu 7b5f6aab9c [mysql] Forbid using problematic startup options earliest-offset/specific-offset/timestamp 4 years ago
Shengkai 2f644007e2
[mysql] Validate MySQL server configuration (version, binlog_format, binlog_row_image) before start job
This closes #211
4 years ago
Leonard Xu 8162dc7ae3
[build] Rename group.id and packge name from 'com.alibaba.ververica' to 'com.ververica' (#287) 4 years ago
Leonard Xu 848a6bfefc
[debezium] Avoid uncompleted state of schema history when engine stop before checkpoint
* This close (#282)
4 years ago
Jark Wu 5180bc984f
[mysql] Refactor split assigner and simplify chunk splitting (#283) 4 years ago
Leonard Xu 2edf6d3778 [mysql] Enable single server id for MySqlParallelSource 4 years ago
Leonard Xu e894b0a69e
[mysql] Keep the global order of between snapshot records and binlog records 4 years ago
Leonard Xu 8638720d71 [mysql] Support latest-offset mode for MySqlParallelSource 4 years ago
Leonard Xu 75c01c530e [mysql] Simplify the options for Mysql Source 4 years ago