Commit Graph

141 Commits (3ef4f2fa3114748424949063b92dc3b901bddc61)

Author SHA1 Message Date
yexianxun 31c6659d2a [cdc-base] The first version of Incremental Snapshot Framework abstraction 3 years ago
Junwang Zhao f2bdd47079
[mysql] Suspend SourceReader eagerly to reduce restoration time
This closes #973.
3 years ago
Leonard Xu dfdee07669 [test][e2e] Clean up database resources for every e2e tests. 3 years ago
Junwang Zhao 2d47b15782
[hotfix][mysql] Avoid schema isn't known error when scanNewlyAddedTable enabled (#965) 3 years ago
gongzhongqiang a96e70a996
[mysql][polardbx] Remove debug print code in PolardbxSourceTCase (#968)
This closes #968.
3 years ago
ehui 41a5463437
[mysql] Split snapshot chunks asynchronously (#931) 3 years ago
Leonard Xu b911dd2a1b [tidb] The first draft of tidb cdc connector 3 years ago
hele.kc 410e4fae57
[mysql] Fallback to build schema by 'desc table' case when parsing DDL failure (#949) 3 years ago
Paul Zhang 580391b6ee
[mysql] Allow custom JDBC URL parameters in MySQL CDC source (#921) 3 years ago
Qingsheng Ren 2a704e551c [mysql] Improve mysql heartbeat feature and tests
This closes #927.
3 years ago
camelusluo 3cb6a815dc [mysql] Original implementation of mysql heartbeat feature 3 years ago
Junwang Zhao 2ff83fd86d
[hotfix][mysql] Fix MySqlSourceReader#snapshotState should return unfinishedSplits (#926)
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>
3 years ago
Dian Qi 64e3408b20
[hotfix][mysql] Fix the binlog position didn't update when emit DDL (#925) 3 years ago
Paul Zhang 8002de4a5b
[common] Allow user to pass custom JsonConverter configs in JsonDebeziumDeserializationSchema (#615) 3 years ago
Leonard Xu 16ec365523 [mysql] Improve the test to cover table with varbinary primary key (#879)
This closes #879.
3 years ago
fangpc 18cbde8afb [mysql] Support primary key with varbinary type (#879) 3 years ago
Leonard Xu c77275cb68 [hotfix][minor] Fix the test code typo 3 years ago
Leonard Xu 2ad6714442
[mysql] Fix ArrayIndexOutOfBoundsException in mysql binlog read phase (#911) 3 years ago
gongzhongqiang 1b34887c08
[common] Use ResolvedSchema instead of deprecated TableSchema API (#782) 3 years ago
wangxiaojing b21466a848 [common] Make Flink CDC Compatible with Flink 1.14 3 years ago
元组 e70e0f1b68 [hotfix][mysql] Rename method from dispatchHighWatermark to dispatchBinlogEndEvent (#810)
This closes #810.
3 years ago
Junwang Zhao 7455ad63ab
[mysql] Use READ type for all records in snapshot reading (#842) 3 years ago
Leonard Xu 8a9d821dc7 [mysql] Rewrite the newly added table tests to cover more cases (#777)
This closes #777.
3 years ago
Leonard Xu c94791fd14 [mysql] Improve newly added tables process 3 years ago
元组 c21aa91e5d [mysql] Support capture newly added tables for existed pipeline 3 years ago
luoyuxia 5511904b62
[mysql] add test to cover the datatype GeomCollection that's synonymous with GeometryCollection for mysql8 (#822) 3 years ago
gongzhongqiang 5c7e2602be
[sqlserver] Add SqlServer cdc connector (#662)
Co-authored-by: Leonard Xu <leonard@apache.org>
3 years ago
hiscat fab9dcaf90
[hotfix] Fix MySqlSource comment typo (#793) 3 years ago
taox c584ecf04c
[mysql] Support MySQL 5.6 (#396)
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 years ago
Leonard Xu 8368bfb4de
[build] Switch to Log4j 2 by default (#791) 3 years ago
Leonard Xu 3b20f9319d
[hotfix][mysql] Fix message timestamp of snapshot record to 0L (#752) 3 years ago
Jiabao Sun 5c924eea6d
[hotfix][mysql] Set minimum connection pool size to 1 (#692) 3 years ago
Jark Wu c97968e637
[build] Remove override definition of maven-surefire-plugin in connectors pom (#673) 3 years ago
Xianxun Ye 7712f9825f
[hotfix] Fix the parameter typo in java doc (#651) 3 years ago
Tuple 56112e9b7c
[mysql] Add a method to get MySqlSourceConfigFactory from MySqlSource (#648) 3 years ago
Leonard Xu 456e2a435c
[mysql] Set default driver class name for PooledDataSource (#659) 3 years ago
Tuple cf50566f34
[mysql] Fix there is duplicate records outputted when keep updating table during snapshot read (#592)
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>
3 years ago
Leonard Xu 6174c7e690 [build] Bump version to 2.2-SNAPSHOT 3 years ago
gongzhongqiang dc5a0c20df
[mysql] Reading a null column with default value defined should return null instead of default value (#555) 3 years ago
Leonard Xu 7ae20a1277
[mysql] Optimize the dynamic chunk size calculation for table with dense distribution (#599) 3 years ago
Leonard Xu 997651427f
[hotfix][mysql] Fix number overflow in ObjectUtils.minus (#598) 3 years ago
Leonard Xu 39944c9ecd [docs] Add metadata column example for mysql-cdc and mongodb-cdc connector 3 years ago
Leonard Xu 75276235dc
[mysql] Skip ddl events in snapshot split normalization (#577) 3 years ago
Leonard Xu 4b15614c45 [mysql] Support dynamic chunk size for evenly distribution table 3 years ago
Leonard Xu e0095458a1 [mysql][minor] Use 'table.include.list' key instead of legacy key 'table.whitelist' in SnapshotSplitReader 3 years ago
Leonard Xu aa3e282cfd
[mysql] Set server time zone information for connection pool factory (#566) 3 years ago
tuple e7ed77f74b
[mysql] Polish binlog offset compare semantic (#543) 3 years ago
gongzhongqiang 0bd39e5310
[postgres] Support metadata columns for postgres-cdc connector (#500)
Co-authored-by: Leonard Xu <xbjtdcq@163.com>
3 years ago
Leonard Xu 51f5a90eb3 [mysql] Reduce the connection usage in table discovery process 3 years ago
Leonard Xu 930efd9ce4 [mysql] Introduce Jdbc connection pools 3 years ago