Commit Graph

191 Commits (dd19da6ff1721942e6da37c4e3464e9c09be1455)

Author SHA1 Message Date
ehui 6d0cdbcc6e
[mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart  (#1627)
* [mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart
2 years ago
Leonard Xu a7f1970e1f [build] Bump version to 2.4-SNAPSHOT 2 years ago
Leonard Xu e4dcd10ec8 [oracle][mysql] Improve the Oracle all data types test and clean up debug logs 2 years ago
Qingsheng Ren c07451884d [hotfix][mysql] Remove unused constructor in MySqlTableSource 2 years ago
Qingsheng Ren aca5643704 [mysql] Support starting reading binlog from earliest offset / specific offset / timestamp (#1661)
This closes #254
2 years ago
Tigran Manasyan 5b3dd9884e
[common] Bump Flink version to 1.15.2 (#1504)
This closes #1363. 

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Hang Ruan a4b969d4a3
[mysql] ChunkSplitter supports to snapshot when splitting chunks for a table (#1463)
This closes #1463.

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 years ago
lidoudou1993 8b2094c5f8
[mysql] Use the latest received meta of binlog split when request the next meta (#1479)
Co-authored-by: lidoudou3 <lidoudou1@jd.com>
2 years ago
sunny 40cd758656
[minor] Use Collections.singletonList instead of Arrays.asList if possible (#1569) 2 years ago
Leonard Xu d3435381a6 [mysql] Avoid duplicate split requests when add new table.(#1156)
This closes #1149.
2 years ago
yurunchuan ad80e47c42 [mysql] Avoid duplicate split requests when add new table (#1156) 2 years ago
Leonard Xu e1ec9906ce [hotfix][typo] Fix typo from schemaLess to schemaless 2 years ago
Hang Ruan f41faad8dc
[mysql] Fix parse error when ALTER SQL statement contains default string value and collate. (#1544)
This closes #1506
2 years ago
Hang Ruan 14213087c1
[mysql] fix parsing ddl error when use string default values for numeric types (#1522)
This closes #1522.
2 years ago
Leonard Xu a264188c67
[mysql] Enumerate captured tables lazily (#1507)
This closes #1507.
2 years ago
Leonard Xu 71c16d5d52
[mysql] Reduce the memory usage of JM by sharing table schemas between splits (#1523)
This closes #865.
2 years ago
empcl cf8a2f4b07
[hotfix][docs] Fix comment typo in MysqlSnapshotSplit (#1513)
Co-authored-by: chenlei677 <chenlei677@jd.com>
2 years ago
Leonard Xu 72c806cb9d
[mysql] Let all records of one snapshot split don't cross checkpoints (#1505)
This closes #1505.
2 years ago
Sergey Nuyanzin 9f97e06f32
[tests] Remove usage of deprecated EnvironmentSettings.Builder#useBlinkPlanner (#1493)
This closes #1493.
2 years ago
Leonard Xu 238305b2d9
[cdc-base][mysql] Fix split key comparison when may contain different types (#1499)
This closes #1496.
2 years ago
Kyle Dong b3ebf3da69
[mysql] Use local timezone as the default value of 'server-time-zone' option (#1407)
This closes  #1406.
3 years ago
Leonard Xu cfbd00fa34 [mysql][polardbx] Stop container timely in tests (#1468) 3 years ago
Hang Ruan 7c9b30276d [mysql][ploardbx] Support all charsets in column level (#1166)
This closes #1166.
3 years ago
lidoudou1993 6a2f470ae3
[mysql][minor] Skip capture newly added tables according snapshotassigner's status (#1449)
Co-authored-by: lidoudou3 <lidoudou1@jd.com>
3 years ago
Leonard Xu 638474d6c7 [polardbx][test] Bump the polardb-x image version from 2.0.1 to 2.10 (#1423) 3 years ago
Hang Ruan 6a56985fa8
[hotfix][test] Fix MySqlSourceITCase failure due to StreamExecutionEnvironment#getConfiguration returned unmodifiable object (#1446) 3 years ago
Hang Ruan 2bb5b6f625
[test] Fix tests missed 'update_before' records if the primary keys of source and sink are different (#1451) 3 years ago
Hang Ruan 9e6549c67e
[polardbx][test] Rename PolardbxSourceTCase to PolardbxSourceITCase (#1447) 3 years ago
Hang Ruan a5dd0c0a14
[mysql] Enable pass custom jdbc properties for debezium mysql connection (#1217)
This closes #674
3 years ago
Matrix42 c96926b6ec
[mysql] Release the debezium reader thread resources after reading finished (#1358)
This closes #1350.
3 years ago
Leonard Xu 70ebfefa9c [hotfix][mysql] Fix compile error due to merge conflict 3 years ago
Hang Ruan 96c84d9c65
[mysql] Generates multiple chunks when approximate row count is bigger than chunk size (#1193)
This closes #1191.
3 years ago
Hang Ruan 0d1ce7a702
[mysql] Introduce 'scan.incremental.snapshot.chunk.key-column' option to support splitting table by custom column (#1415)
This closes #1108.
3 years ago
lzshlzsh 74f0a65355
[mysql] Optimize pure binlog phase check logic to improve performance (#1392)
Co-authored-by: sammieliu <sammieliu@tencent.com>
3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390)
This closes #1389.
3 years ago
gongzhongqiang e7238f2407
[mysql] Fix dead loop when splitting chunks. (#1107) 3 years ago
Sergey Nuyanzin 2f3c872306
[build] Bump Flink version to 1.14.4 (#1284)
This closes #1284
3 years ago
ehui 1fdf28fe49
[mysql] Adopt streaming merge during snapshotSplit scan to avoid OOM (#1219)
This closes #1219
3 years ago
jiabao.sun ccaaf4695d [mysql] Connection pool id should contains username (#1328) 3 years ago
jiabao.sun 146135ebfb [dbz] Patch for DBZ-5126 to fix memory leak problem. (#939) 3 years ago
gongzhongqiang 55e4ae57e5
[hotfix][docs] Fix typo in java docs. (#1305)
This closes #1305.
3 years ago
ruanhang1993 85a6515245
[mysql] Support optional numeric unsigned zerofill types (#1197)
Co-authored-by: bangjiang.xbj <bangjiang.xbj@alibaba-inc.com>
3 years ago
Qingsheng Ren 9c905f6dd1
[mysql] Add heartbeatInterval field to equals() and hashCode() (#1116) 3 years ago
Qingsheng Ren 47e005ab47
[mysql] Catch and hold exception in chunk splitter thread and rethrow in getNext() (#1109) 3 years ago
camelus c0aca57a8f
[mysql] Use the gtid set firstly when compare the binlog offset (#761)
Co-authored-by: camelusluo <camelusluo@tencent.com>
3 years ago
Leonard Xu 7eb9247122
[mysql] Throw RuntimeException timely in snapshot scan phase (#1098) 3 years ago
Qingsheng Ren f9a8c403c8
[common] Apply filter on ResolvedSchema to keep physical columns only (#1092) 3 years ago
Leonard Xu 59b310a24c [common] Bump debezium version to 1.6.4.Final 3 years ago
Junwang Zhao eb230bf30c
[mysql] Serialize isSuspended flag for MySqlBinlogSplit (#996) 3 years ago
Leonard Xu 1d7fdac24e [build] Bump version to 2.3-SNAPSHOT 3 years ago