Commit Graph

31 Commits (8685fd4027bdfac60396f0a7028446fde41cba42)

Author SHA1 Message Date
Qingsheng Ren ffdfd549b9 [cdc-base] Extract a higher level IncrementalSource independent of JDBC dialects 2 years ago
Jiabao Sun fbf5eba03c
[hotfix][cdc-base] Fix OffsetFactory is not initialized when restored from checkpoint (#1657) 2 years ago
Tigran Manasyan 5b3dd9884e
[common] Bump Flink version to 1.15.2 (#1504)
This closes #1363. 

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Jiabao Sun 8976f25925
[cdc-base] Abstract naming for variables of incremental framework (#1646) 2 years ago
Jiabao Sun 21521506c0
[cdc-base] Fix StreamSplit's endingOffset of StreamSplitAssigner (#1659) 2 years ago
Jiabao Sun ddd0680009
[cdc-base] JdbcSourceConfig can be template type of DataSourceDialect (#1639) 2 years ago
sunny 40cd758656
[minor] Use Collections.singletonList instead of Arrays.asList if possible (#1569) 2 years ago
Leonard Xu e1ec9906ce [hotfix][typo] Fix typo from schemaLess to schemaless 2 years ago
Hang Ruan 347911c7a0 [cdc-base] Reduce the memory usage of JM by sharing table schemas between splits 2 years ago
Hang Ruan f44d2092c7
[cdc-base] Release the scan fetcher thread resource after reading finished (#1619) 2 years ago
Hang Ruan 806a8505d3
[cdc-base] Optimize pure binlog phase check logic to improve performance (#1620)
This closes #1620.
2 years ago
Hang Ruan 8df5b110ab
[cdc-base] Let all records of one snapshot split don't cross checkpoints (#1622)
This closes #1622.
2 years ago
Hang Ruan 48b8c366fa
[cdc-base] Adopt streaming merge during snapshotSplit scan to avoid OOM
This closes #1618.
2 years ago
Leonard Xu 238305b2d9
[cdc-base][mysql] Fix split key comparison when may contain different types (#1499)
This closes #1496.
2 years ago
ehui 043841624d
[cdc-base] Flink CDC base registers the identical history engine on multiple tasks (#1340)
This closes #1130
3 years ago
Hang Ruan 96c84d9c65
[mysql] Generates multiple chunks when approximate row count is bigger than chunk size (#1193)
This closes #1191.
3 years ago
ehui 0a097a9e53
[cdc-base] Fix NPE during snpashot scan phase (#1339)
This closes #1122.
3 years ago
Hang Ruan 0d1ce7a702
[mysql] Introduce 'scan.incremental.snapshot.chunk.key-column' option to support splitting table by custom column (#1415)
This closes #1108.
3 years ago
zhmin 2c3962bd03
fix typo of SourceReaderMetrics's name (#1425)
Co-authored-by: zhmin <minzhe@loongteam.com>
3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390)
This closes #1389.
3 years ago
gongzhongqiang e7238f2407
[mysql] Fix dead loop when splitting chunks. (#1107) 3 years ago
Sergey Nuyanzin 2f3c872306
[build] Bump Flink version to 1.14.4 (#1284)
This closes #1284
3 years ago
Hang Ruan c4429a962c
[docs][cdc-base] Optimize annotations (#1320)
This closes #1320.
3 years ago
jiabao.sun ccaaf4695d [mysql] Connection pool id should contains username (#1328) 3 years ago
gongzhongqiang 55e4ae57e5
[hotfix][docs] Fix typo in java docs. (#1305)
This closes #1305.
3 years ago
lincoln lee 3f07aff6c1
[hotfix][cdc-base] Fix typo 'currenFetcher' -> 'currentFetcher' (#1299)
This closes #1299.
3 years ago
gongzhongqiang 4cf36ad22f [oracle][test] Use prebuilt docker image in tests 3 years ago
gongzhongqiang 1b27ee6b29
[cdc-base] Improve Incremental snapshot framework code style. (#1054) 3 years ago
Leonard Xu 1d7fdac24e [build] Bump version to 2.3-SNAPSHOT 3 years ago
Leonard Xu 2b71309582 [cdc-base] Add MySQL Incremental Source to validate the Incremental Snapshot Framework 3 years ago
Leonard Xu 3ef4f2fa31 [cdc-base] Improve the Incremental Snapshot Interfaces 3 years ago