Commit Graph

53 Commits (bf76afb9bfb1b28ab4e428cb1c10877e395281e1)

Author SHA1 Message Date
Hongshun Wang e8198a6fcb [postgres] Not drop replication slot for stream split (#2436)
(cherry picked from commit 928ccf10f1)
1 year ago
Jiabao Sun 5409ee4722 [cdc-base] Fix TM hangs caused by uncaught exception (#2511)
(cherry picked from commit 7172695471)
1 year ago
gongzhongqiang 4ed7206c81 [cdc-base] Fix parsing error when serializing and deserializing the table name with dot (#2443)
(cherry picked from commit 7801ac9588)
1 year ago
gongzhongqiang 53ff798ef6
[docs][hotfix] Update debezium reference links to 1.9 version
This closes #2225.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Co-authored-by: Leonard Xu <leonard@apache.org>
2 years ago
Leonard Xu 92e9d9ea58
[build] Update the copyright year to 2023 (#2205) 2 years ago
Tigran Manasyan 2b017346c3
[debezium] Bump debezium version to 1.9.7.Final (#2156)
Co-authored-by: gongzhongqiang <764629910@qq.com>
2 years ago
ehui 66556ee501
[hotfix][sqlserver] Merge high and low watermark data during snapshot reading process (#2179)
* [sqlserver] Merge high and low watermark data during snapshot reading process
2 years ago
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
2 years ago
molsionmo 734982e075
[oracle] Fix the incremental phase not skip the data that has been read in the snapshot full phase (#2215)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Jiabao Sun aff5b0566d
[mongodb] Support specific timestamp startup mode. (#2207) 2 years ago
Jiabao Sun afefe40944
[cdc-base] Close idle readers when snapshot finished (#2202)
* [cdc-base] Close idle readers when snapshot finished
2 years ago
Tyrantlucifer 7504217968
[core] support print configuration options for connectors (#2099) 2 years ago
gongzhongqiang 8cef4af544
[sqlserver] Sqlserver incremental source. (#1732)
* [sqlserver] Sqlserver incremental source

---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Leonard Xu e85ea62e96 [hotfix][base] Fix typo in java docs 2 years ago
Leonard Xu b2db96b1c1 [hotfix][base][tidb][mysql] Fix wrong condition for execution timeout 2 years ago
Leonard Xu a7f1970e1f [build] Bump version to 2.4-SNAPSHOT 2 years ago
molsion b4ce19951f [oracle]support use user given column as split column 2 years ago
Leonard Xu df4b87f79e [oracle][minor] Clean up useless methods and classes 2 years ago
Leonard Xu 8dd8fe6ac3 [hotfix][oracle][db2] Update the license header 2 years ago
Leonard Xu 1d5961dfec [cdc-base][oralce] Remove useless method of JdbcSourceFetchTaskContext 2 years ago
molsion f6c34cd616 [cdc-base][oracle] Improve the base methods base on Oracle specific requirements 2 years ago
莫贤彬 dd7b7beaaa [oracle] Use Incremental Snapshot Framework for Oracle CDC Connector (#1079)
This closes #1292.
2 years ago
Qingsheng Ren ffdfd549b9 [cdc-base] Extract a higher level IncrementalSource independent of JDBC dialects 2 years ago
Jiabao Sun fbf5eba03c
[hotfix][cdc-base] Fix OffsetFactory is not initialized when restored from checkpoint (#1657) 2 years ago
Tigran Manasyan 5b3dd9884e
[common] Bump Flink version to 1.15.2 (#1504)
This closes #1363. 

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Jiabao Sun 8976f25925
[cdc-base] Abstract naming for variables of incremental framework (#1646) 2 years ago
Jiabao Sun 21521506c0
[cdc-base] Fix StreamSplit's endingOffset of StreamSplitAssigner (#1659) 2 years ago
Jiabao Sun ddd0680009
[cdc-base] JdbcSourceConfig can be template type of DataSourceDialect (#1639) 2 years ago
sunny 40cd758656
[minor] Use Collections.singletonList instead of Arrays.asList if possible (#1569) 2 years ago
Leonard Xu e1ec9906ce [hotfix][typo] Fix typo from schemaLess to schemaless 2 years ago
Hang Ruan 347911c7a0 [cdc-base] Reduce the memory usage of JM by sharing table schemas between splits 2 years ago
Hang Ruan f44d2092c7
[cdc-base] Release the scan fetcher thread resource after reading finished (#1619) 2 years ago
Hang Ruan 806a8505d3
[cdc-base] Optimize pure binlog phase check logic to improve performance (#1620)
This closes #1620.
2 years ago
Hang Ruan 8df5b110ab
[cdc-base] Let all records of one snapshot split don't cross checkpoints (#1622)
This closes #1622.
2 years ago
Hang Ruan 48b8c366fa
[cdc-base] Adopt streaming merge during snapshotSplit scan to avoid OOM
This closes #1618.
2 years ago
Leonard Xu 238305b2d9
[cdc-base][mysql] Fix split key comparison when may contain different types (#1499)
This closes #1496.
2 years ago
ehui 043841624d
[cdc-base] Flink CDC base registers the identical history engine on multiple tasks (#1340)
This closes #1130
3 years ago
Hang Ruan 96c84d9c65
[mysql] Generates multiple chunks when approximate row count is bigger than chunk size (#1193)
This closes #1191.
3 years ago
ehui 0a097a9e53
[cdc-base] Fix NPE during snpashot scan phase (#1339)
This closes #1122.
3 years ago
Hang Ruan 0d1ce7a702
[mysql] Introduce 'scan.incremental.snapshot.chunk.key-column' option to support splitting table by custom column (#1415)
This closes #1108.
3 years ago
zhmin 2c3962bd03
fix typo of SourceReaderMetrics's name (#1425)
Co-authored-by: zhmin <minzhe@loongteam.com>
3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390)
This closes #1389.
3 years ago
gongzhongqiang e7238f2407
[mysql] Fix dead loop when splitting chunks. (#1107) 3 years ago
Sergey Nuyanzin 2f3c872306
[build] Bump Flink version to 1.14.4 (#1284)
This closes #1284
3 years ago
Hang Ruan c4429a962c
[docs][cdc-base] Optimize annotations (#1320)
This closes #1320.
3 years ago
jiabao.sun ccaaf4695d [mysql] Connection pool id should contains username (#1328) 3 years ago
gongzhongqiang 55e4ae57e5
[hotfix][docs] Fix typo in java docs. (#1305)
This closes #1305.
3 years ago
lincoln lee 3f07aff6c1
[hotfix][cdc-base] Fix typo 'currenFetcher' -> 'currentFetcher' (#1299)
This closes #1299.
3 years ago
gongzhongqiang 4cf36ad22f [oracle][test] Use prebuilt docker image in tests 3 years ago
gongzhongqiang 1b27ee6b29
[cdc-base] Improve Incremental snapshot framework code style. (#1054) 3 years ago