Commit Graph

607 Commits (98e2cca800f9e815120a87f8f84a6018eba13892)
 

Author SHA1 Message Date
Kunni 98e2cca800 [test] Fix TiDBE2eITCase by updating the container version to avoid `tikv disk full` failure (#2402)
(cherry picked from commit 8098c82c52)
1 year ago
Hongshun Wang 9205ac2f90 [test][postgres] Close postgres containers after tests and fix container reuse bug (#2394)
(cherry picked from commit 90ed96392c)
1 year ago
Malcolmjian 45b003d5f8 [mysql] quota the field names when executing mysql query (#2381) (#2388)
Co-authored-by: DESKTOP-TQDONF3\狗狗jian <zhangjian@adream.org>
(cherry picked from commit f7df47e2ee)
1 year ago
zhaomin 246e4013e5 [test][mysql] Provide the server-time-zone setting in MySqlSourceExampleTest#testConsumingAllEvents (#2364)
(cherry picked from commit a3ddc488d5)
1 year ago
FocusComputing 20da7adc2c [hotfix][mysql] Catch underlying throwable in snapshot reading.
This closes ##2362.
Co-authored-by: TJX2014 <tangjinxin@deepexi.com>

(cherry picked from commit 094fff41ee)
1 year ago
Hang Ruan 12ebbba750 [hotfix][mysql] Fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource (#2384)
* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource

* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource

(cherry picked from commit b8f468effe)
1 year ago
yuxiqian 2a8d6c5345 [db2] [tests] Fix unstable Db2ConnectorITCase due to cleanup failure
This closes #2345.

(cherry picked from commit 61b9a2ace0)
1 year ago
yuxiqian c35b1ff3bc [mongodb][hotfix] Fix SourceRecord range check (#2343)
(cherry picked from commit 0b9ca5958d)
1 year ago
Tyrantlucifer 7bb5253465 [polish] Add type parameter for MySqlRecords(#2300)
(cherry picked from commit bca60a44bb)
1 year ago
zhaomin 0026ddde16 [doc] fix errors in PostgresParallelSourceExample (#2324)
(cherry picked from commit 6c2fe08af7)
1 year ago
zhaomin ef7f0f5259 [docs][oracle] Add an example of Incremental Snapshot based DataStream for Oracle CDC Connector
This closes #2325.

Co-authored-by: skylines <34996528+gtk96@users.noreply.github.com>
(cherry picked from commit 65bdbfd794)
1 year ago
yuxiqian 30e9761290 [mongodb] [tests] Loosen E2E timeout limitations
This closes #2334.

(cherry picked from commit 883b6846ad)
1 year ago
Kunni 0ff6e26fc6 [build] Add vcs.xml for IDEA (#2064)
(cherry picked from commit 0714688aee)
1 year ago
BIN 409936e28a [hotfix] update dbz option name 'xx. whitelist' to 'xx.include.list'(xx = database, schema or table) (#2212)
(cherry picked from commit ba5fcbc97b)
1 year ago
gongzhongqiang 823f5a1e21
[hotfix] Fix sqlserver monitor same table in other database (#2335)
* [hotfix] Fix sqlserver monitor same table in other database

* Add unit test

---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Leonard Xu 6dba62ece2 [debezium] Fix DebeizumSourceFunction can not do savepoint after close (#2259) 2 years ago
Hang Ruan 8221f51ca8 [mysql] skip closing reader when the reader received the binlog split (#2261) 2 years ago
Hang Ruan cc364a5efc [MySQL] Optimize how to construct config table.include.list (#2274) 2 years ago
Hang Ruan 82d0bfac86 [oracle] Fix class conflict when using multi cdc sql connector
This closes #2285.
2 years ago
empcl 771eff5aab [MySQL] Fix the startup mode exception message (#2264)
Co-authored-by: chenlei677 <chenlei677@jd.com>
2 years ago
SileiWu bcd2ae9e6d [hotfix][mysql] remove unused code (#2231) 2 years ago
Hang Ruan 67c445f2cc
[mysql] Fix assigning duplicate snapshot splits when enable scan newly added tables (#2326) 2 years ago
skylines e8b62babad [docs] Add connector features table to help users quickly understand the supported features of each connector
This closes #1736.
Co-authored-by: rookiegao <rookiegao712@gmail>
2 years ago
Hang Ruan 7dbac7277e
[mysql] Remove the finished snapshot splits for the binlog split when restoring from the checkpoint (#2292) (#2318) 2 years ago
gongzhongqiang 2595118ccb
[hotfix][sqlserver] Fix sqlserver close idle and chunk key column missing (#2310)
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
syyfffy 0918a6439d
[docs] Update Postgres CDC document for slot.name option (#2280) 2 years ago
Hang Ruan a52d80ae76
[postgres] Fix the slot name conflict bug (#2251) 2 years ago
Hang Ruan 9da4949ed4
[docs] add docs for the mysql tables without primary keys (#2238)
* [docs] add docs for the mysql tables without primary keys
2 years ago
Hang Ruan daba72ee51
[oracle] Use oracle connection in context for each reader subtask (#2254) 2 years ago
gongzhongqiang 05fce47f9b
[hotfix] Update support version (#2256)
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Hang Ruan 26b444541f
[docs] Bump cdc version to 2.4.0 in docs
This closes #2237.
2 years ago
Hang Ruan 3fb5029839 [hotfix] Add vitess connector to the release profile 2 years ago
gongzhongqiang 53ff798ef6
[docs][hotfix] Update debezium reference links to 1.9 version
This closes #2225.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Co-authored-by: Leonard Xu <leonard@apache.org>
2 years ago
Leonard Xu 92e9d9ea58
[build] Update the copyright year to 2023 (#2205) 2 years ago
Hang Ruan 015e9515d3 [postgres] Fix postgres e2e test 2 years ago
Hang Ruan 960ef134bc [postgres] scan.incremental.snapshot.enabled is closed by default 2 years ago
Hang Ruan 6d6881663a [postgres] Backfill task will be able to end when there is not new change data but read the ending lsn 2 years ago
Hang Ruan 1a69cef424 [postgres] Create slot for backfill task before snapshot reading
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 years ago
Hang Ruan da5e6a7872 [postgres] Prepare a slot for the unique global stream split
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 years ago
wallkop debd6ef404
[mysql] Fix GTID issues to recover from checkpoint normally in specifying startup mode (#2220) 2 years ago
gongzhongqiang c8d4181cb9
[doc][hotfix] Fix driver version and correct vitess doc path (#2224)
* [doc][hotfix] Fix driver version and correct vitess doc path
---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Qingsheng Ren 1bb0689583 [vitess] Add e2e case for Vitess connector 2 years ago
Qingsheng Ren 1fb4f825e8 [vitess] Add Vitess tests in Azure pipeline 2 years ago
Simonas Gelazevicius e349cb1a83 [vitess] Add Vitess CDC connector (#456)
Co-authored-by: gintarasm <gintaras.matulas@gmail.com>
2 years ago
Tigran Manasyan 2b017346c3
[debezium] Bump debezium version to 1.9.7.Final (#2156)
Co-authored-by: gongzhongqiang <764629910@qq.com>
2 years ago
Hang Ruan d8c1e335dc
[oracle] Fix the backfill task not running bug in oracle cdc connector (#2218) 2 years ago
ehui 66556ee501
[hotfix][sqlserver] Merge high and low watermark data during snapshot reading process (#2179)
* [sqlserver] Merge high and low watermark data during snapshot reading process
2 years ago
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
2 years ago
molsionmo 734982e075
[oracle] Fix the incremental phase not skip the data that has been read in the snapshot full phase (#2215)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Jiabao Sun aff5b0566d
[mongodb] Support specific timestamp startup mode. (#2207) 2 years ago