Commit Graph

645 Commits (95af1a53052b893d264e7c83d9ac1a4dca982661)
 

Author SHA1 Message Date
Hongshun Wang 95af1a5305 [mysql] remove redundant source metrics processTime and emitDelay in mysql source 1 year ago
Hongshun Wang ad927b7e79 [cdc-base]remove redundant source metrics register(#2403) 1 year ago
Hongshun Wang b036604f03
[cdc-base] JdbcConnectionPools supports multiple JDBC sources
This closes #2451.

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
Hongshun Wang 6ca87c4d57
[tests][e2e] add log config to e2e tests (#2464) 1 year ago
Hongshun Wang 928ccf10f1
[postgres] Not drop replication slot for stream split (#2436) 1 year ago
Hongshun Wang 82e30532c8
[postgres] Close jdbc connection after creating replication slot for stream split (#2425) 1 year ago
Hongshun Wang a8fb5b0ef5
[test] Close resources after each test (#2438) 1 year ago
skylines c896df8056
[hotfix][docs] Fix the abnormal display of pictures (#2513) 1 year ago
Jiabao Sun 7172695471
[cdc-base] Fix TM hangs caused by uncaught exception (#2511) 1 year ago
wuzhenhua 07db169765
[postgres] Close idle readers when snapshot finished (#2400) 1 year ago
He Wang b0e6492fac
[oceanbase][ci] Move the OceanBase CI to free azure pipeline (#2506)
Move OceanBase CI to free azure pipeline with new docker image of OceanBase and remove redundant maven profile.
1 year ago
yuxiqian 35c112d2a1
[mongodb][hotfix] Fix Mongo collection regex match logic (#2503) 1 year ago
North.Lin dddab4d62b
[hotfix][mysql] Keep assigned splits in order to fix wrong meta group calculation
This closes #2421. 

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
Hang Ruan 84e97dfea2
[mysql] Add finished unack splits to state for the MysqlSourceReader (#2399) 1 year ago
yuxiqian 44cd46e227
[mongodb][hotfix] Mongo CDC fails to capture collections with `.` in names (#2488) 1 year ago
Leonard Xu 1ff3bdddbf [e2e][tidb] Split e2e tests into two groups to decrease the disk usage for per azure job to avoid tidb disk full error 1 year ago
Leonard Xu c9ae910149 [hotfix][e2e][vitess] Fix module name typo 1 year ago
Leonard Xu c6bfa0edfa [e2e] Remove flink 1.13 tests from e2e test matrix 1 year ago
gongzhongqiang 7801ac9588
[cdc-base] Fix parsing error when serializing and deserializing the table name with dot (#2443) 1 year ago
e-mhui 8feb51b2df
[oracle] Correct the naming error (#2405)
* [oracle] Correct the naming error

* Fix comments

* fix name error
1 year ago
Hang Ruan 639ba31ea5
[docs] Remove unreachable images in README (#2426) 1 year ago
skylines 58136b9977
[docs] Add contribution guidance section in document (#2411)
Co-authored-by: gaotingkai <rookiegao712@gmail>
1 year ago
gongzhongqiang 2f79b24464
[sqlserver] Add support bigint type as table split column (#2416) 1 year ago
gongzhongqiang 6fa02ef477
[hotfix][sqlserver] Fix backfill stream task hang (#2374)
* [sqlserver] Fix backfill stream task hang

* [sqlserver] Fix backfill stream task hang
1 year ago
Hang Ruan 8e7378d8f9
[hotfix][mysql] Trim default value for BIGINT and SMALLINT types when parsing MySQL DDL (#2418) 1 year ago
gongzhongqiang 54df7e93f0
[sqlserver] Add table filter to speed up SqlServerSchema read (#2369)
Co-authored-by: pgm-rookie <669768751@qq.com>
1 year ago
e-mhui 420fe11c2f
[Doc] Use redo log instead of binlog in Oracle document (#2408) 1 year ago
Paddy Gu 92aca18152
[mysql] Filter databases that do not need to be read when discovering tables (#2160) 1 year ago
Kunni 8098c82c52
[test] Fix TiDBE2eITCase by updating the container version to avoid `tikv disk full` failure (#2402) 1 year ago
Hongshun Wang 90ed96392c
[test][postgres] Close postgres containers after tests and fix container reuse bug (#2394) 1 year ago
Malcolmjian f7df47e2ee
[mysql] quota the field names when executing mysql query (#2381) (#2388)
Co-authored-by: DESKTOP-TQDONF3\狗狗jian <zhangjian@adream.org>
1 year ago
zhaomin a3ddc488d5
[test][mysql] Provide the server-time-zone setting in MySqlSourceExampleTest#testConsumingAllEvents (#2364) 1 year ago
FocusComputing 094fff41ee
[hotfix][mysql] Catch underlying throwable in snapshot reading.
This closes ##2362.
Co-authored-by: TJX2014 <tangjinxin@deepexi.com>
1 year ago
Hang Ruan b8f468effe
[hotfix][mysql] Fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource (#2384)
* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource

* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource
1 year ago
yuxiqian 61b9a2ace0
[db2] [tests] Fix unstable Db2ConnectorITCase due to cleanup failure
This closes #2345.
2 years ago
baxinyu 1330cc4118
[vitess] Improve build changelog mode (#2355) 2 years ago
yuxiqian 5915a1a359
[mongodb][tests] Improve test coverage & add class visibility annotations
This closes #2312.
2 years ago
yuxiqian ef9dac5456
[mongodb] Add `pendingRecords` and `numRecordsInErrors` metrics for source
This closes #2313.
2 years ago
yuxiqian 0b9ca5958d
[mongodb][hotfix] Fix SourceRecord range check (#2343) 2 years ago
Tyrantlucifer bca60a44bb
[polish] Add type parameter for MySqlRecords(#2300) 2 years ago
zhaomin 6c2fe08af7
[doc] fix errors in PostgresParallelSourceExample (#2324) 2 years ago
zhaomin 65bdbfd794
[docs][oracle] Add an example of Incremental Snapshot based DataStream for Oracle CDC Connector
This closes #2325.

Co-authored-by: skylines <34996528+gtk96@users.noreply.github.com>
2 years ago
yuxiqian a8dd4d33cf
[mongodb] Add disableCursorTimeout option (#2332) 2 years ago
yuxiqian 883b6846ad
[mongodb] [tests] Loosen E2E timeout limitations
This closes #2334.
2 years ago
Simonas Gelazevicius 2cf3723354
[vitess] Migrate connector properties to debezium 1.9.7 (#2260)
* feat[vitess]: Update connector properties for debezium-1.9.7

* fix: Address review comments

* fix: remove useless &ldquo and &rdquo

* fix: remove useless &nbsp
2 years ago
gongzhongqiang 8f25ebbb7c
[hotfix][sqlserver] Fix sqlserver monitor same table in other database (#2336) 2 years ago
Leonard Xu be16fb7fc8
[debezium] Fix DebeizumSourceFunction can not do savepoint after close (#2259) 2 years ago
Sting 33a3940b90
[Mysql] Fix assigning duplicate snapshot splits when enable scan newly added tables (#2096)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Hang Ruan 8757be23dc
[mysql] skip closing reader when the reader received the binlog split (#2261) 2 years ago
Hang Ruan 69ad160515
[MySQL] Optimize how to construct config table.include.list (#2274) 2 years ago