Commit Graph

707 Commits (6506ba788dae56e42d31cc4dbe163495645f4c12)
 

Author SHA1 Message Date
Jiabao Sun c803f5dad6
[3.0][cdc-common] Introduce Event related APIs for Flink CDC 3.0
This closes #2624.
1 year ago
Leonard Xu 82a652ca6f
[3.0][kickoff] Introduce basic modules for Flink CDC 3.0
This closes #2610
1 year ago
van d1729e862a
[mongodb] Use SampleBucketSplitStrategy for shard collection with hashed keys (#2595) 1 year ago
gongzhongqiang 58d2182206
[vitess][hotfix] Use stable image tag for vitess docker image (#2594)
This closes #2594.
1 year ago
gongzhongqiang e0fd6f965b [oracle] Bump oracle docker image version to 19c 1 year ago
gongzhongqiang 3cf64106c9 [oracle] Refactor oracle unit test 1 year ago
gongzhongqiang 057aa098ad [build] Bump testcontainers version and polish dependency 1 year ago
FlechazoW da3013db66
[mysql] Use automatic resource management to replace 'try - finally' code block. (#2552) 1 year ago
gongzhongqiang 6f9a064486
[sqlserver] Fix get latest lsn (#2551) 1 year ago
wudi 7e9cbfd544
[flink-connector-debezium] Support overriding some debezium properties in DebeziumSourceFunction (#2530)
Co-authored-by: wudi <>
1 year ago
gongzhongqiang aec2a91c81
[e2e] Remove db docker image after test cases are executed. (#2508) 1 year ago
Hongshun Wang a99e3da34b
[postgres] Reuse pool connection based on database in postgres cdc 1 year ago
Hongshun Wang 95af1a5305 [mysql] remove redundant source metrics processTime and emitDelay in mysql source 1 year ago
Hongshun Wang ad927b7e79 [cdc-base]remove redundant source metrics register(#2403) 1 year ago
Hongshun Wang b036604f03
[cdc-base] JdbcConnectionPools supports multiple JDBC sources
This closes #2451.

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
Hongshun Wang 6ca87c4d57
[tests][e2e] add log config to e2e tests (#2464) 1 year ago
Hongshun Wang 928ccf10f1
[postgres] Not drop replication slot for stream split (#2436) 1 year ago
Hongshun Wang 82e30532c8
[postgres] Close jdbc connection after creating replication slot for stream split (#2425) 1 year ago
Hongshun Wang a8fb5b0ef5
[test] Close resources after each test (#2438) 1 year ago
skylines c896df8056
[hotfix][docs] Fix the abnormal display of pictures (#2513) 1 year ago
Jiabao Sun 7172695471
[cdc-base] Fix TM hangs caused by uncaught exception (#2511) 1 year ago
wuzhenhua 07db169765
[postgres] Close idle readers when snapshot finished (#2400) 1 year ago
He Wang b0e6492fac
[oceanbase][ci] Move the OceanBase CI to free azure pipeline (#2506)
Move OceanBase CI to free azure pipeline with new docker image of OceanBase and remove redundant maven profile.
1 year ago
yuxiqian 35c112d2a1
[mongodb][hotfix] Fix Mongo collection regex match logic (#2503) 1 year ago
North.Lin dddab4d62b
[hotfix][mysql] Keep assigned splits in order to fix wrong meta group calculation
This closes #2421. 

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
Hang Ruan 84e97dfea2
[mysql] Add finished unack splits to state for the MysqlSourceReader (#2399) 1 year ago
yuxiqian 44cd46e227
[mongodb][hotfix] Mongo CDC fails to capture collections with `.` in names (#2488) 1 year ago
Leonard Xu 1ff3bdddbf [e2e][tidb] Split e2e tests into two groups to decrease the disk usage for per azure job to avoid tidb disk full error 1 year ago
Leonard Xu c9ae910149 [hotfix][e2e][vitess] Fix module name typo 1 year ago
Leonard Xu c6bfa0edfa [e2e] Remove flink 1.13 tests from e2e test matrix 1 year ago
gongzhongqiang 7801ac9588
[cdc-base] Fix parsing error when serializing and deserializing the table name with dot (#2443) 1 year ago
e-mhui 8feb51b2df
[oracle] Correct the naming error (#2405)
* [oracle] Correct the naming error

* Fix comments

* fix name error
1 year ago
Hang Ruan 639ba31ea5
[docs] Remove unreachable images in README (#2426) 1 year ago
skylines 58136b9977
[docs] Add contribution guidance section in document (#2411)
Co-authored-by: gaotingkai <rookiegao712@gmail>
1 year ago
gongzhongqiang 2f79b24464
[sqlserver] Add support bigint type as table split column (#2416) 1 year ago
gongzhongqiang 6fa02ef477
[hotfix][sqlserver] Fix backfill stream task hang (#2374)
* [sqlserver] Fix backfill stream task hang

* [sqlserver] Fix backfill stream task hang
1 year ago
Hang Ruan 8e7378d8f9
[hotfix][mysql] Trim default value for BIGINT and SMALLINT types when parsing MySQL DDL (#2418) 1 year ago
gongzhongqiang 54df7e93f0
[sqlserver] Add table filter to speed up SqlServerSchema read (#2369)
Co-authored-by: pgm-rookie <669768751@qq.com>
1 year ago
e-mhui 420fe11c2f
[Doc] Use redo log instead of binlog in Oracle document (#2408) 1 year ago
Paddy Gu 92aca18152
[mysql] Filter databases that do not need to be read when discovering tables (#2160) 1 year ago
Kunni 8098c82c52
[test] Fix TiDBE2eITCase by updating the container version to avoid `tikv disk full` failure (#2402) 1 year ago
Hongshun Wang 90ed96392c
[test][postgres] Close postgres containers after tests and fix container reuse bug (#2394) 2 years ago
Malcolmjian f7df47e2ee
[mysql] quota the field names when executing mysql query (#2381) (#2388)
Co-authored-by: DESKTOP-TQDONF3\狗狗jian <zhangjian@adream.org>
2 years ago
zhaomin a3ddc488d5
[test][mysql] Provide the server-time-zone setting in MySqlSourceExampleTest#testConsumingAllEvents (#2364) 2 years ago
FocusComputing 094fff41ee
[hotfix][mysql] Catch underlying throwable in snapshot reading.
This closes ##2362.
Co-authored-by: TJX2014 <tangjinxin@deepexi.com>
2 years ago
Hang Ruan b8f468effe
[hotfix][mysql] Fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource (#2384)
* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource

* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource
2 years ago
yuxiqian 61b9a2ace0
[db2] [tests] Fix unstable Db2ConnectorITCase due to cleanup failure
This closes #2345.
2 years ago
baxinyu 1330cc4118
[vitess] Improve build changelog mode (#2355) 2 years ago
yuxiqian 5915a1a359
[mongodb][tests] Improve test coverage & add class visibility annotations
This closes #2312.
2 years ago
yuxiqian ef9dac5456
[mongodb] Add `pendingRecords` and `numRecordsInErrors` metrics for source
This closes #2313.
2 years ago