Commit Graph

715 Commits (d5981c9acb6e1f8936952f83fa732d9b89310978)
 

Author SHA1 Message Date
Jiabao Sun b3e1e55e52
[3.0][cdc-common] Introduce Connector Factory APIs (#2661)
* [3.0][cdc-common] Introduce Connector Factory APIs

* Add PublicEvolving annotation
1 year ago
Jiabao Sun 4288cf6cae
[3.0][cdc-common] Add getTableSchema method for MetadataAccessor (#2650) 1 year ago
Leonard Xu 22bb4fd5c8
[3.0][cdc-common] Introduce Schema API for CDC 3.0
This closes ##2628.
1 year ago
Jiabao Sun 5481d436c6
[3.0][cdc-common] Introduce Event DataSink APIs for Flink CDC 3.0
This closes #2626.
1 year ago
Jiabao Sun 0f62d1d59d
[3.0][cdc-common] Introduce DataSource related APIs for Flink CDC 3.0
This closes #2625.
1 year ago
joyCurry30 d01f0a9791
[pom] Use ${revision} replace specific version. (#2623) 1 year ago
Hang Ruan e26470fff0
[3.0][cdc-runtime] introduce schema evolution framework API
This closes #2604
1 year ago
Leonard Xu 38efff8cc3
[3.0][cdc-common] Introduce data types for cdc 3.0
This closes #2627.
1 year ago
Jiabao Sun c803f5dad6
[3.0][cdc-common] Introduce Event related APIs for Flink CDC 3.0
This closes #2624.
1 year ago
Leonard Xu 82a652ca6f
[3.0][kickoff] Introduce basic modules for Flink CDC 3.0
This closes #2610
1 year ago
van d1729e862a
[mongodb] Use SampleBucketSplitStrategy for shard collection with hashed keys (#2595) 1 year ago
gongzhongqiang 58d2182206
[vitess][hotfix] Use stable image tag for vitess docker image (#2594)
This closes #2594.
1 year ago
gongzhongqiang e0fd6f965b [oracle] Bump oracle docker image version to 19c 1 year ago
gongzhongqiang 3cf64106c9 [oracle] Refactor oracle unit test 1 year ago
gongzhongqiang 057aa098ad [build] Bump testcontainers version and polish dependency 1 year ago
FlechazoW da3013db66
[mysql] Use automatic resource management to replace 'try - finally' code block. (#2552) 1 year ago
gongzhongqiang 6f9a064486
[sqlserver] Fix get latest lsn (#2551) 1 year ago
wudi 7e9cbfd544
[flink-connector-debezium] Support overriding some debezium properties in DebeziumSourceFunction (#2530)
Co-authored-by: wudi <>
1 year ago
gongzhongqiang aec2a91c81
[e2e] Remove db docker image after test cases are executed. (#2508) 1 year ago
Hongshun Wang a99e3da34b
[postgres] Reuse pool connection based on database in postgres cdc 1 year ago
Hongshun Wang 95af1a5305 [mysql] remove redundant source metrics processTime and emitDelay in mysql source 1 year ago
Hongshun Wang ad927b7e79 [cdc-base]remove redundant source metrics register(#2403) 1 year ago
Hongshun Wang b036604f03
[cdc-base] JdbcConnectionPools supports multiple JDBC sources
This closes #2451.

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
Hongshun Wang 6ca87c4d57
[tests][e2e] add log config to e2e tests (#2464) 1 year ago
Hongshun Wang 928ccf10f1
[postgres] Not drop replication slot for stream split (#2436) 1 year ago
Hongshun Wang 82e30532c8
[postgres] Close jdbc connection after creating replication slot for stream split (#2425) 1 year ago
Hongshun Wang a8fb5b0ef5
[test] Close resources after each test (#2438) 1 year ago
skylines c896df8056
[hotfix][docs] Fix the abnormal display of pictures (#2513) 1 year ago
Jiabao Sun 7172695471
[cdc-base] Fix TM hangs caused by uncaught exception (#2511) 1 year ago
wuzhenhua 07db169765
[postgres] Close idle readers when snapshot finished (#2400) 1 year ago
He Wang b0e6492fac
[oceanbase][ci] Move the OceanBase CI to free azure pipeline (#2506)
Move OceanBase CI to free azure pipeline with new docker image of OceanBase and remove redundant maven profile.
1 year ago
yuxiqian 35c112d2a1
[mongodb][hotfix] Fix Mongo collection regex match logic (#2503) 1 year ago
North.Lin dddab4d62b
[hotfix][mysql] Keep assigned splits in order to fix wrong meta group calculation
This closes #2421. 

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
Hang Ruan 84e97dfea2
[mysql] Add finished unack splits to state for the MysqlSourceReader (#2399) 1 year ago
yuxiqian 44cd46e227
[mongodb][hotfix] Mongo CDC fails to capture collections with `.` in names (#2488) 1 year ago
Leonard Xu 1ff3bdddbf [e2e][tidb] Split e2e tests into two groups to decrease the disk usage for per azure job to avoid tidb disk full error 1 year ago
Leonard Xu c9ae910149 [hotfix][e2e][vitess] Fix module name typo 1 year ago
Leonard Xu c6bfa0edfa [e2e] Remove flink 1.13 tests from e2e test matrix 1 year ago
gongzhongqiang 7801ac9588
[cdc-base] Fix parsing error when serializing and deserializing the table name with dot (#2443) 1 year ago
e-mhui 8feb51b2df
[oracle] Correct the naming error (#2405)
* [oracle] Correct the naming error

* Fix comments

* fix name error
1 year ago
Hang Ruan 639ba31ea5
[docs] Remove unreachable images in README (#2426) 1 year ago
skylines 58136b9977
[docs] Add contribution guidance section in document (#2411)
Co-authored-by: gaotingkai <rookiegao712@gmail>
1 year ago
gongzhongqiang 2f79b24464
[sqlserver] Add support bigint type as table split column (#2416) 1 year ago
gongzhongqiang 6fa02ef477
[hotfix][sqlserver] Fix backfill stream task hang (#2374)
* [sqlserver] Fix backfill stream task hang

* [sqlserver] Fix backfill stream task hang
1 year ago
Hang Ruan 8e7378d8f9
[hotfix][mysql] Trim default value for BIGINT and SMALLINT types when parsing MySQL DDL (#2418) 1 year ago
gongzhongqiang 54df7e93f0
[sqlserver] Add table filter to speed up SqlServerSchema read (#2369)
Co-authored-by: pgm-rookie <669768751@qq.com>
1 year ago
e-mhui 420fe11c2f
[Doc] Use redo log instead of binlog in Oracle document (#2408) 1 year ago
Paddy Gu 92aca18152
[mysql] Filter databases that do not need to be read when discovering tables (#2160) 1 year ago
Kunni 8098c82c52
[test] Fix TiDBE2eITCase by updating the container version to avoid `tikv disk full` failure (#2402) 1 year ago
Hongshun Wang 90ed96392c
[test][postgres] Close postgres containers after tests and fix container reuse bug (#2394) 1 year ago