Commit Graph

139 Commits (e817cc283d6fef1830e203fc19322bb16f1f3b4b)

Author SHA1 Message Date
Hang Ruan 10ccbde023 [cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent 1 year ago
Jiabao Sun d0cce26b76 [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource 1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Xin Gong 2d9dc018c5
[cdc-connector][sqlserver][tests] Fix UT errors by increasing the wait time after committing SQL (#2799)
This closes #2799.
1 year ago
Qingsheng Ren 173deb5248
[cdc-composer] Add common and runtime JAR when submit (#2795)
This closes #2795.
1 year ago
Xin Gong 5f318346ff
[cdc-connector][debezium] Supports conversion from binary bytes to base64 encoded string (#2435)
This closes #2435.
1 year ago
Hang Ruan d1c3f8500b
[cdc-connector][mysql] MysqlTableSource return metadata in a fixed order (#2578) 1 year ago
gongzhongqiang 72d33c8965
[cdc-connector][mysql] Fix snapshot fetch size conf does not take effect (#2766) 1 year ago
Hongshun Wang 5c00f76d0f [cdc-connector][oracle] Expose ability to skip backfill in snapshot period for Oracle CDC (#2793)
This closes #2793.
1 year ago
yunqingmo ef1c095763 [cdc-connector][oracle] Fix wrong table path during backfill phase which leads to potential data loss (#2707)
This closes #2707.
1 year ago
Qingsheng Ren cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776)
This closes #2766.
1 year ago
Hongshun Wang f57d6f6e67 [cdc-connector][sqlserver] Expose ability to skip backfill in snapshot period for SqlServer CDC.(#2783)
This closes #2783.
1 year ago
Hongshun Wang a6379358e4 [cdc-connector][mysql] Expose ability to skip backfill in snapshot period for MySQL CDC. 1 year ago
Hongshun Wang e7c713eca6 [cdc-connector][mongodb] Expose ability to skip backfill in snapshot period for Mongodb CDC. 1 year ago
Hongshun Wang c6cb3b2371 [cdc-connector][postgres] Expose ability to skip backfill in snapshot period for Postgres CDC. 1 year ago
Hongshun Wang 4e248fad33 [cdc-connector][base] Support skip snapshot backfill for incremental snapshot connector 1 year ago
Hongshun Wang 13be14fe3f [cdc-connector][base][tests] Introduce snapshot phase hooks for better snapshot test 1 year ago
Hang Ruan 6eb980a614
[hotfix][mysql][tests] Avoid canceling a finished job in tests of SpecificStartingOffsetITCase (#2687)
This closes #2687.
1 year ago
Hongshun Wang cc9dbc6660
[mongodb][hotfix] Fix MongoDB's rewriteOutputBuffer to emit +I rather than +U (#2760) (#2760) 1 year ago
Kunni a81d4a16b9
[cdc-common] Introduce createFieldGetters method in SchemaUtils to build FieldGetters of given Schema. (#2762)
This closes #2762.
1 year ago
Kunni 8edf2a60f0
[cdc-pipeline-connector][values] Avoid using `default` as name of namespace and schema. (#2774) 1 year ago
Hongshun Wang 57e4793b21
[cdc-base] Extract the common parts of each ScanFetchTask into AbstractScanFetcherTask.
This closes #2690.
1 year ago
He Wang 6e53733df2
[oceanbase] Use global timestamp to start log client (#2565)
* use global timestamp to start log client

* remove redundant fields

* update log info
1 year ago
Kunni 4a5f2161aa
[cdc-pipeline-connector][values] Add event set MULTI_SPLITS_SINGLE_TABLE to mock source with multiple splits (#2737)
This closes #2737.
1 year ago
Hang Ruan 70614be28c [3.0][cdc-common] Introduce BinaryRecordDataGenerator to help to create BinaryRecordData
This closes #2734.
1 year ago
Hang Ruan cad7424a1d [3.0][cdc-common] Use BinaryRecordData in DataChangeEvent instead of GenericRecordData 1 year ago
gongzhongqiang 51554d8630
[hotfix][vitess] Fix invalidate package name
This closes #2735.
1 year ago
lvyanquan b4deda97be [cdc-pipeline-connector][values] Introduce `values` cdc pipeline connector
This closes #2675.
1 year ago
Hongshun Wang 4770f360d0
[sqlserver] Fix timestamp type parse of sqlserver (#2708) 1 year ago
Shawn Huang 18936a3676
[mongodb] Incremental snapshot source supports comma-separated format parameter for databases and collections (#2724) 1 year ago
joyCurry30 a1b67a7585
[3.0][cdc-common] Add ConText for Source/Sink initialization. (#2672) 1 year ago
Leonard Xu 00f8156671 [build] Add header copyright check for java files 1 year ago
Leonard Xu 7192e5300b [oracle] Skip unsupported nested table for legacy debezium source function 1 year ago
zyi728 0565bf844c [oracle] Skip unsupported nested table for Incremental OracleSource 1 year ago
Leonard Xu 995d524416 [3.0][common] Use built-in API annotations to make common module free with flink
This closes #2695.
1 year ago
Maciej Bryński 1e6b983bdd
[build] Bump Flink version to 1.18.0 (#2463)
This closes #2670.
1 year ago
Hongshun Wang 7da3eaef77
[postgres-cdc] Add tests for latest-offset startup strategy (#2527) 1 year ago
joyCurry30 d01f0a9791
[pom] Use ${revision} replace specific version. (#2623) 1 year ago
Leonard Xu 82a652ca6f
[3.0][kickoff] Introduce basic modules for Flink CDC 3.0
This closes #2610
1 year ago