Commit Graph

54 Commits (daceb42168238189a3fc247f5e377c5737a339f1)

Author SHA1 Message Date
Qingsheng Ren daceb42168 [build] Use ${project.version} instead of ${revision} for dependency version
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Jiabao Sun 8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820)
This closes #2820.
1 year ago
Dian Qi f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event (#2682)
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
Jiabao Sun 7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816) 1 year ago
Josh Mahonin 63b39ba22c
[cdc-source-connector][mysql] Fix attempted load of isSuspended in MySqlSplitSerializer::deserializeSplit when cdc version <= 2.2.0 (#2550)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun 8c75db145d
[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema (#2811) 1 year ago
He Wang a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs (#2543)
This closes #2543.
1 year ago
Leonard Xu 0eae214183
[pipeline-connector][mysql] Enable send schema change by default (#2815)
This closes #2815.
1 year ago
PengFei Li 33b7c85093 [pipeline-connector][starrocks] Add starrocks pipeline connector (#2765)
This closes #2645.
1 year ago
Kunni 4abd86a500
[pipeline-connector][doris] add doris pipeline connector. (#2810)
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Jiabao Sun 8ca3091805 [cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema 1 year ago
Hang Ruan 1766e82d7c [3.0][cdc-common & runtime] Remove useless flink imports 1 year ago
Jiabao Sun 08c5dfed83 [cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun 174282d3ef [cdc-pipeline-connector][mysql] Support more mysql types 1 year ago
Hang Ruan ec3d558485 [cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector 1 year ago
Hang Ruan 10ccbde023 [cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent 1 year ago
Jiabao Sun d0cce26b76 [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource 1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Xin Gong 2d9dc018c5
[cdc-connector][sqlserver][tests] Fix UT errors by increasing the wait time after committing SQL (#2799)
This closes #2799.
1 year ago
Qingsheng Ren 173deb5248
[cdc-composer] Add common and runtime JAR when submit (#2795)
This closes #2795.
1 year ago
Xin Gong 5f318346ff
[cdc-connector][debezium] Supports conversion from binary bytes to base64 encoded string (#2435)
This closes #2435.
1 year ago
Hang Ruan d1c3f8500b
[cdc-connector][mysql] MysqlTableSource return metadata in a fixed order (#2578) 1 year ago
gongzhongqiang 72d33c8965
[cdc-connector][mysql] Fix snapshot fetch size conf does not take effect (#2766) 1 year ago
Hongshun Wang 5c00f76d0f [cdc-connector][oracle] Expose ability to skip backfill in snapshot period for Oracle CDC (#2793)
This closes #2793.
1 year ago
yunqingmo ef1c095763 [cdc-connector][oracle] Fix wrong table path during backfill phase which leads to potential data loss (#2707)
This closes #2707.
1 year ago
Qingsheng Ren cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776)
This closes #2766.
1 year ago
Hongshun Wang f57d6f6e67 [cdc-connector][sqlserver] Expose ability to skip backfill in snapshot period for SqlServer CDC.(#2783)
This closes #2783.
1 year ago
Hongshun Wang a6379358e4 [cdc-connector][mysql] Expose ability to skip backfill in snapshot period for MySQL CDC. 1 year ago
Hongshun Wang e7c713eca6 [cdc-connector][mongodb] Expose ability to skip backfill in snapshot period for Mongodb CDC. 1 year ago
Hongshun Wang c6cb3b2371 [cdc-connector][postgres] Expose ability to skip backfill in snapshot period for Postgres CDC. 1 year ago
Hongshun Wang 4e248fad33 [cdc-connector][base] Support skip snapshot backfill for incremental snapshot connector 1 year ago
Hongshun Wang 13be14fe3f [cdc-connector][base][tests] Introduce snapshot phase hooks for better snapshot test 1 year ago
Hang Ruan 6eb980a614
[hotfix][mysql][tests] Avoid canceling a finished job in tests of SpecificStartingOffsetITCase (#2687)
This closes #2687.
1 year ago
Hongshun Wang cc9dbc6660
[mongodb][hotfix] Fix MongoDB's rewriteOutputBuffer to emit +I rather than +U (#2760) (#2760) 1 year ago
Kunni a81d4a16b9
[cdc-common] Introduce createFieldGetters method in SchemaUtils to build FieldGetters of given Schema. (#2762)
This closes #2762.
1 year ago
Kunni 8edf2a60f0
[cdc-pipeline-connector][values] Avoid using `default` as name of namespace and schema. (#2774) 1 year ago
Hongshun Wang 57e4793b21
[cdc-base] Extract the common parts of each ScanFetchTask into AbstractScanFetcherTask.
This closes #2690.
1 year ago
He Wang 6e53733df2
[oceanbase] Use global timestamp to start log client (#2565)
* use global timestamp to start log client

* remove redundant fields

* update log info
1 year ago
Kunni 4a5f2161aa
[cdc-pipeline-connector][values] Add event set MULTI_SPLITS_SINGLE_TABLE to mock source with multiple splits (#2737)
This closes #2737.
1 year ago
Hang Ruan 70614be28c [3.0][cdc-common] Introduce BinaryRecordDataGenerator to help to create BinaryRecordData
This closes #2734.
1 year ago
Hang Ruan cad7424a1d [3.0][cdc-common] Use BinaryRecordData in DataChangeEvent instead of GenericRecordData 1 year ago
gongzhongqiang 51554d8630
[hotfix][vitess] Fix invalidate package name
This closes #2735.
1 year ago
lvyanquan b4deda97be [cdc-pipeline-connector][values] Introduce `values` cdc pipeline connector
This closes #2675.
1 year ago
Hongshun Wang 4770f360d0
[sqlserver] Fix timestamp type parse of sqlserver (#2708) 1 year ago
Shawn Huang 18936a3676
[mongodb] Incremental snapshot source supports comma-separated format parameter for databases and collections (#2724) 1 year ago
joyCurry30 a1b67a7585
[3.0][cdc-common] Add ConText for Source/Sink initialization. (#2672) 1 year ago
Leonard Xu 00f8156671 [build] Add header copyright check for java files 1 year ago
Leonard Xu 7192e5300b [oracle] Skip unsupported nested table for legacy debezium source function 1 year ago
zyi728 0565bf844c [oracle] Skip unsupported nested table for Incremental OracleSource 1 year ago
Leonard Xu 995d524416 [3.0][common] Use built-in API annotations to make common module free with flink
This closes #2695.
1 year ago