Commit Graph

793 Commits (8a08ded410311809290704db14178fb25d44fe73)
 

Author SHA1 Message Date
Jiabao Sun 8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820)
This closes #2820.
1 year ago
Dian Qi f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event (#2682)
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
Jiabao Sun 7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816) 1 year ago
Leonard Xu 18fb0d8b7f
[build][hotfix] Remove useless suppressions. (#2817) 1 year ago
Josh Mahonin 63b39ba22c
[cdc-source-connector][mysql] Fix attempted load of isSuspended in MySqlSplitSerializer::deserializeSplit when cdc version <= 2.2.0 (#2550)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun 8c75db145d
[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema (#2811) 1 year ago
He Wang a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs (#2543)
This closes #2543.
1 year ago
Leonard Xu 0eae214183
[pipeline-connector][mysql] Enable send schema change by default (#2815)
This closes #2815.
1 year ago
Hang Ruan 30c8254af3
[3.0][cdc-runtime] Remove waitForFlushSuccess field in request handler (#2812) 1 year ago
PengFei Li 33b7c85093 [pipeline-connector][starrocks] Add starrocks pipeline connector (#2765)
This closes #2645.
1 year ago
Kunni 4abd86a500
[pipeline-connector][doris] add doris pipeline connector. (#2810)
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Jiabao Sun 8ca3091805 [cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema 1 year ago
Hang Ruan 1766e82d7c [3.0][cdc-common & runtime] Remove useless flink imports 1 year ago
Jiabao Sun 08c5dfed83 [cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun 174282d3ef [cdc-pipeline-connector][mysql] Support more mysql types 1 year ago
Hang Ruan ec3d558485 [cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector 1 year ago
Hang Ruan 10ccbde023 [cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent 1 year ago
Jiabao Sun d0cce26b76 [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource 1 year ago
Qingsheng Ren a328f9895a
[cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments (#2807)
This closes #2807.
1 year ago
Qingsheng Ren 9ce8450cf2
[cdc-runtime][hotfix] Setup waitFlushSuccess before responding operator to flush. (#2805)
This closes #2805.

There might be a case that sink flushes faster than schema operator requesting release upstream. In that case waitFlushSuccess has not been set when sink has flushed successfully, which will lead to a NullPointerException.
1 year ago
Leonard Xu 95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well (#2797)
This closes #2797.
1 year ago
Hang Ruan e435004eda
[cdc-common][hotfix] Remove useless flink imports (#2803)
This closes #2803.
1 year ago
Qingsheng Ren cfb3fd206e
[build] Let surefire plugin to keep the full stacktrace on test failure (#2804)
This closes #2804.
1 year ago
Kunni b60322bef7
[pipeline-common] Use column name to check whether the schema contains specific column or not. (#2801)
This closes #2801.
1 year ago
Qingsheng Ren 3bf1428233 [cdc-composer][route][sink] Add name for route and improve name for sink 1 year ago
Leonard Xu a8f4ba8cc6 [cdc-composer][hotfix] Always chain operator by default 1 year ago
Leonard Xu f0c630d6f6 [cdc-composer][sink] Use correct name for sink operator 1 year ago
Qingsheng Ren 4843ab2432
[cdc-runtime] SchemaRegistry should complete the future after making the checkpoint (#2800)
This closes #2800.
1 year ago
Xin Gong 2d9dc018c5
[cdc-connector][sqlserver][tests] Fix UT errors by increasing the wait time after committing SQL (#2799)
This closes #2799.
1 year ago
Qingsheng Ren 173deb5248
[cdc-composer] Add common and runtime JAR when submit (#2795)
This closes #2795.
1 year ago
Xin Gong 5f318346ff
[cdc-connector][debezium] Supports conversion from binary bytes to base64 encoded string (#2435)
This closes #2435.
1 year ago
Hang Ruan d1c3f8500b
[cdc-connector][mysql] MysqlTableSource return metadata in a fixed order (#2578) 1 year ago
gongzhongqiang 72d33c8965
[cdc-connector][mysql] Fix snapshot fetch size conf does not take effect (#2766) 1 year ago
Hongshun Wang 5c00f76d0f [cdc-connector][oracle] Expose ability to skip backfill in snapshot period for Oracle CDC (#2793)
This closes #2793.
1 year ago
yunqingmo ef1c095763 [cdc-connector][oracle] Fix wrong table path during backfill phase which leads to potential data loss (#2707)
This closes #2707.
1 year ago
Qingsheng Ren cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer (#2776)
This closes #2766.
1 year ago
Qingsheng Ren 100fb4a59e
[cdc-dist] Introduce flink-cdc.sh as the entrypoint of the Flink CDC (#2791) 1 year ago
gongzhongqiang 1a5065e774
[3.0] [flink-cdc-dist] Collect all distro resources into a TAR (#2636)
This closes #2621 #2622 

Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
1 year ago
Hongshun Wang f57d6f6e67 [cdc-connector][sqlserver] Expose ability to skip backfill in snapshot period for SqlServer CDC.(#2783)
This closes #2783.
1 year ago
Hongshun Wang a6379358e4 [cdc-connector][mysql] Expose ability to skip backfill in snapshot period for MySQL CDC. 1 year ago
Hongshun Wang e7c713eca6 [cdc-connector][mongodb] Expose ability to skip backfill in snapshot period for Mongodb CDC. 1 year ago
Hongshun Wang c6cb3b2371 [cdc-connector][postgres] Expose ability to skip backfill in snapshot period for Postgres CDC. 1 year ago
Hongshun Wang 4e248fad33 [cdc-connector][base] Support skip snapshot backfill for incremental snapshot connector 1 year ago
Hongshun Wang 13be14fe3f [cdc-connector][base][tests] Introduce snapshot phase hooks for better snapshot test 1 year ago
Qingsheng Ren a771abef90 [cdc-composer] Add routing logic into the Flink composer 1 year ago
Qingsheng Ren f22ac3e788 [cdc-cli][cdc-composer] Use sourceTable and sinkTable as keyword in route definition 1 year ago
Qingsheng Ren 416562c9ba [cdc-runtime] Add RouteFunction for routing change events 1 year ago
Qingsheng Ren 2bde0beaec [cdc-common] Introduce AssertJ-style assertion system for Flink CDC data structures 1 year ago
Hang Ruan 6eb980a614
[hotfix][mysql][tests] Avoid canceling a finished job in tests of SpecificStartingOffsetITCase (#2687)
This closes #2687.
1 year ago
ice f7dda3b67b
[docs][zh][hotfix] Remove redundant sections from mysql-cdc documentation (#2777)
This closes #2777.
1 year ago