Commit Graph

873 Commits (88c23b59a016d7b023992d2a8fb1865f46fed00d)
 

Author SHA1 Message Date
Xianxun Ye 8eba910063
[cdc-connector][mysql] Support metadata 'operation' virtual column for MySql Connector. (#2913) 1 year ago
Hongshun Wang 6b6d9fcb0b
[cdc-connector][mongodb] Avoid mongodb source to read data after high_watermark in backfill phase (#2893) 1 year ago
He Wang 26dfeeb563
[cdc-connector][oceanbase] Fallback to current timestamp when query gts failure (#2868) 1 year ago
Hongshun Wang 2c557c6a78
[cdc-connector][sqlserver][tests] Fix UT errors by correcting right output (#2864) 1 year ago
skylines 1839fb556c
[hotfix][docs] Change the title to keep the document format uniform (#2871) 1 year ago
GOODBOY008 08beca52d0 [cdc] Add Deprecated annotation to source function which connector implemented incremental 1 year ago
GOODBOY008 f7d6adc28b [hotfix] Remove mysqlToDoris.yml 1 year ago
GOODBOY008 f2c81c7d08 [hotfix] Fix BinaryRecordData deserialize 1 year ago
Hongshun Wang 568ed79005
[postgres] Add commits of PostgresConnection back to distinguish with debezium's origin class (#2839) 1 year ago
xuzifu666 e6bb8e9a55
[hotfix][cdc-rumtime][minor] Clean up useless code in BinaryRecordDataSerializer (#2845)
Co-authored-by: xuyu <11161569@vivo.com>
1 year ago
PengFei Li f2c0a03269
[pipeline-connector][starrocks][docs] Fix the pictures do not display (#2860) 1 year ago
wudi 12836e5560
[docs][pipeline-connector][doris] Introduce Doris Pipeline Connector (#2788) 1 year ago
PengFei Li 78dc8ba9e7
[docs][pipeline-connector][starrocks] Add documents for StarRocks pipeline connector (#2840)
This close #2840.
1 year ago
Kunni 8be7bdd25d
[3.0][docs] Add tutorial for mysql to starrocks pipeline (#2841) 1 year ago
Xin Gong 08d6b8178f
[cdc-connector][sqlserver] Fix SqlServerTableSource params order error (#2847) 1 year ago
Kunni 43bd5c01b2
[3.0][docs] Add tutorial for mysql to doris pipeline. (#2838) 1 year ago
Hongshun Wang f15faac298
[docs] Fix overview docs to remove prefix of pipeline options (#2833) 1 year ago
Shawn Huang b9615db694
[3.0][docs] fix mysql pipeline connector option in readme (#2834) 1 year ago
Jiabao Sun 2088f89ed8
[3.0][docs] Add documents for MySql pipeline connector (#2827) 1 year ago
Hongshun Wang f2c2e64491
[3.0][docs] Introduce core concepts for CDC 3.0 pipeline (#2790)
This closes #2655.
1 year ago
Shawn Huang db5743ce00
[docs] Add CDC pipeline example in README (#2819)
Co-authored-by: guiyuan.hx <guiyuan.hx@alibaba-inc.com>
1 year ago
PengFei Li 72bcb1df02
[pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks (#2829) 1 year ago
gongzhongqiang c484bb447c
[build][hotfix] Remove duplicate dependency (#2828) 1 year ago
Qingsheng Ren 6cb2ffe2fb
[cdc-cli][cdc-composer] Use "source-table" and "sink-table" as keywords of route (#2823) 1 year ago
Qingsheng Ren 73086c4f37
[cdc-cli][cdc-dist] Support loading global config from FLINK_CDC_HOME (#2822)
This closes #2822.
1 year ago
Qingsheng Ren 9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options (#2821)
This closes #2821.
1 year ago
He Wang 4616092195
[cdc-source-connector][oceanbase][e2e] Add OceanBase e2e test case (#2521)
This closes #981
1 year ago
Qingsheng Ren 0c8f5eaf0a [build] Use flink-shaded-force-shading to force all submodules to generate dependency-reduced-pom.xml
This will erase all properties in dependency-reduced-pom.xml and
pin all properties to a constant value. For example, ${flink.version}
will be replaced by the actual Flink version, which is safer for users
to reference it.
1 year ago
Qingsheng Ren daceb42168 [build] Use ${project.version} instead of ${revision} for dependency version
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Qingsheng Ren c0ee1c188e [build] Skip maven-deploy-plugin for test modules and flink-cdc-dist 1 year ago
Jiabao Sun 8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820)
This closes #2820.
1 year ago
Dian Qi f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event (#2682)
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
Jiabao Sun 7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816) 1 year ago
Leonard Xu 18fb0d8b7f
[build][hotfix] Remove useless suppressions. (#2817) 1 year ago
Josh Mahonin 63b39ba22c
[cdc-source-connector][mysql] Fix attempted load of isSuspended in MySqlSplitSerializer::deserializeSplit when cdc version <= 2.2.0 (#2550)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun 8c75db145d
[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema (#2811) 1 year ago
He Wang a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs (#2543)
This closes #2543.
1 year ago
Leonard Xu 0eae214183
[pipeline-connector][mysql] Enable send schema change by default (#2815)
This closes #2815.
1 year ago
Hang Ruan 30c8254af3
[3.0][cdc-runtime] Remove waitForFlushSuccess field in request handler (#2812) 1 year ago
PengFei Li 33b7c85093 [pipeline-connector][starrocks] Add starrocks pipeline connector (#2765)
This closes #2645.
1 year ago
Kunni 4abd86a500
[pipeline-connector][doris] add doris pipeline connector. (#2810)
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Jiabao Sun 8ca3091805 [cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema 1 year ago
Hang Ruan 1766e82d7c [3.0][cdc-common & runtime] Remove useless flink imports 1 year ago
Jiabao Sun 08c5dfed83 [cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun 174282d3ef [cdc-pipeline-connector][mysql] Support more mysql types 1 year ago
Hang Ruan ec3d558485 [cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector 1 year ago
Hang Ruan 10ccbde023 [cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent 1 year ago
Jiabao Sun d0cce26b76 [cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource 1 year ago
Qingsheng Ren a328f9895a
[cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments (#2807)
This closes #2807.
1 year ago
Qingsheng Ren 9ce8450cf2
[cdc-runtime][hotfix] Setup waitFlushSuccess before responding operator to flush. (#2805)
This closes #2805.

There might be a case that sink flushes faster than schema operator requesting release upstream. In that case waitFlushSuccess has not been set when sink has flushed successfully, which will lead to a NullPointerException.
1 year ago