GOODBOY008
f2c81c7d08
[hotfix] Fix BinaryRecordData deserialize
1 year ago
Hongshun Wang
568ed79005
[postgres] Add commits of PostgresConnection back to distinguish with debezium's origin class ( #2839 )
1 year ago
xuzifu666
e6bb8e9a55
[hotfix][cdc-rumtime][minor] Clean up useless code in BinaryRecordDataSerializer ( #2845 )
...
Co-authored-by: xuyu <11161569@vivo.com>
1 year ago
PengFei Li
f2c0a03269
[pipeline-connector][starrocks][docs] Fix the pictures do not display ( #2860 )
1 year ago
wudi
12836e5560
[docs][pipeline-connector][doris] Introduce Doris Pipeline Connector ( #2788 )
1 year ago
PengFei Li
78dc8ba9e7
[docs][pipeline-connector][starrocks] Add documents for StarRocks pipeline connector ( #2840 )
...
This close #2840 .
1 year ago
Kunni
8be7bdd25d
[3.0][docs] Add tutorial for mysql to starrocks pipeline ( #2841 )
1 year ago
Xin Gong
08d6b8178f
[cdc-connector][sqlserver] Fix SqlServerTableSource params order error ( #2847 )
1 year ago
Kunni
43bd5c01b2
[3.0][docs] Add tutorial for mysql to doris pipeline. ( #2838 )
1 year ago
Hongshun Wang
f15faac298
[docs] Fix overview docs to remove prefix of pipeline options ( #2833 )
1 year ago
Shawn Huang
b9615db694
[3.0][docs] fix mysql pipeline connector option in readme ( #2834 )
1 year ago
Jiabao Sun
2088f89ed8
[3.0][docs] Add documents for MySql pipeline connector ( #2827 )
1 year ago
Hongshun Wang
f2c2e64491
[3.0][docs] Introduce core concepts for CDC 3.0 pipeline ( #2790 )
...
This closes #2655 .
1 year ago
Shawn Huang
db5743ce00
[docs] Add CDC pipeline example in README ( #2819 )
...
Co-authored-by: guiyuan.hx <guiyuan.hx@alibaba-inc.com>
1 year ago
PengFei Li
72bcb1df02
[pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks ( #2829 )
1 year ago
gongzhongqiang
c484bb447c
[build][hotfix] Remove duplicate dependency ( #2828 )
1 year ago
Qingsheng Ren
6cb2ffe2fb
[cdc-cli][cdc-composer] Use "source-table" and "sink-table" as keywords of route ( #2823 )
1 year ago
Qingsheng Ren
73086c4f37
[cdc-cli][cdc-dist] Support loading global config from FLINK_CDC_HOME ( #2822 )
...
This closes #2822 .
1 year ago
Qingsheng Ren
9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options ( #2821 )
...
This closes #2821 .
1 year ago
He Wang
4616092195
[cdc-source-connector][oceanbase][e2e] Add OceanBase e2e test case ( #2521 )
...
This closes #981
1 year ago
Qingsheng Ren
0c8f5eaf0a
[build] Use flink-shaded-force-shading to force all submodules to generate dependency-reduced-pom.xml
...
This will erase all properties in dependency-reduced-pom.xml and
pin all properties to a constant value. For example, ${flink.version}
will be replaced by the actual Flink version, which is safer for users
to reference it.
1 year ago
Qingsheng Ren
daceb42168
[build] Use ${project.version} instead of ${revision} for dependency version
...
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Qingsheng Ren
c0ee1c188e
[build] Skip maven-deploy-plugin for test modules and flink-cdc-dist
1 year ago
Jiabao Sun
8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion ( #2820 )
...
This closes #2820 .
1 year ago
Dian Qi
f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event ( #2682 )
...
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
Jiabao Sun
7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema ( #2816 )
1 year ago
Leonard Xu
18fb0d8b7f
[build][hotfix] Remove useless suppressions. ( #2817 )
1 year ago
Josh Mahonin
63b39ba22c
[cdc-source-connector][mysql] Fix attempted load of isSuspended in MySqlSplitSerializer::deserializeSplit when cdc version <= 2.2.0 ( #2550 )
...
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun
8c75db145d
[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema ( #2811 )
1 year ago
He Wang
a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs ( #2543 )
...
This closes #2543 .
1 year ago
Leonard Xu
0eae214183
[pipeline-connector][mysql] Enable send schema change by default ( #2815 )
...
This closes #2815 .
1 year ago
Hang Ruan
30c8254af3
[3.0][cdc-runtime] Remove waitForFlushSuccess field in request handler ( #2812 )
1 year ago
PengFei Li
33b7c85093
[pipeline-connector][starrocks] Add starrocks pipeline connector ( #2765 )
...
This closes #2645 .
1 year ago
Kunni
4abd86a500
[pipeline-connector][doris] add doris pipeline connector. ( #2810 )
...
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Jiabao Sun
8ca3091805
[cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema
1 year ago
Hang Ruan
1766e82d7c
[3.0][cdc-common & runtime] Remove useless flink imports
1 year ago
Jiabao Sun
08c5dfed83
[cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector
...
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun
174282d3ef
[cdc-pipeline-connector][mysql] Support more mysql types
1 year ago
Hang Ruan
ec3d558485
[cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector
1 year ago
Hang Ruan
10ccbde023
[cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent
1 year ago
Jiabao Sun
d0cce26b76
[cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource
1 year ago
Qingsheng Ren
a328f9895a
[cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments ( #2807 )
...
This closes #2807 .
1 year ago
Qingsheng Ren
9ce8450cf2
[cdc-runtime][hotfix] Setup waitFlushSuccess before responding operator to flush. ( #2805 )
...
This closes #2805 .
There might be a case that sink flushes faster than schema operator requesting release upstream. In that case waitFlushSuccess has not been set when sink has flushed successfully, which will lead to a NullPointerException.
1 year ago
Leonard Xu
95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well ( #2797 )
...
This closes #2797 .
1 year ago
Hang Ruan
e435004eda
[cdc-common][hotfix] Remove useless flink imports ( #2803 )
...
This closes #2803 .
1 year ago
Qingsheng Ren
cfb3fd206e
[build] Let surefire plugin to keep the full stacktrace on test failure ( #2804 )
...
This closes #2804 .
1 year ago
Kunni
b60322bef7
[pipeline-common] Use column name to check whether the schema contains specific column or not. ( #2801 )
...
This closes #2801 .
1 year ago
Qingsheng Ren
3bf1428233
[cdc-composer][route][sink] Add name for route and improve name for sink
1 year ago
Leonard Xu
a8f4ba8cc6
[cdc-composer][hotfix] Always chain operator by default
1 year ago
Leonard Xu
f0c630d6f6
[cdc-composer][sink] Use correct name for sink operator
1 year ago