3bf886b94d
[cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source ( #2901 )
1 year ago
35d3c0ff28
[cdc-base][hotfix] Fix SourceSplitSerializer to get totalFinishedSplitSize from recovery in 4th version
...
This closes #2992 .
1 year ago
146ed9d0be
[hotfix][cdc-common] Fix NoSuchMethodError of CollectionUtil.newHashMapWithExpectedSize
...
This closes #2943
1 year ago
a24c5d1b24
[cdc][e2e] Unify logic to clean docker image when connector e2e test finished ( #2978 )
1 year ago
f3762a1b30
[pipeline-connector][mysql] fix timestamp with timezone format ( #2952 )
...
* fix ts with tz parser
* test timestamp with default value
* fix related test
* use timestamp string in test cases
1 year ago
557944488b
[doc] fix invalid page in website and update yaml in tutorial.
...
This closes #2966 .
1 year ago
15a734efa0
[cdc-connector][oracledb] Fix oracle read exceed high_watermark in backfill phase
1 year ago
1b643026fe
[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector ( #2895 )
1 year ago
812c33d27b
[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe ( #2954 )
1 year ago
b42bc60ab9
[source-connector][mysql] speedup searching binlog by timestamp ( #2924 )
...
* [feature] speedup search mysql binlog when mysql-cdc-connector consume binlog by timestamp
* improve code
* improve code
* code improve
* test case add and code improve
* code improve
* code improve
* code improve, ut add and bugfix for purged log
---------
Co-authored-by: TJX2014 <tangjinxin@deepexi.com>
1 year ago
7ab1e87842
[build] Add github labeler for pipeline connector. ( #2851 )
1 year ago
cebfe2e5ca
[docs][cdc-connector][oceanbase] update docker image and os compatibility in quickstart ( #2897 )
...
* [docs][cdc-connector] update docker image and description in oceanbase quickstart
* revert removal by accident
1 year ago
c12c44d969
[docs] Add Supported Connectors and Supported Flink Versions to Overview. ( #2920 )
1 year ago
055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. ( #2886 )
1 year ago
a5fa2dc6c8
[hotfix][cdc-connector][mysql] Expose row_kind metadata column for mysql cdc source. ( #2927 )
...
We use 'row_kind' name instead of 'op' or 'op_type', the operation type is a concept of database and database only has 'update'
type and hasn't 'update_before' and 'update_after' type.
1 year ago
8eba910063
[cdc-connector][mysql] Support metadata 'operation' virtual column for MySql Connector. ( #2913 )
1 year ago
6b6d9fcb0b
[cdc-connector][mongodb] Avoid mongodb source to read data after high_watermark in backfill phase ( #2893 )
1 year ago
26dfeeb563
[cdc-connector][oceanbase] Fallback to current timestamp when query gts failure ( #2868 )
1 year ago
2c557c6a78
[cdc-connector][sqlserver][tests] Fix UT errors by correcting right output ( #2864 )
1 year ago
1839fb556c
[hotfix][docs] Change the title to keep the document format uniform ( #2871 )
1 year ago
08beca52d0
[cdc] Add Deprecated annotation to source function which connector implemented incremental
1 year ago
f7d6adc28b
[hotfix] Remove mysqlToDoris.yml
1 year ago
f2c81c7d08
[hotfix] Fix BinaryRecordData deserialize
1 year ago
568ed79005
[postgres] Add commits of PostgresConnection back to distinguish with debezium's origin class ( #2839 )
1 year ago
e6bb8e9a55
[hotfix][cdc-rumtime][minor] Clean up useless code in BinaryRecordDataSerializer ( #2845 )
...
Co-authored-by: xuyu <11161569@vivo.com>
1 year ago
f2c0a03269
[pipeline-connector][starrocks][docs] Fix the pictures do not display ( #2860 )
1 year ago
12836e5560
[docs][pipeline-connector][doris] Introduce Doris Pipeline Connector ( #2788 )
1 year ago
78dc8ba9e7
[docs][pipeline-connector][starrocks] Add documents for StarRocks pipeline connector ( #2840 )
...
This close #2840 .
1 year ago
8be7bdd25d
[3.0][docs] Add tutorial for mysql to starrocks pipeline ( #2841 )
1 year ago
08d6b8178f
[cdc-connector][sqlserver] Fix SqlServerTableSource params order error ( #2847 )
1 year ago
43bd5c01b2
[3.0][docs] Add tutorial for mysql to doris pipeline. ( #2838 )
1 year ago
f15faac298
[docs] Fix overview docs to remove prefix of pipeline options ( #2833 )
1 year ago
b9615db694
[3.0][docs] fix mysql pipeline connector option in readme ( #2834 )
1 year ago
2088f89ed8
[3.0][docs] Add documents for MySql pipeline connector ( #2827 )
1 year ago
f2c2e64491
[3.0][docs] Introduce core concepts for CDC 3.0 pipeline ( #2790 )
...
This closes #2655 .
1 year ago
db5743ce00
[docs] Add CDC pipeline example in README ( #2819 )
...
Co-authored-by: guiyuan.hx <guiyuan.hx@alibaba-inc.com>
1 year ago
72bcb1df02
[pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks ( #2829 )
1 year ago
c484bb447c
[build][hotfix] Remove duplicate dependency ( #2828 )
1 year ago
6cb2ffe2fb
[cdc-cli][cdc-composer] Use "source-table" and "sink-table" as keywords of route ( #2823 )
1 year ago
73086c4f37
[cdc-cli][cdc-dist] Support loading global config from FLINK_CDC_HOME ( #2822 )
...
This closes #2822 .
1 year ago
9415260a25
[cdc-common][hotfix] Remove redundant prefix of pipeline options ( #2821 )
...
This closes #2821 .
1 year ago
4616092195
[cdc-source-connector][oceanbase][e2e] Add OceanBase e2e test case ( #2521 )
...
This closes #981
1 year ago
0c8f5eaf0a
[build] Use flink-shaded-force-shading to force all submodules to generate dependency-reduced-pom.xml
...
This will erase all properties in dependency-reduced-pom.xml and
pin all properties to a constant value. For example, ${flink.version}
will be replaced by the actual Flink version, which is safer for users
to reference it.
1 year ago
daceb42168
[build] Use ${project.version} instead of ${revision} for dependency version
...
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
c0ee1c188e
[build] Skip maven-deploy-plugin for test modules and flink-cdc-dist
1 year ago
8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion ( #2820 )
...
This closes #2820 .
1 year ago
f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event ( #2682 )
...
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema ( #2816 )
1 year ago
18fb0d8b7f
[build][hotfix] Remove useless suppressions. ( #2817 )
1 year ago
63b39ba22c
[cdc-source-connector][mysql] Fix attempted load of isSuspended in MySqlSplitSerializer::deserializeSplit when cdc version <= 2.2.0 ( #2550 )
...
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Hongshun Wang
Hongshun Wang
Kunni
gongzhongqiang
He Wang
张田
Kunni
FocusComputing
TorinJie
joyCurry30
Leonard Xu
Xianxun Ye
skylines
xuzifu666
PengFei Li
wudi
Xin Gong
Shawn Huang
Jiabao Sun
Qingsheng Ren
Dian Qi
Josh Mahonin