Commit Graph

289 Commits (master)

Author SHA1 Message Date
Shawn Huang 80920aaa28
[FLINK-35297][mysql] Add validation for option connect.timeout because of HikariConfig limitation (#3295) 8 months ago
yux 2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options 8 months ago
GOODBOY008 7d35f3c1d3 [FLINK-35545][doc] Revert dbz doc 2.0 back to 1.9 8 months ago
yux b1e157468a
[FLINK-35527][docs] Polish quickstart guide & migrate maven links from ververica to apache 8 months ago
Muhammet Orazov 5b28d1a579
[FLINK-35129][postgres] Introduce scan.lsn-commit.checkpoints-num-delay option to control LSN offset commit lazily
This close #3349.
8 months ago
gongzhongqiang 644b5c2ce1
[FLINK-35431][doc] Migrate references in Flink CDC documentation from Debezium 1.9 to 2.0 to avoid dead links
This closes #3351.
8 months ago
PONYLEE b33e6a047d
[minor][docs] Improve the answer of MySQL CDC FAQ docs
This closes  #3337.
8 months ago
Wink d0457f7d24
[FLINK-35314][cdc] Add Flink CDC pipeline transform user document (#3308) 9 months ago
yux 8d2d2a65d9
[hotfix][docs] Fix dead links in documentations
This closes  #3314.
9 months ago
yux 0f5584b20a
[minor][docs] Rectify names of CDC sources for Flink and improve the content directory
This closes #3310.
9 months ago
Junbo wang b6cfbccd36
[hotfix][docs] Correct example configuration for Paimon warehouse path 9 months ago
yux 4609f5f155
[minor][docs] Fix route definition example in core concept docs (#3269) 9 months ago
yux a513e9f82e
[FLINK-35258][cdc][doc] Fix broken links to Doris in documentation (#3276) 9 months ago
yux 185f71978d
[minor][cdc][docs] Add user guide about providing extra jar package in quickstart docs 9 months ago
He Wang 05281e5d6f
[FLINK-34639][cdc][oceanbase] Support debezium deserializer in OceanBase source connector (#3124) 9 months ago
gong 3385ae8fbc [cdc-connector][db2] Db2 support incremental source 9 months ago
yux de4be372f8
[hotfix][e2e] Fix pipeline e2e test cases failures (#3246) 9 months ago
Kunni ef2eece256
[pipeline-connector][paimon] add paimon pipeline data sink connector. (#2916) 9 months ago
yux 01ec7da989
[FLINK-35055][cdc] Exclude connector dependencies with questionable licenses from fat jar packages (#3212) 9 months ago
Kunni 253ef9256b
[pipeline-connector][kafka] Add kafka pipeline data sink connector. (#2938) 9 months ago
yux 313726b096
[minor][cdc][docs] Fix outdated StarRocks quickstart guide 9 months ago
Thorne 0d797a6021
[FLINK-34903][cdc][mysql] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables (#3186) 10 months ago
xleoken ef9491b78c
[minor][cdc][docs] Optimize markdown styles in quickstart doc 10 months ago
Laffery 9d150c07a3
[docs] [minor] Optimize styles of the Flink CDC website homepage
This closes #3208.
10 months ago
Kunni b10a666e3e
[FLINK-34613][cdc] Support recover from a specific savepoint file (#2959) 10 months ago
Shawn Huang 927a0ec474
[FLINK-34753][cdc][docs] Improve and update outdated mongodb cdc FAQ 10 months ago
gongzhongqiang 1c69a650e3
[FLINK-34732][cdc][ci] Add document dead link check for Flink CDC Documentation (#3168) 10 months ago
Kunni 0ab57ac1ab
[FLINK-34770][cdc][doc] Fix outdated download links of legacy connector jars
This closes  #3182.
11 months ago
Hongshun Wang 43a5887cd7
[FLINK-34741][cdc][docs] Translate get-started page for Flink CDC doc to Chinese
This closes #3175.
11 months ago
Kunni bacb6a3b60
[FLINK-34740][cdc][doc-zh] Translate legacy cdc source docs to Chinese
This closes #3174.
11 months ago
Hongshun Wang 18fa3c5dc4
[FLINK-34742][cdc][docs] Translate "FAQ" Page for Flink CDC Chinese Documentation
This closes  #3173.
11 months ago
Qingsheng Ren 88c9cf2146
[FLINK-34677][cdc] Synchronize Chinese documentations for Flink CDC (#3169) 11 months ago
Hongshun Wang 8098a9ca3e
[FLINK-34724][docs] Fix broken web link in document of legacy Flink CDC Sources (#3167) 11 months ago
Shawn Huang 32c8e0bc2a
[FLINK-34686][cdc] add docs about yarn deployment (#3163) 11 months ago
Kunni e93cc833f9
[FLINK-34681][cdc][doc] add standalone.md under deployment directory. (#3166) 11 months ago
Kunni 1fd0cfec89
[FLINK-34685][cdc][doc] add kubernetes.md under deployment directory. (#3165) 11 months ago
Leonard Xu a954daba1b
[minor][cdc][docs] Improve the quickstart examples for Flink CDC docs
This closes #3164.
11 months ago
kunni e73f3adaa3
[FLINK-34679][cdc][docs] Add core concept pages for Flink CDC docs
This closes #3153.
11 months ago
Qingsheng Ren 8fd28f1788
[FLINK-34680][cdc][docs] Add overview page for CDC connectors and optimize connector docs
This closes #3160.
11 months ago
Qingsheng Ren 4d3da2649b
[FLINK-34682][cdc][docs] Add "Understand Flink CDC API" page for Flink CDC docs
This closes #3162.
11 months ago
Hang Ruan 776dcbab3f [FLINK-34684][cdc][docs] Add licenses page for Flink CDC docs
This closes #3159.
11 months ago
Hang Ruan 96909eae5d [FLINK-34683][cdc][docs] Add contributing page for Flink CDC docs 11 months ago
Qingsheng Ren bd760b10d7
[FLINK-34678][cdc][docs] Add introduction page for Flink CDC docs
This closes  #3158.
11 months ago
Leonard Xu 9988cae54d [FLINK-34687][cdc][docs] Build the home page of Flink CDC documentation 11 months ago
Qingsheng Ren 84ca4dd140
[FLINK-34677][cdc][dcos] Refactor the structure of Flink CDC website documentation
This closes #3146.
11 months ago
gongzhongqiang 1dc201f9b3
[FLINK-34180] Migrate doc website from ververica to flink (#3028) 11 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan a6c1b06e11 [FLINK-34184][cdc][docs] Add license for all document files
This closes #3092.
11 months ago
Check Null 167bb403a3
[hotfix][docs] fix typo 'escription' to 'description' (#3050) 1 year ago
Xin Gong 10e542c3ff
[cdc-connector][sqlserver] sqlserver support use specific chunk column as a split key (#2972)
This closes #2971.
1 year ago
Xin Gong 20e44e6966
[cdc-connector][oracle] Oracle supports user specific chunk column (#2976)
This closes #2973.
1 year ago
Xin Gong 44692aa2d2
[docs][hotfix] Update dependency version from 2.5-SNAPSHOT to 3.0-SNAPSHOT (#2994) 1 year ago
Kunni 557944488b
[doc] fix invalid page in website and update yaml in tutorial.
This closes #2966.
1 year ago
He Wang cebfe2e5ca
[docs][cdc-connector][oceanbase] update docker image and os compatibility in quickstart (#2897)
* [docs][cdc-connector] update docker image and description in oceanbase quickstart

* revert removal by accident
1 year ago
TorinJie c12c44d969
[docs] Add Supported Connectors and Supported Flink Versions to Overview. (#2920) 1 year ago
Leonard Xu a5fa2dc6c8
[hotfix][cdc-connector][mysql] Expose row_kind metadata column for mysql cdc source. (#2927)
We use 'row_kind' name instead of 'op' or 'op_type', the operation type is a concept of database and database only has 'update'
type and hasn't 'update_before' and 'update_after' type.
1 year ago
Xianxun Ye 8eba910063
[cdc-connector][mysql] Support metadata 'operation' virtual column for MySql Connector. (#2913) 1 year ago
skylines 1839fb556c
[hotfix][docs] Change the title to keep the document format uniform (#2871) 1 year ago
PengFei Li f2c0a03269
[pipeline-connector][starrocks][docs] Fix the pictures do not display (#2860) 1 year ago
wudi 12836e5560
[docs][pipeline-connector][doris] Introduce Doris Pipeline Connector (#2788) 1 year ago
PengFei Li 78dc8ba9e7
[docs][pipeline-connector][starrocks] Add documents for StarRocks pipeline connector (#2840)
This close #2840.
1 year ago
Kunni 8be7bdd25d
[3.0][docs] Add tutorial for mysql to starrocks pipeline (#2841) 1 year ago
Kunni 43bd5c01b2
[3.0][docs] Add tutorial for mysql to doris pipeline. (#2838) 1 year ago
Hongshun Wang f15faac298
[docs] Fix overview docs to remove prefix of pipeline options (#2833) 1 year ago
Jiabao Sun 2088f89ed8
[3.0][docs] Add documents for MySql pipeline connector (#2827) 1 year ago
Hongshun Wang f2c2e64491
[3.0][docs] Introduce core concepts for CDC 3.0 pipeline (#2790)
This closes #2655.
1 year ago
He Wang a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs (#2543)
This closes #2543.
1 year ago
Xin Gong 5f318346ff
[cdc-connector][debezium] Supports conversion from binary bytes to base64 encoded string (#2435)
This closes #2435.
1 year ago
ice f7dda3b67b
[docs][zh][hotfix] Remove redundant sections from mysql-cdc documentation (#2777)
This closes #2777.
1 year ago
l568288g 369be8c035 [docs][hotfix] Configuration 'slot.name' is required in mysql-postgres-tutorial-zh.md (#2763)
This closes #2763.
1 year ago
l568288g c853514a0d
[docs][hotfix] Configuration 'slot.name' is required in mysql-postgres-tutorial.md (#2764)
This closes #2764.
1 year ago
skylines 0bf378dd22
[docs] Add DataStream application package guidance (#2583)
This closes #2583.

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
skylines f697c5fff3
[hotfix][docs] Adjust the correct doc versions (#2679)
This closes #2679.
1 year ago
gongzhongqiang 9aed54d70f
[docs][oracle] Fix oracle cdc quick start (#2727)
This closes #2727.
1 year ago
Maciej Bryński 1e6b983bdd
[build] Bump Flink version to 1.18.0 (#2463)
This closes #2670.
1 year ago
Hongshun Wang 112b835743
[docs] Remove flink 1.13 from supported flink versions
This closes #2526.
1 year ago
van d1729e862a
[mongodb] Use SampleBucketSplitStrategy for shard collection with hashed keys (#2595) 1 year ago
gongzhongqiang 3cf64106c9 [oracle] Refactor oracle unit test 1 year ago
skylines c896df8056
[hotfix][docs] Fix the abnormal display of pictures (#2513) 1 year ago
skylines 58136b9977
[docs] Add contribution guidance section in document (#2411)
Co-authored-by: gaotingkai <rookiegao712@gmail>
1 year ago
e-mhui 420fe11c2f
[Doc] Use redo log instead of binlog in Oracle document (#2408) 1 year ago
zhaomin 6c2fe08af7
[doc] fix errors in PostgresParallelSourceExample (#2324) 2 years ago
zhaomin 65bdbfd794
[docs][oracle] Add an example of Incremental Snapshot based DataStream for Oracle CDC Connector
This closes #2325.

Co-authored-by: skylines <34996528+gtk96@users.noreply.github.com>
2 years ago
yuxiqian a8dd4d33cf
[mongodb] Add disableCursorTimeout option (#2332) 2 years ago
Simonas Gelazevicius 2cf3723354
[vitess] Migrate connector properties to debezium 1.9.7 (#2260)
* feat[vitess]: Update connector properties for debezium-1.9.7

* fix: Address review comments

* fix: remove useless &ldquo and &rdquo

* fix: remove useless &nbsp
2 years ago
Hang Ruan 69ad160515
[MySQL] Optimize how to construct config table.include.list (#2274) 2 years ago
gongzhongqiang ca9f89ab1b
[hotfix][doc] Fix doc site with 404 (#2322) 2 years ago
skylines 3797d62646
[docs] Add connector features table to help users quickly understand the supported features of each connector
This closes #1736.
Co-authored-by: rookiegao <rookiegao712@gmail>
2 years ago
yuxiqian 62b32713a4
[mongodb] [docs] Adds scanFullChangelog docs (#2294) 2 years ago
syyfffy 10ce714551
[docs] Update Postgres CDC documents for required slot.name option (#2270) 2 years ago
Hang Ruan 1e5063a887
[docs] add docs for the mysql tables without primary keys (#2227)
* [docs] add docs for the mysql tables without primary keys
2 years ago
gongzhongqiang 4c1a19c287
[hotfix] Update support version (#2255)
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Hang Ruan 70250a7187 [docs] Update connector link to 2.5-SNAPSHOT in docs 2 years ago
gongzhongqiang 53ff798ef6
[docs][hotfix] Update debezium reference links to 1.9 version
This closes #2225.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Co-authored-by: Leonard Xu <leonard@apache.org>
2 years ago
gongzhongqiang c8d4181cb9
[doc][hotfix] Fix driver version and correct vitess doc path (#2224)
* [doc][hotfix] Fix driver version and correct vitess doc path
---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Simonas Gelazevicius e349cb1a83 [vitess] Add Vitess CDC connector (#456)
Co-authored-by: gintarasm <gintaras.matulas@gmail.com>
2 years ago
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
2 years ago
Jiabao Sun aff5b0566d
[mongodb] Support specific timestamp startup mode. (#2207) 2 years ago
Jiabao Sun be9e6574b5
[doc] Add docs for close idle readers feature. (#2208)
* [doc] Add docs for close idle readers feature
2 years ago
Jiabao Sun d9ea355752
[mongodb] Add support for mongodb+srv connection protocol. (#2203) 2 years ago