Commit Graph

334 Commits (aeebf674ba6a054a57a9ab08d3493475c4b624bf)

Author SHA1 Message Date
Kunni 1fd0cfec89
[FLINK-34685][cdc][doc] add kubernetes.md under deployment directory. (#3165) 11 months ago
Leonard Xu a954daba1b
[minor][cdc][docs] Improve the quickstart examples for Flink CDC docs
This closes #3164.
11 months ago
kunni a332fad3c6
[FLINK-34671][cdc][docs] Update README file of Flink CDC project
This closes #3152.
11 months ago
kunni e73f3adaa3
[FLINK-34679][cdc][docs] Add core concept pages for Flink CDC docs
This closes #3153.
11 months ago
Qingsheng Ren 8fd28f1788
[FLINK-34680][cdc][docs] Add overview page for CDC connectors and optimize connector docs
This closes #3160.
11 months ago
Qingsheng Ren 4d3da2649b
[FLINK-34682][cdc][docs] Add "Understand Flink CDC API" page for Flink CDC docs
This closes #3162.
11 months ago
Hang Ruan 776dcbab3f [FLINK-34684][cdc][docs] Add licenses page for Flink CDC docs
This closes #3159.
11 months ago
Hang Ruan 96909eae5d [FLINK-34683][cdc][docs] Add contributing page for Flink CDC docs 11 months ago
Qingsheng Ren bd760b10d7
[FLINK-34678][cdc][docs] Add introduction page for Flink CDC docs
This closes  #3158.
11 months ago
Leonard Xu aa9e91ce45 [FLINK-34687][cdc][docs][zh] Build the home page of Flink CDC documentation
This closes #3156.
11 months ago
Leonard Xu 9988cae54d [FLINK-34687][cdc][docs] Build the home page of Flink CDC documentation 11 months ago
Qingsheng Ren 84ca4dd140
[FLINK-34677][cdc][dcos] Refactor the structure of Flink CDC website documentation
This closes #3146.
12 months ago
gongzhongqiang 1dc201f9b3
[FLINK-34180] Migrate doc website from ververica to flink (#3028) 12 months ago
Hang Ruan 86272bf102
[FLINK-34183][cdc][license] Update NOTICE files (#3107) 12 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
12 months ago
Hang Ruan a6c1b06e11 [FLINK-34184][cdc][docs] Add license for all document files
This closes #3092.
12 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 12 months ago
Check Null 167bb403a3
[hotfix][docs] fix typo 'escription' to 'description' (#3050) 1 year ago
Xin Gong 10e542c3ff
[cdc-connector][sqlserver] sqlserver support use specific chunk column as a split key (#2972)
This closes #2971.
1 year ago
Xin Gong 20e44e6966
[cdc-connector][oracle] Oracle supports user specific chunk column (#2976)
This closes #2973.
1 year ago
Xin Gong 44692aa2d2
[docs][hotfix] Update dependency version from 2.5-SNAPSHOT to 3.0-SNAPSHOT (#2994) 1 year ago
Kunni 557944488b
[doc] fix invalid page in website and update yaml in tutorial.
This closes #2966.
1 year ago
He Wang cebfe2e5ca
[docs][cdc-connector][oceanbase] update docker image and os compatibility in quickstart (#2897)
* [docs][cdc-connector] update docker image and description in oceanbase quickstart

* revert removal by accident
1 year ago
TorinJie c12c44d969
[docs] Add Supported Connectors and Supported Flink Versions to Overview. (#2920) 1 year ago
Leonard Xu a5fa2dc6c8
[hotfix][cdc-connector][mysql] Expose row_kind metadata column for mysql cdc source. (#2927)
We use 'row_kind' name instead of 'op' or 'op_type', the operation type is a concept of database and database only has 'update'
type and hasn't 'update_before' and 'update_after' type.
1 year ago
Xianxun Ye 8eba910063
[cdc-connector][mysql] Support metadata 'operation' virtual column for MySql Connector. (#2913) 1 year ago
skylines 1839fb556c
[hotfix][docs] Change the title to keep the document format uniform (#2871) 1 year ago
PengFei Li f2c0a03269
[pipeline-connector][starrocks][docs] Fix the pictures do not display (#2860) 1 year ago
wudi 12836e5560
[docs][pipeline-connector][doris] Introduce Doris Pipeline Connector (#2788) 1 year ago
PengFei Li 78dc8ba9e7
[docs][pipeline-connector][starrocks] Add documents for StarRocks pipeline connector (#2840)
This close #2840.
1 year ago
Kunni 8be7bdd25d
[3.0][docs] Add tutorial for mysql to starrocks pipeline (#2841) 1 year ago
Kunni 43bd5c01b2
[3.0][docs] Add tutorial for mysql to doris pipeline. (#2838) 1 year ago
Hongshun Wang f15faac298
[docs] Fix overview docs to remove prefix of pipeline options (#2833) 1 year ago
Jiabao Sun 2088f89ed8
[3.0][docs] Add documents for MySql pipeline connector (#2827) 1 year ago
Hongshun Wang f2c2e64491
[3.0][docs] Introduce core concepts for CDC 3.0 pipeline (#2790)
This closes #2655.
1 year ago
He Wang a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs (#2543)
This closes #2543.
1 year ago
Xin Gong 5f318346ff
[cdc-connector][debezium] Supports conversion from binary bytes to base64 encoded string (#2435)
This closes #2435.
1 year ago
ice f7dda3b67b
[docs][zh][hotfix] Remove redundant sections from mysql-cdc documentation (#2777)
This closes #2777.
1 year ago
l568288g 369be8c035 [docs][hotfix] Configuration 'slot.name' is required in mysql-postgres-tutorial-zh.md (#2763)
This closes #2763.
1 year ago
l568288g c853514a0d
[docs][hotfix] Configuration 'slot.name' is required in mysql-postgres-tutorial.md (#2764)
This closes #2764.
1 year ago
skylines 0bf378dd22
[docs] Add DataStream application package guidance (#2583)
This closes #2583.

Co-authored-by: Leonard Xu <leonard@apache.org>
1 year ago
skylines f697c5fff3
[hotfix][docs] Adjust the correct doc versions (#2679)
This closes #2679.
1 year ago
gongzhongqiang 9aed54d70f
[docs][oracle] Fix oracle cdc quick start (#2727)
This closes #2727.
1 year ago
Maciej Bryński 1e6b983bdd
[build] Bump Flink version to 1.18.0 (#2463)
This closes #2670.
1 year ago
Hongshun Wang 112b835743
[docs] Remove flink 1.13 from supported flink versions
This closes #2526.
1 year ago
van d1729e862a
[mongodb] Use SampleBucketSplitStrategy for shard collection with hashed keys (#2595) 1 year ago
gongzhongqiang 3cf64106c9 [oracle] Refactor oracle unit test 1 year ago
skylines c896df8056
[hotfix][docs] Fix the abnormal display of pictures (#2513) 1 year ago
skylines 58136b9977
[docs] Add contribution guidance section in document (#2411)
Co-authored-by: gaotingkai <rookiegao712@gmail>
2 years ago
e-mhui 420fe11c2f
[Doc] Use redo log instead of binlog in Oracle document (#2408) 2 years ago
zhaomin 6c2fe08af7
[doc] fix errors in PostgresParallelSourceExample (#2324) 2 years ago
zhaomin 65bdbfd794
[docs][oracle] Add an example of Incremental Snapshot based DataStream for Oracle CDC Connector
This closes #2325.

Co-authored-by: skylines <34996528+gtk96@users.noreply.github.com>
2 years ago
yuxiqian a8dd4d33cf
[mongodb] Add disableCursorTimeout option (#2332) 2 years ago
Simonas Gelazevicius 2cf3723354
[vitess] Migrate connector properties to debezium 1.9.7 (#2260)
* feat[vitess]: Update connector properties for debezium-1.9.7

* fix: Address review comments

* fix: remove useless &ldquo and &rdquo

* fix: remove useless &nbsp
2 years ago
Hang Ruan 69ad160515
[MySQL] Optimize how to construct config table.include.list (#2274) 2 years ago
gongzhongqiang ca9f89ab1b
[hotfix][doc] Fix doc site with 404 (#2322) 2 years ago
skylines 3797d62646
[docs] Add connector features table to help users quickly understand the supported features of each connector
This closes #1736.
Co-authored-by: rookiegao <rookiegao712@gmail>
2 years ago
yuxiqian 62b32713a4
[mongodb] [docs] Adds scanFullChangelog docs (#2294) 2 years ago
syyfffy 10ce714551
[docs] Update Postgres CDC documents for required slot.name option (#2270) 2 years ago
Hang Ruan 1e5063a887
[docs] add docs for the mysql tables without primary keys (#2227)
* [docs] add docs for the mysql tables without primary keys
2 years ago
gongzhongqiang 4c1a19c287
[hotfix] Update support version (#2255)
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Hang Ruan 70250a7187 [docs] Update connector link to 2.5-SNAPSHOT in docs 2 years ago
gongzhongqiang 53ff798ef6
[docs][hotfix] Update debezium reference links to 1.9 version
This closes #2225.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Co-authored-by: Leonard Xu <leonard@apache.org>
2 years ago
Leonard Xu 92e9d9ea58
[build] Update the copyright year to 2023 (#2205) 2 years ago
gongzhongqiang c8d4181cb9
[doc][hotfix] Fix driver version and correct vitess doc path (#2224)
* [doc][hotfix] Fix driver version and correct vitess doc path
---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Simonas Gelazevicius e349cb1a83 [vitess] Add Vitess CDC connector (#456)
Co-authored-by: gintarasm <gintaras.matulas@gmail.com>
2 years ago
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
2 years ago
Jiabao Sun aff5b0566d
[mongodb] Support specific timestamp startup mode. (#2207) 2 years ago
Jiabao Sun be9e6574b5
[doc] Add docs for close idle readers feature. (#2208)
* [doc] Add docs for close idle readers feature
2 years ago
Jiabao Sun d9ea355752
[mongodb] Add support for mongodb+srv connection protocol. (#2203) 2 years ago
He Wang 888f92d1a2
[oceanbase] add jdbc options and support oracle mode (#1854) 2 years ago
He Wang c2a6456ad0
[oceanbase] support libobcdc 4.x and fix restore timestamp config (#2161) 2 years ago
gongzhongqiang 8cef4af544
[sqlserver] Sqlserver incremental source. (#1732)
* [sqlserver] Sqlserver incremental source

---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
He Wang c8c8107bf0
[OceanBase][test] Update oceanbase and oblogproxy docker image (#2060) 2 years ago
Sergey Nuyanzin c3a88f0638
[common] Bump flink to 1.17.0 (#2057)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
skylines 2d0cfeb1d3
[doc] add mongodb cdc chinese doc (#2042) 2 years ago
ZhongLinLeo bc7d9631e9
[docs][db2] Correct CHAR(n) to CHARACTER(n) (#2052)
Co-authored-by: lin.zl <lin.zl@dtwave-inc.com>
2 years ago
Hang Ruan 727a0706a8
[postgres] Change config option slot.name to be required (#1996) 2 years ago
Leonard Xu a5b195cce9 [docs] Update the outdated DingTalk QR code 2 years ago
bb chen fb3cce33fd [hotfix][docs] Correct the flink file path in MySQL docs 2 years ago
Jiabao Sun 22f68d321d
[ci] Fix for dubious repo ownership issue (#1843) 2 years ago
skylines c98971ec1c
[docs] Update mysql-cdc.md to recommend latest version (#1842) 2 years ago
wangxiaojing 00fe5ad922
[docs][sqlserver] Update data type mapping (#1802)
* [DOC ] Update data type mapping

* Delete doc format,change all types testcase

* Delete  format

* code format

* Update sink table schema

Co-authored-by: wangxiaojing <wangxiaojing@lixiang.com>
2 years ago
molsionmo 00fea60110
[docs][oracle] Add new introduced config options from incremental snapshot framework (#1719) 2 years ago
xixingya 7a2312cde1
[hotfix][docs] Correct the startup option's data type in Mysql docs and duplicate batch.size in MongoDB docs (#1751) 2 years ago
Leonard Xu 8132bc8a51 [hotfix][docs] Correct the mysql driver version in MySQL docs 2 years ago
Leonard Xu cdbec16710 [docs][site] update the supported cdc connectors picture 2 years ago
ehui 774c339a1d
[oracle] Add missing supported config options for oracle table source (#1727) 2 years ago
Qingsheng Ren f2d2b98a3e [mysql] Improve error message under the case that start reading from earliest but schema change happened before (#1724) 2 years ago
Leonard Xu 0fde9eb55c [docs][oceanbase][zh] Update outdated sections and translate them to Chinese 2 years ago
Leonard Xu bad00e56a3 [hotfix][docs] Upgrade the version in link to 2.4-SNAPSHOT 2 years ago
Leonard Xu 96162848b4 [hotfix][docs] Add link for Oceanbase ZH docs 2 years ago
Amber Moe dd19da6ff1 [docs][oceanbase] Add Chinese documents for oceanbase-cdc connector(#1611)
This closes #1611.
2 years ago
gongzhongqiang 20ef0aea62
[db2] Fix stream api example in db2 doc. (#1714)
* [db2] Fix db2 doc.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Leonard Xu a7f1970e1f [build] Bump version to 2.4-SNAPSHOT 2 years ago
Leonard Xu 3a198250b6 [docs] Update the flink cdc picture with supported database vendors. 2 years ago
jiabao.sun 086634666f [docs][mongodb] Add docs for MongoDB incremental source 2 years ago
Hang Ruan 9bbfcb477d [docs] Bump Flink version to 1.16.0 2 years ago
Hang Ruan 8685fd4027
[docs] Bump connector version to flink 1.15.2 in docs (#1684) 2 years ago
Jiabao Sun aee88f947c
[hotfix][docs] Correct reference link for DB2 docs (#1683) 2 years ago
Qingsheng Ren 4e63851c6a [mysql] Update docs of specifying starting offset feature of MySQL CDC source 2 years ago
Jiabao Sun 301e5a8ab0 [mongodb] Support incremental snapshot for MongoDB CDC Connector 2 years ago
skylines 21ba3b05a2
[hotfix][docs] Fix db2 doc download link (#1681) 2 years ago
Leonard Xu f8f1a64081 [docs][db2] Add Db2 CDC connector doc link 2 years ago
Hang Ruan a5f6657046 [docs][db2] Add Db2 cdc connector docs 2 years ago
He Wang b1b092c97e
[oceanbase] Add new deserialization schema with runtime converter (#1356)
This closes #980.
2 years ago
fbad aac6e31718 [postgres] Introduce changelog mode configuration with upsert/all modes 2 years ago
hehuiyuan 7b4f31b4e4
[hotfix][docs] Fix docs for scan.incremental.snapshot.chunk.size (#1617) 2 years ago
Amber Moe 0e4954b4e6 [docs][oceanbase][zh] Add video tutorials that synchronizes data from OceanBase to Elasticsearch (#1604)
This closes #1601
2 years ago
Amber Moe 500aa85d92 [docs][oceanbase] Add video tutorials that synchronizes data from OceanBase to Elasticsearch (#1605)
This closes #1605
2 years ago
leixin 569c6a525b
[docs][mysql] Add regex examples for multiple tables (#1564)
Co-authored-by: leixin1 <leixin1@jd.com>
2 years ago
leixin dbd184ec36
[docs][mysql] Update the description of mysql server-time-zone option (#1497)
Co-authored-by: leixin1 <leixin1@jd.com>
3 years ago
JiaJia 11c1d84dfa
[docs][postgres] Add two frequently debezium options in Postgres connector document (#1142)
This closes #1142.
3 years ago
skylines 1b17a751cc
[hotfix][docs] Fix the page links in MySQL Chinese document (#1466)
This closes #1466.
3 years ago
He Wang d0d40d05c7
[oceanbase][test] Use memory mode of obcdc and double startup timeout duration (#1474)
This closes #1473.
3 years ago
He Wang e83810ff67
[oceanbase] Use utc offset as 'server-time-zone' option's default value (#1443) 3 years ago
dujie 0292a39a3c [oracle] Support custom JDBC URL for Oracle (#1258)
This closes #1244.
3 years ago
empcl 45fd69692f
[docs] Correct the data type of 'server-id' option to String (#1444)
Co-authored-by: chenlei677 <chenlei677@jd.com>
3 years ago
He Wang 2de4903261
[oceanbase] Introduce 'table-list' option to support capture list of tables (#1369)
This closes #1369.
3 years ago
Leonard Xu 52368e5b87 [docs] Improve MySQL ZH document and update the outdated links (#1435)
This closes #1435.
3 years ago
rookiegao 5eabe38aef [docs] Translate mysql cdc doc to Chinese (#1391)
This closes #1391.
3 years ago
gongzhongqiang 657f4364d5 [docs] Add step up SQLServer Database cdc document in sqlserver-cdc.md. 3 years ago
Jiabao Sun 02eca305d2
[mongodb] Expose batch.size config option for table source. (#1387)
* [mongodb] Expose batch.size config option for table source.
3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390)
This closes #1389.
3 years ago
gongzhongqiang bc11657855
[docs] Fix a typo in sqlserver-cdc.md (#1382) 3 years ago
hsldymq 1c55a879ec
[docs] Fix typo in mysql-cdc.md (#1364) 3 years ago
xieyi888 0cc58141eb
[docs] Fix a typo in tidb-cdc.md  (#1215)
Signed-off-by: Yi Xie <xieyi01@rd.netease.com>

Co-authored-by: Yi Xie <xieyi01@rd.netease.com>
3 years ago
Hang Ruan 75d70518c1
[docs] Add all supported type mapping for mysql cdc connector (#1373) 3 years ago
He Wang be4249156e
[oceanbase] Introduce more config options of log proxy and improve the oceanbase connector(#1234)
This PR closes #1202 and #1287.

1.Add logproxy.client.id, config-url and working-mode params for libobcdc
2.Fix timezone config for change events reading.
3.Sort class fields in order of [common properties -> snapshot properties -> change events properties]
4.Use official docker image in tests.
5.update logproxy-client to 1.0.5
3 years ago
pacino 5ee2233e34
[mongodb][doc] Fix meta field collection_name of metadata sql example (#1290) 3 years ago
Jiabao Sun 893e934f74
[docs][mongodb] Update document about MongoDB database and collection regex filter (#1089) 3 years ago
Leonard Xu 59b310a24c [common] Bump debezium version to 1.6.4.Final 3 years ago
gongzhongqiang b89c80d667
[tidb] Test TiDB 6.0.0 and add it to supported list (#1057) 3 years ago
阿洋 cc27d1e488 [docs][mysql] Fix connector document link error (#1043)
This close #1043.
3 years ago
gongzhongqiang eccd748287
[sqlserver] Add more supported(tested) SqlServer versions (#1050) 3 years ago
Leonard Xu 21075cebb7 [docs] Update the supported sink vendors 3 years ago
skylines 85db463dd2
[docs][mysql] Add note to make the tableList usage and dependencies clearer (#1019)
Co-authored-by: 高廷凯 <gaotk@dtinsure.com>
3 years ago
Jiabao Sun d002cda9f7
[hotfix][docs] Fix misspell of docs title 3 years ago
wangminchao bb6d3d8cb6 [docs] Add example for Scan Newly Added tables feature (#1016)
This closes #1016.
3 years ago
hele.kc 4761804ffd
[hotfix][docs] Fix jar link for PolarDB-X doc. (#1012) 3 years ago
Leonard Xu 1d7fdac24e [build] Bump version to 2.3-SNAPSHOT 3 years ago
Leonard Xu 6a8543f8dd [docs] Update the supported database vendors and improve the notes. 3 years ago
hele.kc 245b920244
[docs][mysql][polardbx] Add polardbx tutorials (#1003)
Co-authored-by: hele.kc <hele.kc@alibaba-inc.com>
3 years ago
Xuebing Li d6f7cb696d
[docs][mysql] Remove redundant docker environment variable in tutorials (#1005) 3 years ago
Leonard Xu 2b71309582 [cdc-base] Add MySQL Incremental Source to validate the Incremental Snapshot Framework 3 years ago
Leonard Xu 3ef4f2fa31 [cdc-base] Improve the Incremental Snapshot Interfaces 3 years ago
Konstantin Knauf 60d15fb566
clarify ownership to comply with ASF trademark policies (#1000) 3 years ago
Leonard Xu c11a98a3cb [hotfix][site] Use Flink with its trademark 3 years ago
Leonard Xu b2ddad7316
[docs] Adopt the full name 'Apache Flink' with its trademark notice (#988) 3 years ago
Leonard Xu 2f724f3b5f [docs][mysql] Correct the jdbc driver version in documentation 3 years ago