github-forks
/
flink-cdc-connectors
mirror of https://github.com/ververica/flink-cdc-connectors.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,102 Commits
15 Branches
34 Tags
68 MiB
master
release-3.3
release-3.2
release-3.1
release-3.0
release-2.4
release-2.3
release-2.2
release-2.1
release-2.0
release-1.4
release-1.3
release-1.2
release-1.1
release-1.0
release-3.3.0
release-3.3.0-rc1
release-3.2.1
release-3.2.1-rc1
release-3.2.0
release-3.2.0-rc1
release-3.2.0-rc0
release-3.1.1
release-3.1.1-rc0
release-3.1.0
release-3.1.0-rc3
release-3.1.0-rc2
release-3.1.0-rc1
release-3.0.1
release-3.0.0
release-3.0.0-rc2
release-3.0.0-rc1
release-2.4.2
release-2.4.1
release-2.4.0
release-2.3.0
release-2.2.1
release-2.2.0
release-2.1.1
release-2.1.0
release-2.0.2
release-2.0.1
release-2.0.0
release-1.1.0
release-1.0.0
release-1.2.0
release-1.3.0
release-1.4.0
rm
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '4b13c49163'
${ noResults }
Commit Graph

299 Commits (4b13c491631b6fe067571f9aba0aeead313dfe43)

Author SHA1 Message Date
He Wang a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs (#2543) 
This closes #2543.
 1 year ago
Xin Gong 5f318346ff
[cdc-connector][debezium] Supports conversion from binary bytes to base64 encoded string (#2435) 
This closes #2435.
 1 year ago
ice f7dda3b67b
[docs][zh][hotfix] Remove redundant sections from mysql-cdc documentation (#2777) 
This closes #2777.
 1 year ago
l568288g 369be8c035 [docs][hotfix] Configuration 'slot.name' is required in mysql-postgres-tutorial-zh.md (#2763) 
This closes #2763.
 1 year ago
l568288g c853514a0d
[docs][hotfix] Configuration 'slot.name' is required in mysql-postgres-tutorial.md (#2764) 
This closes #2764.
 1 year ago
skylines 0bf378dd22
[docs] Add DataStream application package guidance (#2583) 
This closes #2583.

Co-authored-by: Leonard Xu <leonard@apache.org>
 1 year ago
skylines f697c5fff3
[hotfix][docs] Adjust the correct doc versions (#2679) 
This closes #2679.
 1 year ago
gongzhongqiang 9aed54d70f
[docs][oracle] Fix oracle cdc quick start (#2727) 
This closes #2727.
 1 year ago
Maciej Bryński 1e6b983bdd
[build] Bump Flink version to 1.18.0 (#2463) 
This closes #2670.
 1 year ago
Hongshun Wang 112b835743
[docs] Remove flink 1.13 from supported flink versions 
This closes #2526.
 1 year ago
van d1729e862a
[mongodb] Use SampleBucketSplitStrategy for shard collection with hashed keys (#2595) 1 year ago
gongzhongqiang 3cf64106c9 [oracle] Refactor oracle unit test 1 year ago
skylines c896df8056
[hotfix][docs] Fix the abnormal display of pictures (#2513) 1 year ago
skylines 58136b9977
[docs] Add contribution guidance section in document (#2411) 
Co-authored-by: gaotingkai <rookiegao712@gmail>
 1 year ago
e-mhui 420fe11c2f
[Doc] Use redo log instead of binlog in Oracle document (#2408) 1 year ago
zhaomin 6c2fe08af7
[doc] fix errors in PostgresParallelSourceExample (#2324) 2 years ago
zhaomin 65bdbfd794
[docs][oracle] Add an example of Incremental Snapshot based DataStream for Oracle CDC Connector 
This closes #2325.

Co-authored-by: skylines <34996528+gtk96@users.noreply.github.com>
 2 years ago
yuxiqian a8dd4d33cf
[mongodb] Add disableCursorTimeout option (#2332) 2 years ago
Simonas Gelazevicius 2cf3723354
[vitess] Migrate connector properties to debezium 1.9.7 (#2260) 
* feat[vitess]: Update connector properties for debezium-1.9.7

* fix: Address review comments

* fix: remove useless &ldquo and &rdquo

* fix: remove useless &nbsp
 2 years ago
Hang Ruan 69ad160515
[MySQL] Optimize how to construct config table.include.list (#2274) 2 years ago
gongzhongqiang ca9f89ab1b
[hotfix][doc] Fix doc site with 404 (#2322) 2 years ago
skylines 3797d62646
[docs] Add connector features table to help users quickly understand the supported features of each connector 
This closes #1736.
Co-authored-by: rookiegao <rookiegao712@gmail>
 2 years ago
yuxiqian 62b32713a4
[mongodb] [docs] Adds scanFullChangelog docs (#2294) 2 years ago
syyfffy 10ce714551
[docs] Update Postgres CDC documents for required slot.name option (#2270) 2 years ago
Hang Ruan 1e5063a887
[docs] add docs for the mysql tables without primary keys (#2227) 
* [docs] add docs for the mysql tables without primary keys
 2 years ago
gongzhongqiang 4c1a19c287
[hotfix] Update support version (#2255) 
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
 2 years ago
Hang Ruan 70250a7187 [docs] Update connector link to 2.5-SNAPSHOT in docs 2 years ago
gongzhongqiang 53ff798ef6
[docs][hotfix] Update debezium reference links to 1.9 version 
This closes #2225.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Co-authored-by: Leonard Xu <leonard@apache.org>
 2 years ago
Leonard Xu 92e9d9ea58
[build] Update the copyright year to 2023 (#2205) 2 years ago
gongzhongqiang c8d4181cb9
[doc][hotfix] Fix driver version and correct vitess doc path (#2224) 
* [doc][hotfix] Fix driver version and correct vitess doc path
---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
 2 years ago
Simonas Gelazevicius e349cb1a83 [vitess] Add Vitess CDC connector (#456) 
Co-authored-by: gintarasm <gintaras.matulas@gmail.com>
 2 years ago
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216) 
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
 2 years ago
Jiabao Sun aff5b0566d
[mongodb] Support specific timestamp startup mode. (#2207) 2 years ago
Jiabao Sun be9e6574b5
[doc] Add docs for close idle readers feature. (#2208) 
* [doc] Add docs for close idle readers feature
 2 years ago
Jiabao Sun d9ea355752
[mongodb] Add support for mongodb+srv connection protocol. (#2203) 2 years ago
He Wang 888f92d1a2
[oceanbase] add jdbc options and support oracle mode (#1854) 2 years ago
He Wang c2a6456ad0
[oceanbase] support libobcdc 4.x and fix restore timestamp config (#2161) 2 years ago
gongzhongqiang 8cef4af544
[sqlserver] Sqlserver incremental source. (#1732) 
* [sqlserver] Sqlserver incremental source

---------

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
 2 years ago
He Wang c8c8107bf0
[OceanBase][test] Update oceanbase and oblogproxy docker image (#2060) 2 years ago
Sergey Nuyanzin c3a88f0638
[common] Bump flink to 1.17.0 (#2057) 
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
 2 years ago
skylines 2d0cfeb1d3
[doc] add mongodb cdc chinese doc (#2042) 2 years ago
ZhongLinLeo bc7d9631e9
[docs][db2] Correct CHAR(n) to CHARACTER(n) (#2052) 
Co-authored-by: lin.zl <lin.zl@dtwave-inc.com>
 2 years ago
Hang Ruan 727a0706a8
[postgres] Change config option slot.name to be required (#1996) 2 years ago
Leonard Xu a5b195cce9 [docs] Update the outdated DingTalk QR code 2 years ago
bb chen fb3cce33fd [hotfix][docs] Correct the flink file path in MySQL docs 2 years ago
Jiabao Sun 22f68d321d
[ci] Fix for dubious repo ownership issue (#1843) 2 years ago
skylines c98971ec1c
[docs] Update mysql-cdc.md to recommend latest version (#1842) 2 years ago
wangxiaojing 00fe5ad922
[docs][sqlserver] Update data type mapping (#1802) 
* [DOC ] Update data type mapping

* Delete doc format,change all types testcase

* Delete  format

* code format

* Update sink table schema

Co-authored-by: wangxiaojing <wangxiaojing@lixiang.com>
 2 years ago
molsionmo 00fea60110
[docs][oracle] Add new introduced config options from incremental snapshot framework (#1719) 2 years ago
xixingya 7a2312cde1
[hotfix][docs] Correct the startup option's data type in Mysql docs and duplicate batch.size in MongoDB docs (#1751) 2 years ago
Leonard Xu 8132bc8a51 [hotfix][docs] Correct the mysql driver version in MySQL docs 2 years ago
Leonard Xu cdbec16710 [docs][site] update the supported cdc connectors picture 2 years ago
ehui 774c339a1d
[oracle] Add missing supported config options for oracle table source (#1727) 2 years ago
Qingsheng Ren f2d2b98a3e [mysql] Improve error message under the case that start reading from earliest but schema change happened before (#1724) 2 years ago
Leonard Xu 0fde9eb55c [docs][oceanbase][zh] Update outdated sections and translate them to Chinese 2 years ago
Leonard Xu bad00e56a3 [hotfix][docs] Upgrade the version in link to 2.4-SNAPSHOT 2 years ago
Leonard Xu 96162848b4 [hotfix][docs] Add link for Oceanbase ZH docs 2 years ago
Amber Moe dd19da6ff1 [docs][oceanbase] Add Chinese documents for oceanbase-cdc connector(#1611) 
This closes #1611.
 2 years ago
gongzhongqiang 20ef0aea62
[db2] Fix stream api example in db2 doc. (#1714) 
* [db2] Fix db2 doc.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
 2 years ago
Leonard Xu a7f1970e1f [build] Bump version to 2.4-SNAPSHOT 2 years ago
Leonard Xu 3a198250b6 [docs] Update the flink cdc picture with supported database vendors. 2 years ago
jiabao.sun 086634666f [docs][mongodb] Add docs for MongoDB incremental source 2 years ago
Hang Ruan 9bbfcb477d [docs] Bump Flink version to 1.16.0 2 years ago
Hang Ruan 8685fd4027
[docs] Bump connector version to flink 1.15.2 in docs (#1684) 2 years ago
Jiabao Sun aee88f947c
[hotfix][docs] Correct reference link for DB2 docs (#1683) 2 years ago
Qingsheng Ren 4e63851c6a [mysql] Update docs of specifying starting offset feature of MySQL CDC source 2 years ago
Jiabao Sun 301e5a8ab0 [mongodb] Support incremental snapshot for MongoDB CDC Connector 2 years ago
skylines 21ba3b05a2
[hotfix][docs] Fix db2 doc download link (#1681) 2 years ago
Leonard Xu f8f1a64081 [docs][db2] Add Db2 CDC connector doc link 2 years ago
Hang Ruan a5f6657046 [docs][db2] Add Db2 cdc connector docs 2 years ago
He Wang b1b092c97e
[oceanbase] Add new deserialization schema with runtime converter (#1356) 
This closes #980.
 2 years ago
fbad aac6e31718 [postgres] Introduce changelog mode configuration with upsert/all modes 2 years ago
hehuiyuan 7b4f31b4e4
[hotfix][docs] Fix docs for scan.incremental.snapshot.chunk.size (#1617) 2 years ago
Amber Moe 0e4954b4e6 [docs][oceanbase][zh] Add video tutorials that synchronizes data from OceanBase to Elasticsearch (#1604) 
This closes #1601
 2 years ago
Amber Moe 500aa85d92 [docs][oceanbase] Add video tutorials that synchronizes data from OceanBase to Elasticsearch (#1605) 
This closes #1605
 2 years ago
leixin 569c6a525b
[docs][mysql] Add regex examples for multiple tables (#1564) 
Co-authored-by: leixin1 <leixin1@jd.com>
 2 years ago
leixin dbd184ec36
[docs][mysql] Update the description of mysql server-time-zone option (#1497) 
Co-authored-by: leixin1 <leixin1@jd.com>
 2 years ago
JiaJia 11c1d84dfa
[docs][postgres] Add two frequently debezium options in Postgres connector document (#1142) 
This closes #1142.
 3 years ago
skylines 1b17a751cc
[hotfix][docs] Fix the page links in MySQL Chinese document (#1466) 
This closes #1466.
 3 years ago
He Wang d0d40d05c7
[oceanbase][test] Use memory mode of obcdc and double startup timeout duration (#1474) 
This closes #1473.
 3 years ago
He Wang e83810ff67
[oceanbase] Use utc offset as 'server-time-zone' option's default value (#1443) 3 years ago
dujie 0292a39a3c [oracle] Support custom JDBC URL for Oracle (#1258) 
This closes #1244.
 3 years ago
empcl 45fd69692f
[docs] Correct the data type of 'server-id' option to String (#1444) 
Co-authored-by: chenlei677 <chenlei677@jd.com>
 3 years ago
He Wang 2de4903261
[oceanbase] Introduce 'table-list' option to support capture list of tables (#1369) 
This closes #1369.
 3 years ago
Leonard Xu 52368e5b87 [docs] Improve MySQL ZH document and update the outdated links (#1435) 
This closes #1435.
 3 years ago
rookiegao 5eabe38aef [docs] Translate mysql cdc doc to Chinese (#1391) 
This closes #1391.
 3 years ago
gongzhongqiang 657f4364d5 [docs] Add step up SQLServer Database cdc document in sqlserver-cdc.md. 3 years ago
Jiabao Sun 02eca305d2
[mongodb] Expose batch.size config option for table source. (#1387) 
* [mongodb] Expose batch.size config option for table source.
 3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390) 
This closes #1389.
 3 years ago
gongzhongqiang bc11657855
[docs] Fix a typo in sqlserver-cdc.md (#1382) 3 years ago
hsldymq 1c55a879ec
[docs] Fix typo in mysql-cdc.md (#1364) 3 years ago
xieyi888 0cc58141eb
[docs] Fix a typo in tidb-cdc.md  (#1215) 
Signed-off-by: Yi Xie <xieyi01@rd.netease.com>

Co-authored-by: Yi Xie <xieyi01@rd.netease.com>
 3 years ago
Hang Ruan 75d70518c1
[docs] Add all supported type mapping for mysql cdc connector (#1373) 3 years ago
He Wang be4249156e
[oceanbase] Introduce more config options of log proxy and improve the oceanbase connector(#1234) 
This PR closes #1202 and #1287.

1.Add logproxy.client.id, config-url and working-mode params for libobcdc
2.Fix timezone config for change events reading.
3.Sort class fields in order of [common properties -> snapshot properties -> change events properties]
4.Use official docker image in tests.
5.update logproxy-client to 1.0.5
 3 years ago
pacino 5ee2233e34
[mongodb][doc] Fix meta field collection_name of metadata sql example (#1290) 3 years ago
Jiabao Sun 893e934f74
[docs][mongodb] Update document about MongoDB database and collection regex filter (#1089) 3 years ago
Leonard Xu 59b310a24c [common] Bump debezium version to 1.6.4.Final 3 years ago
gongzhongqiang b89c80d667
[tidb] Test TiDB 6.0.0 and add it to supported list (#1057) 3 years ago
阿洋 cc27d1e488 [docs][mysql] Fix connector document link error (#1043) 
This close #1043.
 3 years ago
gongzhongqiang eccd748287
[sqlserver] Add more supported(tested) SqlServer versions (#1050) 3 years ago
Leonard Xu 21075cebb7 [docs] Update the supported sink vendors 3 years ago
skylines 85db463dd2
[docs][mysql] Add note to make the tableList usage and dependencies clearer (#1019) 
Co-authored-by: 高廷凯 <gaotk@dtinsure.com>
 3 years ago
Jiabao Sun d002cda9f7
[hotfix][docs] Fix misspell of docs title 3 years ago
wangminchao bb6d3d8cb6 [docs] Add example for Scan Newly Added tables feature (#1016) 
This closes #1016.
 3 years ago
hele.kc 4761804ffd
[hotfix][docs] Fix jar link for PolarDB-X doc. (#1012) 3 years ago
Leonard Xu 1d7fdac24e [build] Bump version to 2.3-SNAPSHOT 3 years ago
Leonard Xu 6a8543f8dd [docs] Update the supported database vendors and improve the notes. 3 years ago
hele.kc 245b920244
[docs][mysql][polardbx] Add polardbx tutorials (#1003) 
Co-authored-by: hele.kc <hele.kc@alibaba-inc.com>
 3 years ago
Xuebing Li d6f7cb696d
[docs][mysql] Remove redundant docker environment variable in tutorials (#1005) 3 years ago
Leonard Xu 2b71309582 [cdc-base] Add MySQL Incremental Source to validate the Incremental Snapshot Framework 3 years ago
Leonard Xu 3ef4f2fa31 [cdc-base] Improve the Incremental Snapshot Interfaces 3 years ago
Konstantin Knauf 60d15fb566
clarify ownership to comply with ASF trademark policies (#1000) 3 years ago
Leonard Xu c11a98a3cb [hotfix][site] Use Flink with its trademark 3 years ago
Leonard Xu b2ddad7316
[docs] Adopt the full name 'Apache Flink' with its trademark notice (#988) 3 years ago
Leonard Xu 2f724f3b5f [docs][mysql] Correct the jdbc driver version in documentation 3 years ago
Leonard Xu 996c446317 [docs] Organize the connector docs in alphabetical order 3 years ago
gongzhongqiang 7ad375643c [docs][tidb] Add tidb cdc connector document 
This closes #959.
 3 years ago
gongzhongqiang 2455f10e94 [hotfix][docs] Fix typo in tidb-tutorial.md and tidb-tutorial-zh.md 3 years ago
He Wang efa3f8cd0a [docs][oceanbase] Add quickstart tutorials for OceanBase CDC connector 3 years ago
He Wang b7534ee48d [docs][oceanbase] Add docs for OceanBase CDC connector 3 years ago
Leonard Xu 8ef398d102 [docs][site] Add favicon fot website index html 3 years ago
tsreaper 8c3dfda48e
[docs][site] Introduce static index html for the project website (#961) 3 years ago
Leonard Xu 7b16dc2b98 [docs][tidb] Add index for tidb tutorial docs 3 years ago
gongzhongqiang bd70a18769
[tidb][docs] Add tidb connector tutorial (#938) 3 years ago
hele.kc 5ab71318fd
[docs] List supported databases in docs (#954) 3 years ago
He Wang bd6936b417
[docs] Fix download url in mongodb tutorial (#951) 
This closes #951.
 3 years ago
Jiabao Sun 473e36b9cd
[mongodb] Match multiple database and collection names using a regular expression in MongoDB. (#940) 
Co-authored-by: Bobby Richard <bobbyrlg@gmail.com>
 3 years ago
Paul Zhang 580391b6ee
[mysql] Allow custom JDBC URL parameters in MySQL CDC source (#921) 3 years ago
Qingsheng Ren 2a704e551c [mysql] Improve mysql heartbeat feature and tests 
This closes #927.
 3 years ago
camelusluo 3cb6a815dc [mysql] Original implementation of mysql heartbeat feature 3 years ago
gongzhongqiang f2d420f1b9
[docs] Fix the outdated link of flink download link (#922) 3 years ago
Paul Zhang 8002de4a5b
[common] Allow user to pass custom JsonConverter configs in JsonDebeziumDeserializationSchema (#615) 3 years ago
Leonard Xu 3f26906425
[format][changelog-json] Remove the support of changelog-json format (#912) 3 years ago
Leonard Xu 7fc9c9ded0
[docs] Update the supported flink version mapping (#885) 3 years ago
gongzhongqiang 38ba603c1a [docs][sql-server] Add sqlserver-cdc connector tutorial (#687) 
This closes #687.
 3 years ago
gongzhongqiang 40034abe01
[docs][sqlserver] Add SqlServer CDC connector document (#705) 3 years ago
szgeqin ab828aca2f
[doc][sqlserver] Add SqlServer English tutorial document. (#693) 3 years ago
luoyuxia 6964cc6d1d
[docs][oracle] Add guidance about oracle CDB database (#792) 3 years ago
eastfisher 77e9b44837
[docs] Add connection.pool.size and connect.max-retries option in mysql document (#857) 3 years ago
Paul Zhang df295d80b5
[docs] Fix typo in mongodb-cdc.md (#836) 3 years ago
skylines aae7dc2075
[docs] Translate the Chinese FAQ document to English (#737) 3 years ago
Leonard Xu b9264433ca
[docs] Remove the fixed version of website (#730) 3 years ago
wysstartgo f1f39a7530
[docs] Add FAQ for tableList option usage in DataStream API (#634) 
Co-authored-by: Leonard Xu <leonard@apache.org>
 3 years ago
paul8263 cf1a72e4d4
[docs] Improve column name note in oracle cdc document. (#625) 3 years ago
Leonard Xu d8fafdd7cf
[docs] Add Flink cdc eco-system picture (#623) 3 years ago
paul8263 c2957bdbc3
[hotfix][docs] Fix typo in oracle-cdc.md (#613) 3 years ago
Mustang Kong a537d45357
[docs] Add supported Flink versions for Flink CDC 2.1(#611) 3 years ago
Leonard Xu 6174c7e690 [build] Bump version to 2.2-SNAPSHOT 3 years ago
Leonard Xu 997651427f
[hotfix][mysql] Fix number overflow in ObjectUtils.minus (#598) 3 years ago
luoyuxia aa5a2eed4d
[docs] Add tutorial about building real-time data lake for MySQL sharding table with Flink CDC (#551) 3 years ago