Commit Graph

485 Commits (dd19da6ff1721942e6da37c4e3464e9c09be1455)
 

Author SHA1 Message Date
Amber Moe dd19da6ff1 [docs][oceanbase] Add Chinese documents for oceanbase-cdc connector(#1611)
This closes #1611.
2 years ago
ehui 6d0cdbcc6e
[mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart  (#1627)
* [mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart
2 years ago
Qingsheng Ren ae51129ba3
[hotfix][docs] Exclude auto-generated files in docs from apache-rat-plugin (#1717) 2 years ago
gongzhongqiang 20ef0aea62
[db2] Fix stream api example in db2 doc. (#1714)
* [db2] Fix db2 doc.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Leonard Xu a7f1970e1f [build] Bump version to 2.4-SNAPSHOT 2 years ago
Leonard Xu 3a198250b6 [docs] Update the flink cdc picture with supported database vendors. 2 years ago
gongzhongqiang d8542cdec0
[tidb] Fix unstable TiDB region changed test. (#1702)
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
jiabao.sun 086634666f [docs][mongodb] Add docs for MongoDB incremental source 2 years ago
Leonard Xu e4dcd10ec8 [oracle][mysql] Improve the Oracle all data types test and clean up debug logs 2 years ago
Leonard Xu 228fbe650a [oracle] Properly support TIMESTAMP_LTZ type for oracle cdc connector 2 years ago
molsion b4ce19951f [oracle]support use user given column as split column 2 years ago
Leonard Xu df4b87f79e [oracle][minor] Clean up useless methods and classes 2 years ago
ehui 6fe4fc93e1 [oracle] Parallel read supports startup of startupOptions 2 years ago
ehui 4bfe694fea [oracle] Add full type field test 2 years ago
molsion a09a31495e [oracle]OracleTableSource support splitSize, fetchSize ,connectMaxRetries, connectionPoolSize and add test 2 years ago
Leonard Xu 8dd8fe6ac3 [hotfix][oracle][db2] Update the license header 2 years ago
Leonard Xu 1d5961dfec [cdc-base][oralce] Remove useless method of JdbcSourceFetchTaskContext 2 years ago
molsion f6c34cd616 [cdc-base][oracle] Improve the base methods base on Oracle specific requirements 2 years ago
ehui 4d9c0e41e1 [oracle] Support custom url for incremental snapshot source 2 years ago
molsion 94fa8b347f [oracle] Introduce SCAN_INCREMENTAL_SNAPSHOT_ENABLED option for OracleTableSourceFactory 2 years ago
molsion a94eefd90a [minor][oracle] Improve tests and code format 2 years ago
01410172 f99efd809f [oracle] Ignore testCheckpointAndRestore util DBZ-5245 and DBZ-4936 fix 2 years ago
莫贤彬 4855fa3337 [oracle][test] Add tests for Oracle incremental snapshot source 2 years ago
Enoch aeaf57b37e [oracle] Use ROWID as split column and replace limit syntax with ROWNUM 2 years ago
莫贤彬 70fb9cf5a3 [oracle] Let LogMinerStreamingChangeEventSource do not rely on oracle table LOG_MINING_FLUSH 2 years ago
莫贤彬 dd7b7beaaa [oracle] Use Incremental Snapshot Framework for Oracle CDC Connector (#1079)
This closes #1292.
2 years ago
Hang Ruan 9bbfcb477d [docs] Bump Flink version to 1.16.0 2 years ago
Hang Ruan db24ba59d4 [common] Bump Flink version to 1.16.0 2 years ago
gongzhongqiang 15392e8f84
[docs][db2] Add db2 to README.md (#1699) 2 years ago
wangxiaojing da5b322890
[tidb] Checkpoint is not updated long after a task has been running (#1686)
Co-authored-by: wangxiaojing <wangxiaojing@lixiang.com>
2 years ago
gongzhongqiang e377c339b6
[hotfix] Add method getMaxResolvedTs back to class CDCClient. (#1695)
Co-authored-by: gongzhongqiang <764629910@qq.com>
2 years ago
Hang Ruan 8685fd4027
[docs] Bump connector version to flink 1.15.2 in docs (#1684) 2 years ago
leozlliang 1111f0270e
[tidb] Fix data lost when region changed (#1632)
* [tidb] Fix data lost when region changed.

* [tidb] Add tidb cdc region change unit test and polish TiKVRichParallelSourceFunction.

Co-authored-by: liangzhili2 <liangzhili2@joyy.com>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
Jiabao Sun aee88f947c
[hotfix][docs] Correct reference link for DB2 docs (#1683) 2 years ago
Qingsheng Ren 4e63851c6a [mysql] Update docs of specifying starting offset feature of MySQL CDC source 2 years ago
Qingsheng Ren c07451884d [hotfix][mysql] Remove unused constructor in MySqlTableSource 2 years ago
Qingsheng Ren aca5643704 [mysql] Support starting reading binlog from earliest offset / specific offset / timestamp (#1661)
This closes #254
2 years ago
Jiabao Sun 301e5a8ab0 [mongodb] Support incremental snapshot for MongoDB CDC Connector 2 years ago
Qingsheng Ren ffdfd549b9 [cdc-base] Extract a higher level IncrementalSource independent of JDBC dialects 2 years ago
skylines 21ba3b05a2
[hotfix][docs] Fix db2 doc download link (#1681) 2 years ago
Leonard Xu f8f1a64081 [docs][db2] Add Db2 CDC connector doc link 2 years ago
Hang Ruan a5f6657046 [docs][db2] Add Db2 cdc connector docs 2 years ago
Hang Ruan f1b130cedf [build][db2] Add Db2 pipeline script 2 years ago
Hang Ruan 23e06df79d [e2e][db2] Add Db2 e2e test 2 years ago
Hang Ruan 3592dcc4ee [db2] Add sql connector for Db2 CDC (#1626)
This closes #450.
2 years ago
Hang Ruan 5d005809e9 [db2] Introduce Db2 cdc connector (#450) 2 years ago
xieyi888 a6fa1e694e
[tidb] Fix data loss in tidb-cdc when switch from snapshot read to change event read  (#1207)
Signed-off-by: Yi Xie <xieyi01@rd.netease.com>

Signed-off-by: Yi Xie <xieyi01@rd.netease.com>
Co-authored-by: Yi Xie <xieyi01@rd.netease.com>
2 years ago
Jiabao Sun fbf5eba03c
[hotfix][cdc-base] Fix OffsetFactory is not initialized when restored from checkpoint (#1657) 2 years ago
Tigran Manasyan 5b3dd9884e
[common] Bump Flink version to 1.15.2 (#1504)
This closes #1363. 

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Jiabao Sun 8976f25925
[cdc-base] Abstract naming for variables of incremental framework (#1646) 2 years ago