Commit Graph

485 Commits (dd19da6ff1721942e6da37c4e3464e9c09be1455)
 

Author SHA1 Message Date
Amber Moe dd19da6ff1 [docs][oceanbase] Add Chinese documents for oceanbase-cdc connector()
This closes .
ehui 6d0cdbcc6e
[mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart  ()
* [mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart
Qingsheng Ren ae51129ba3
[hotfix][docs] Exclude auto-generated files in docs from apache-rat-plugin ()
gongzhongqiang 20ef0aea62
[db2] Fix stream api example in db2 doc. ()
* [db2] Fix db2 doc.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Leonard Xu a7f1970e1f [build] Bump version to 2.4-SNAPSHOT
Leonard Xu 3a198250b6 [docs] Update the flink cdc picture with supported database vendors.
gongzhongqiang d8542cdec0
[tidb] Fix unstable TiDB region changed test. ()
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
jiabao.sun 086634666f [docs][mongodb] Add docs for MongoDB incremental source
Leonard Xu e4dcd10ec8 [oracle][mysql] Improve the Oracle all data types test and clean up debug logs
Leonard Xu 228fbe650a [oracle] Properly support TIMESTAMP_LTZ type for oracle cdc connector
molsion b4ce19951f [oracle]support use user given column as split column
Leonard Xu df4b87f79e [oracle][minor] Clean up useless methods and classes
ehui 6fe4fc93e1 [oracle] Parallel read supports startup of startupOptions
ehui 4bfe694fea [oracle] Add full type field test
molsion a09a31495e [oracle]OracleTableSource support splitSize, fetchSize ,connectMaxRetries, connectionPoolSize and add test
Leonard Xu 8dd8fe6ac3 [hotfix][oracle][db2] Update the license header
Leonard Xu 1d5961dfec [cdc-base][oralce] Remove useless method of JdbcSourceFetchTaskContext
molsion f6c34cd616 [cdc-base][oracle] Improve the base methods base on Oracle specific requirements
ehui 4d9c0e41e1 [oracle] Support custom url for incremental snapshot source
molsion 94fa8b347f [oracle] Introduce SCAN_INCREMENTAL_SNAPSHOT_ENABLED option for OracleTableSourceFactory
molsion a94eefd90a [minor][oracle] Improve tests and code format
01410172 f99efd809f [oracle] Ignore testCheckpointAndRestore util DBZ-5245 and DBZ-4936 fix
莫贤彬 4855fa3337 [oracle][test] Add tests for Oracle incremental snapshot source
Enoch aeaf57b37e [oracle] Use ROWID as split column and replace limit syntax with ROWNUM
莫贤彬 70fb9cf5a3 [oracle] Let LogMinerStreamingChangeEventSource do not rely on oracle table LOG_MINING_FLUSH
莫贤彬 dd7b7beaaa [oracle] Use Incremental Snapshot Framework for Oracle CDC Connector ()
This closes .
Hang Ruan 9bbfcb477d [docs] Bump Flink version to 1.16.0
Hang Ruan db24ba59d4 [common] Bump Flink version to 1.16.0
gongzhongqiang 15392e8f84
[docs][db2] Add db2 to README.md ()
wangxiaojing da5b322890
[tidb] Checkpoint is not updated long after a task has been running ()
Co-authored-by: wangxiaojing <wangxiaojing@lixiang.com>
gongzhongqiang e377c339b6
[hotfix] Add method getMaxResolvedTs back to class CDCClient. ()
Co-authored-by: gongzhongqiang <764629910@qq.com>
Hang Ruan 8685fd4027
[docs] Bump connector version to flink 1.15.2 in docs ()
leozlliang 1111f0270e
[tidb] Fix data lost when region changed ()
* [tidb] Fix data lost when region changed.

* [tidb] Add tidb cdc region change unit test and polish TiKVRichParallelSourceFunction.

Co-authored-by: liangzhili2 <liangzhili2@joyy.com>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Jiabao Sun aee88f947c
[hotfix][docs] Correct reference link for DB2 docs ()
Qingsheng Ren 4e63851c6a [mysql] Update docs of specifying starting offset feature of MySQL CDC source
Qingsheng Ren c07451884d [hotfix][mysql] Remove unused constructor in MySqlTableSource
Qingsheng Ren aca5643704 [mysql] Support starting reading binlog from earliest offset / specific offset / timestamp ()
This closes 
Jiabao Sun 301e5a8ab0 [mongodb] Support incremental snapshot for MongoDB CDC Connector
Qingsheng Ren ffdfd549b9 [cdc-base] Extract a higher level IncrementalSource independent of JDBC dialects
skylines 21ba3b05a2
[hotfix][docs] Fix db2 doc download link ()
Leonard Xu f8f1a64081 [docs][db2] Add Db2 CDC connector doc link
Hang Ruan a5f6657046 [docs][db2] Add Db2 cdc connector docs
Hang Ruan f1b130cedf [build][db2] Add Db2 pipeline script
Hang Ruan 23e06df79d [e2e][db2] Add Db2 e2e test
Hang Ruan 3592dcc4ee [db2] Add sql connector for Db2 CDC ()
This closes .
Hang Ruan 5d005809e9 [db2] Introduce Db2 cdc connector ()
xieyi888 a6fa1e694e
[tidb] Fix data loss in tidb-cdc when switch from snapshot read to change event read  ()
Signed-off-by: Yi Xie <xieyi01@rd.netease.com>

Signed-off-by: Yi Xie <xieyi01@rd.netease.com>
Co-authored-by: Yi Xie <xieyi01@rd.netease.com>
Jiabao Sun fbf5eba03c
[hotfix][cdc-base] Fix OffsetFactory is not initialized when restored from checkpoint ()
Tigran Manasyan 5b3dd9884e
[common] Bump Flink version to 1.15.2 ()
This closes . 

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
Jiabao Sun 8976f25925
[cdc-base] Abstract naming for variables of incremental framework ()