f6c34cd616
[cdc-base][oracle] Improve the base methods base on Oracle specific requirements
2 years ago
4d9c0e41e1
[oracle] Support custom url for incremental snapshot source
2 years ago
94fa8b347f
[oracle] Introduce SCAN_INCREMENTAL_SNAPSHOT_ENABLED option for OracleTableSourceFactory
2 years ago
a94eefd90a
[minor][oracle] Improve tests and code format
2 years ago
f99efd809f
[oracle] Ignore testCheckpointAndRestore util DBZ-5245 and DBZ-4936 fix
2 years ago
4855fa3337
[oracle][test] Add tests for Oracle incremental snapshot source
2 years ago
aeaf57b37e
[oracle] Use ROWID as split column and replace limit syntax with ROWNUM
2 years ago
70fb9cf5a3
[oracle] Let LogMinerStreamingChangeEventSource do not rely on oracle table LOG_MINING_FLUSH
2 years ago
dd7b7beaaa
[oracle] Use Incremental Snapshot Framework for Oracle CDC Connector ( #1079 )
...
This closes #1292 .
2 years ago
9bbfcb477d
[docs] Bump Flink version to 1.16.0
2 years ago
db24ba59d4
[common] Bump Flink version to 1.16.0
2 years ago
15392e8f84
[docs][db2] Add db2 to README.md ( #1699 )
2 years ago
da5b322890
[tidb] Checkpoint is not updated long after a task has been running ( #1686 )
...
Co-authored-by: wangxiaojing <wangxiaojing@lixiang.com>
2 years ago
e377c339b6
[hotfix] Add method getMaxResolvedTs back to class CDCClient. ( #1695 )
...
Co-authored-by: gongzhongqiang <764629910@qq.com>
2 years ago
8685fd4027
[docs] Bump connector version to flink 1.15.2 in docs ( #1684 )
2 years ago
1111f0270e
[tidb] Fix data lost when region changed ( #1632 )
...
* [tidb] Fix data lost when region changed.
* [tidb] Add tidb cdc region change unit test and polish TiKVRichParallelSourceFunction.
Co-authored-by: liangzhili2 <liangzhili2@joyy.com>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
2 years ago
aee88f947c
[hotfix][docs] Correct reference link for DB2 docs ( #1683 )
2 years ago
4e63851c6a
[mysql] Update docs of specifying starting offset feature of MySQL CDC source
2 years ago
c07451884d
[hotfix][mysql] Remove unused constructor in MySqlTableSource
2 years ago
aca5643704
[mysql] Support starting reading binlog from earliest offset / specific offset / timestamp ( #1661 )
...
This closes #254
2 years ago
301e5a8ab0
[mongodb] Support incremental snapshot for MongoDB CDC Connector
2 years ago
ffdfd549b9
[cdc-base] Extract a higher level IncrementalSource independent of JDBC dialects
2 years ago
21ba3b05a2
[hotfix][docs] Fix db2 doc download link ( #1681 )
2 years ago
f8f1a64081
[docs][db2] Add Db2 CDC connector doc link
2 years ago
a5f6657046
[docs][db2] Add Db2 cdc connector docs
2 years ago
f1b130cedf
[build][db2] Add Db2 pipeline script
2 years ago
23e06df79d
[e2e][db2] Add Db2 e2e test
2 years ago
3592dcc4ee
[db2] Add sql connector for Db2 CDC ( #1626 )
...
This closes #450 .
2 years ago
5d005809e9
[db2] Introduce Db2 cdc connector ( #450 )
2 years ago
a6fa1e694e
[tidb] Fix data loss in tidb-cdc when switch from snapshot read to change event read ( #1207 )
...
Signed-off-by: Yi Xie <xieyi01@rd.netease.com>
Signed-off-by: Yi Xie <xieyi01@rd.netease.com>
Co-authored-by: Yi Xie <xieyi01@rd.netease.com>
2 years ago
fbf5eba03c
[hotfix][cdc-base] Fix OffsetFactory is not initialized when restored from checkpoint ( #1657 )
2 years ago
5b3dd9884e
[common] Bump Flink version to 1.15.2 ( #1504 )
...
This closes #1363 .
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
8976f25925
[cdc-base] Abstract naming for variables of incremental framework ( #1646 )
2 years ago
a4b969d4a3
[mysql] ChunkSplitter supports to snapshot when splitting chunks for a table ( #1463 )
...
This closes #1463 .
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 years ago
21521506c0
[cdc-base] Fix StreamSplit's endingOffset of StreamSplitAssigner ( #1659 )
2 years ago
ddd0680009
[cdc-base] JdbcSourceConfig can be template type of DataSourceDialect ( #1639 )
2 years ago
8b2094c5f8
[mysql] Use the latest received meta of binlog split when request the next meta ( #1479 )
...
Co-authored-by: lidoudou3 <lidoudou1@jd.com>
2 years ago
40cd758656
[minor] Use Collections.singletonList instead of Arrays.asList if possible ( #1569 )
2 years ago
b1b092c97e
[oceanbase] Add new deserialization schema with runtime converter ( #1356 )
...
This closes #980 .
2 years ago
d3435381a6
[mysql] Avoid duplicate split requests when add new table.( #1156 )
...
This closes #1149 .
2 years ago
ad80e47c42
[mysql] Avoid duplicate split requests when add new table ( #1156 )
2 years ago
fcbed91311
[postgres] Upgrade org.postgresql:postgresql from 42.2.14 to 42.2.26 for CVE-2022-31197 ( #1616 )
2 years ago
c37b9ed1e9
[test][e2e] Upgrade org.postgresql:postgresql from 42.3.1 to 42.2.26 for CVE-2022-31197( #1616 )
2 years ago
e1ec9906ce
[hotfix][typo] Fix typo from schemaLess to schemaless
2 years ago
347911c7a0
[cdc-base] Reduce the memory usage of JM by sharing table schemas between splits
2 years ago
f44d2092c7
[cdc-base] Release the scan fetcher thread resource after reading finished ( #1619 )
2 years ago
806a8505d3
[cdc-base] Optimize pure binlog phase check logic to improve performance ( #1620 )
...
This closes #1620 .
2 years ago
8df5b110ab
[cdc-base] Let all records of one snapshot split don't cross checkpoints ( #1622 )
...
This closes #1622 .
2 years ago
aac6e31718
[postgres] Introduce changelog mode configuration with upsert/all modes
2 years ago
9eab82a2f8
[common] Introduce changelog mode configuration with upsert/all modes
2 years ago
molsion
ehui
01410172
Enoch
Hang Ruan
gongzhongqiang
wangxiaojing
leozlliang
Jiabao Sun
Qingsheng Ren
skylines
Leonard Xu
xieyi888
Tigran Manasyan
lidoudou1993
sunny
He Wang
yurunchuan
lxxawfl
fbad