Commit Graph

485 Commits (dd19da6ff1721942e6da37c4e3464e9c09be1455)
 

Author SHA1 Message Date
Hang Ruan 6a56985fa8
[hotfix][test] Fix MySqlSourceITCase failure due to StreamExecutionEnvironment#getConfiguration returned unmodifiable object (#1446) 3 years ago
Hang Ruan 2bb5b6f625
[test] Fix tests missed 'update_before' records if the primary keys of source and sink are different (#1451) 3 years ago
legendtkl 8849d14aeb
[hotfix][oracle] Fix the shell script interpreter assignment should be at first line (#1452)
Co-authored-by: taokelu <taokelu@bytedance.com>
3 years ago
gongzhongqiang 6af93959c2
[hotfix][tidb-cdc] TiDB CDC dealUnsignedColumnValue throw NullPointerException. (#1448) 3 years ago
Hang Ruan 9e6549c67e
[polardbx][test] Rename PolardbxSourceTCase to PolardbxSourceITCase (#1447) 3 years ago
Hang Ruan a5dd0c0a14
[mysql] Enable pass custom jdbc properties for debezium mysql connection (#1217)
This closes #674
3 years ago
Matrix42 c96926b6ec
[mysql] Release the debezium reader thread resources after reading finished (#1358)
This closes #1350.
3 years ago
He Wang 2de4903261
[oceanbase] Introduce 'table-list' option to support capture list of tables (#1369)
This closes #1369.
3 years ago
ehui 043841624d
[cdc-base] Flink CDC base registers the identical history engine on multiple tasks (#1340)
This closes #1130
3 years ago
Leonard Xu 70ebfefa9c [hotfix][mysql] Fix compile error due to merge conflict 3 years ago
Hang Ruan 96c84d9c65
[mysql] Generates multiple chunks when approximate row count is bigger than chunk size (#1193)
This closes #1191.
3 years ago
ehui 0a097a9e53
[cdc-base] Fix NPE during snpashot scan phase (#1339)
This closes #1122.
3 years ago
Leonard Xu 52368e5b87 [docs] Improve MySQL ZH document and update the outdated links (#1435)
This closes #1435.
3 years ago
rookiegao 5eabe38aef [docs] Translate mysql cdc doc to Chinese (#1391)
This closes #1391.
3 years ago
Hang Ruan 0d1ce7a702
[mysql] Introduce 'scan.incremental.snapshot.chunk.key-column' option to support splitting table by custom column (#1415)
This closes #1108.
3 years ago
lzshlzsh 74f0a65355
[mysql] Optimize pure binlog phase check logic to improve performance (#1392)
Co-authored-by: sammieliu <sammieliu@tencent.com>
3 years ago
zhmin 2c3962bd03
fix typo of SourceReaderMetrics's name (#1425)
Co-authored-by: zhmin <minzhe@loongteam.com>
3 years ago
Leonard Xu 7afa2e1675 [oracle] Fix mining session stopped due to 'No more data to read from socket' 3 years ago
Leonard Xu 1ab2c6de71 [common] Ignore retriableException to make the debezium engine retry works
[test][oracle] Fix unstable tests OracleE2eITCase due to reuse container
3 years ago
Paul Lin 4a6a89903c
[tidb] Fix NPE when the specified table does not exist (#1411)
This closes #1410.
3 years ago
gongzhongqiang 657f4364d5 [docs] Add step up SQLServer Database cdc document in sqlserver-cdc.md. 3 years ago
Jiabao Sun 02eca305d2
[mongodb] Expose batch.size config option for table source. (#1387)
* [mongodb] Expose batch.size config option for table source.
3 years ago
Jiabao Sun 3ce8f824d2
[mongodb] Example tests for MongoDBSource (#1388) 3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390)
This closes #1389.
3 years ago
vanliu 42631af6f5
[mongodb] Allow document field defined as string type in flink sql (#1385) 3 years ago
gongzhongqiang e7238f2407
[mysql] Fix dead loop when splitting chunks. (#1107) 3 years ago
gongzhongqiang bc11657855
[docs] Fix a typo in sqlserver-cdc.md (#1382) 3 years ago
hsldymq 1c55a879ec
[docs] Fix typo in mysql-cdc.md (#1364) 3 years ago
xieyi888 0cc58141eb
[docs] Fix a typo in tidb-cdc.md  (#1215)
Signed-off-by: Yi Xie <xieyi01@rd.netease.com>

Co-authored-by: Yi Xie <xieyi01@rd.netease.com>
3 years ago
Hang Ruan 75d70518c1
[docs] Add all supported type mapping for mysql cdc connector (#1373) 3 years ago
Dezhi Cai 2aeffd7380
[build] Build document site only if current PR modified files under docs (#1230)
This closes #343.
3 years ago
Matrix42 8f6078d12a
[oracle] Support XMLType for Oracle CDC Connector (#1342)
This closes #1341
3 years ago
Sergey Nuyanzin 2f3c872306
[build] Bump Flink version to 1.14.4 (#1284)
This closes #1284
3 years ago
ehui 1fdf28fe49
[mysql] Adopt streaming merge during snapshotSplit scan to avoid OOM (#1219)
This closes #1219
3 years ago
He Wang be4249156e
[oceanbase] Introduce more config options of log proxy and improve the oceanbase connector(#1234)
This PR closes #1202 and #1287.

1.Add logproxy.client.id, config-url and working-mode params for libobcdc
2.Fix timezone config for change events reading.
3.Sort class fields in order of [common properties -> snapshot properties -> change events properties]
4.Use official docker image in tests.
5.update logproxy-client to 1.0.5
3 years ago
Hang Ruan c4429a962c
[docs][cdc-base] Optimize annotations (#1320)
This closes #1320.
3 years ago
jiabao.sun ccaaf4695d [mysql] Connection pool id should contains username (#1328) 3 years ago
gongzhongqiang de9425faf0
[tidb-cdc] Monitor tidb table lose data, which table has one more regions. (#1196) 3 years ago
jiabao.sun 146135ebfb [dbz] Patch for DBZ-5126 to fix memory leak problem. (#939) 3 years ago
gongzhongqiang 55e4ae57e5
[hotfix][docs] Fix typo in java docs. (#1305)
This closes #1305.
3 years ago
Jiabao Sun 086464a733
[mongodb] Permission optimization of single database is specified (#1240) 3 years ago
lincoln lee 3f07aff6c1
[hotfix][cdc-base] Fix typo 'currenFetcher' -> 'currentFetcher' (#1299)
This closes #1299.
3 years ago
He Wang 841376404c
[hotfix][oceanbase] Fix the default string encoding(#1294)
This closes #1294.
3 years ago
pacino 5ee2233e34
[mongodb][doc] Fix meta field collection_name of metadata sql example (#1290) 3 years ago
Qishang Zhong b2014dea11
[mongodb] Fix UnsupportedTemporalTypeException when define Timestamp as String (#1268) 3 years ago
ruanhang1993 85a6515245
[mysql] Support optional numeric unsigned zerofill types (#1197)
Co-authored-by: bangjiang.xbj <bangjiang.xbj@alibaba-inc.com>
3 years ago
Qingsheng Ren 9c905f6dd1
[mysql] Add heartbeatInterval field to equals() and hashCode() (#1116) 3 years ago
Qingsheng Ren 47e005ab47
[mysql] Catch and hold exception in chunk splitter thread and rethrow in getNext() (#1109) 3 years ago
camelus c0aca57a8f
[mysql] Use the gtid set firstly when compare the binlog offset (#761)
Co-authored-by: camelusluo <camelusluo@tencent.com>
3 years ago
Rinka 7efdc67c80
[hotfix][tidb] Fix RowKind.INSERT judgement condition (#1073)
Co-authored-by: rinka <gzlinjia@corp.netease.com>
3 years ago