Xin Gong
14b81dc6ec
[FLINK-34715][cdc][cdc-connector][mysql] Correctly close BinlogSplitReader in MySQL UTCase
...
This closes #3161 .
12 months ago
Kunni
26eb6a99b9
[hotfix][cdc][build] Include cdc-common module when shaded for module flink-sql-connector-mysql-cdc
12 months ago
Hang Ruan
86272bf102
[FLINK-34183][cdc][license] Update NOTICE files ( #3107 )
12 months ago
Hang Ruan
e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
...
This closes #3089 .
12 months ago
Hang Ruan
eeb4bab92d
[FLINK-34184][cdc][license] Update Copyright from Ververica to Apache
12 months ago
e-mhui
6da9684999
[cdc-connector][oracle] Use database name in upper case at the snapshot phase to fix fetching two different db name for the same table at the snapshot phase and incremental phase( #2088 )
1 year ago
e-mhui
ea7b0e8dbb
[cdc-base] Support to parse Oracle/SqlServer/PostgresSQL CDC schema change events ( #2315 )
1 year ago
Hongshun Wang
a2ad627fed
[cdc-connector][mongodb] Expose capture newly added tables ability to Mongodb CDC source
1 year ago
Hongshun Wang
03a287a9c2
[cdc-connector][postgres] Expose capture newly added tables ability to Postgres CDC source
1 year ago
Hongshun Wang
1eeda75eaa
[cdc-connector][cdc-base] Support capture newly added tables with un-blocking stream read for CDC Framework(#3024)
1 year ago
Yaroslav Tkachenko
1562bc29a3
[cdc-base] Support Scan Newly Added Tables feature
1 year ago
Hongshun Wang
0ca718c31f
[cdc-connector][oracle] Expose SNAPSHOT_ONLY mode for Oracle CDC Source ( #3005 )
1 year ago
gongzhongqiang
d058102c5c
[cdc-connector][oracle]Add oracle 21 version to OracleValidator ( #3054 )
1 year ago
yuxiqian
82ccf00e6a
[hotfix][cdc-connector][mongodb] Fix scanFullChangelog requires all collections
1 year ago
Hongshun Wang
7ea197242f
[debezium] Upgrade to Debezium 1.9.8.Final( #3033 ) ( #3034 )
1 year ago
Xin Gong
10e542c3ff
[cdc-connector][sqlserver] sqlserver support use specific chunk column as a split key ( #2972 )
...
This closes #2971 .
1 year ago
Hongshun Wang
3be3417de2
[cdc-connector][postgres] Fix potential PostgresSQL database connection leak ( #3013 )
...
This closes #2980 .
1 year ago
Xin Gong
20e44e6966
[cdc-connector][oracle] Oracle supports user specific chunk column ( #2976 )
...
This closes #2973 .
1 year ago
joyCurry30
c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. ( #2888 )
1 year ago
Hongshun Wang
a2d36a892e
[cdc-connector][mongodb][hotfix] Stop executing log reading in MongoDBStreamFetchTask#close ( #3029 )
...
This closes #3029 .
1 year ago
lzshlzsh
9ce36569fb
[cdc-connector][postgres] Fix data lost problem when new lsn committed to slot between snapshotState and notifyCheckpointComplete ( #2539 )
...
This closes #2538 .
Co-authored-by: sammieliu <sammieliu@tencent.com>
1 year ago
Hongshun Wang
e3d6c7e0aa
[cdc-connector][postgres] Apply DBZ-5398 postgres connector to handle functional unique index ( #2842 )
...
This closes #2710 .
1 year ago
Kunni
9abf2cf900
[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not included in capturedTableFilter ( #2986 )
...
This closes #2981
1 year ago
Hongshun Wang
e3f6829263
[cdc-connector][mongodb] Add SNAPSHOT_ONLY mode for Mongodb CDC Source
1 year ago
Hongshun Wang
0e4f835f6d
[cdc-connector][Postgres] Add SNAPSHOT_ONLY mode for Postgres CDC Source
1 year ago
Hongshun Wang
1cbdb4f8ae
[cdc-connector][cdc-base] Add SNAPSHOT_ONLY mode for Incremental CDC Source framework ( #2901 )
1 year ago
Hongshun Wang
3bf886b94d
[cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source ( #2901 )
1 year ago
Hongshun Wang
35d3c0ff28
[cdc-base][hotfix] Fix SourceSplitSerializer to get totalFinishedSplitSize from recovery in 4th version
...
This closes #2992 .
1 year ago
gongzhongqiang
a24c5d1b24
[cdc][e2e] Unify logic to clean docker image when connector e2e test finished ( #2978 )
1 year ago
He Wang
f3762a1b30
[pipeline-connector][mysql] fix timestamp with timezone format ( #2952 )
...
* fix ts with tz parser
* test timestamp with default value
* fix related test
* use timestamp string in test cases
1 year ago
Hongshun Wang
15a734efa0
[cdc-connector][oracledb] Fix oracle read exceed high_watermark in backfill phase
1 year ago
张田
1b643026fe
[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector ( #2895 )
1 year ago
Kunni
812c33d27b
[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe ( #2954 )
1 year ago
FocusComputing
b42bc60ab9
[source-connector][mysql] speedup searching binlog by timestamp ( #2924 )
...
* [feature] speedup search mysql binlog when mysql-cdc-connector consume binlog by timestamp
* improve code
* improve code
* code improve
* test case add and code improve
* code improve
* code improve
* code improve, ut add and bugfix for purged log
---------
Co-authored-by: TJX2014 <tangjinxin@deepexi.com>
1 year ago
joyCurry30
055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. ( #2886 )
1 year ago
Leonard Xu
a5fa2dc6c8
[hotfix][cdc-connector][mysql] Expose row_kind metadata column for mysql cdc source. ( #2927 )
...
We use 'row_kind' name instead of 'op' or 'op_type', the operation type is a concept of database and database only has 'update'
type and hasn't 'update_before' and 'update_after' type.
1 year ago
Xianxun Ye
8eba910063
[cdc-connector][mysql] Support metadata 'operation' virtual column for MySql Connector. ( #2913 )
1 year ago
Hongshun Wang
6b6d9fcb0b
[cdc-connector][mongodb] Avoid mongodb source to read data after high_watermark in backfill phase ( #2893 )
1 year ago
He Wang
26dfeeb563
[cdc-connector][oceanbase] Fallback to current timestamp when query gts failure ( #2868 )
1 year ago
Hongshun Wang
2c557c6a78
[cdc-connector][sqlserver][tests] Fix UT errors by correcting right output ( #2864 )
1 year ago
GOODBOY008
08beca52d0
[cdc] Add Deprecated annotation to source function which connector implemented incremental
1 year ago
Hongshun Wang
568ed79005
[postgres] Add commits of PostgresConnection back to distinguish with debezium's origin class ( #2839 )
1 year ago
Xin Gong
08d6b8178f
[cdc-connector][sqlserver] Fix SqlServerTableSource params order error ( #2847 )
1 year ago
Hongshun Wang
f15faac298
[docs] Fix overview docs to remove prefix of pipeline options ( #2833 )
1 year ago
PengFei Li
72bcb1df02
[pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks ( #2829 )
1 year ago
gongzhongqiang
c484bb447c
[build][hotfix] Remove duplicate dependency ( #2828 )
1 year ago
Qingsheng Ren
daceb42168
[build] Use ${project.version} instead of ${revision} for dependency version
...
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Jiabao Sun
8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion ( #2820 )
...
This closes #2820 .
1 year ago
Dian Qi
f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event ( #2682 )
...
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
Jiabao Sun
7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema ( #2816 )
1 year ago