Commit Graph

100 Commits (0ab57ac1ab540bd7ebc62d89d5dc877ee62b8b57)

Author SHA1 Message Date
Xin Gong 14b81dc6ec
[FLINK-34715][cdc][cdc-connector][mysql] Correctly close BinlogSplitReader in MySQL UTCase
This closes #3161.
12 months ago
Kunni 26eb6a99b9
[hotfix][cdc][build] Include cdc-common module when shaded for module flink-sql-connector-mysql-cdc 12 months ago
Hang Ruan 86272bf102
[FLINK-34183][cdc][license] Update NOTICE files (#3107) 12 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
12 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 12 months ago
e-mhui 6da9684999
[cdc-connector][oracle] Use database name in upper case at the snapshot phase to fix fetching two different db name for the same table at the snapshot phase and incremental phase(#2088) 1 year ago
e-mhui ea7b0e8dbb
[cdc-base] Support to parse Oracle/SqlServer/PostgresSQL CDC schema change events (#2315) 1 year ago
Hongshun Wang a2ad627fed [cdc-connector][mongodb] Expose capture newly added tables ability to Mongodb CDC source 1 year ago
Hongshun Wang 03a287a9c2 [cdc-connector][postgres] Expose capture newly added tables ability to Postgres CDC source 1 year ago
Hongshun Wang 1eeda75eaa [cdc-connector][cdc-base] Support capture newly added tables with un-blocking stream read for CDC Framework(#3024) 1 year ago
Yaroslav Tkachenko 1562bc29a3 [cdc-base] Support Scan Newly Added Tables feature 1 year ago
Hongshun Wang 0ca718c31f
[cdc-connector][oracle] Expose SNAPSHOT_ONLY mode for Oracle CDC Source (#3005) 1 year ago
gongzhongqiang d058102c5c
[cdc-connector][oracle]Add oracle 21 version to OracleValidator (#3054) 1 year ago
yuxiqian 82ccf00e6a
[hotfix][cdc-connector][mongodb] Fix scanFullChangelog requires all collections 1 year ago
Hongshun Wang 7ea197242f
[debezium] Upgrade to Debezium 1.9.8.Final(#3033) (#3034) 1 year ago
Xin Gong 10e542c3ff
[cdc-connector][sqlserver] sqlserver support use specific chunk column as a split key (#2972)
This closes #2971.
1 year ago
Hongshun Wang 3be3417de2
[cdc-connector][postgres] Fix potential PostgresSQL database connection leak (#3013)
This closes #2980.
1 year ago
Xin Gong 20e44e6966
[cdc-connector][oracle] Oracle supports user specific chunk column (#2976)
This closes #2973.
1 year ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Hongshun Wang a2d36a892e
[cdc-connector][mongodb][hotfix] Stop executing log reading in MongoDBStreamFetchTask#close (#3029)
This closes #3029.
1 year ago
lzshlzsh 9ce36569fb
[cdc-connector][postgres] Fix data lost problem when new lsn committed to slot between snapshotState and notifyCheckpointComplete (#2539)
This closes #2538.
Co-authored-by: sammieliu <sammieliu@tencent.com>
1 year ago
Hongshun Wang e3d6c7e0aa
[cdc-connector][postgres] Apply DBZ-5398 postgres connector to handle functional unique index (#2842)
This closes #2710.
1 year ago
Kunni 9abf2cf900
[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not included in capturedTableFilter (#2986)
This closes #2981
1 year ago
Hongshun Wang e3f6829263 [cdc-connector][mongodb] Add SNAPSHOT_ONLY mode for Mongodb CDC Source 1 year ago
Hongshun Wang 0e4f835f6d [cdc-connector][Postgres] Add SNAPSHOT_ONLY mode for Postgres CDC Source 1 year ago
Hongshun Wang 1cbdb4f8ae [cdc-connector][cdc-base] Add SNAPSHOT_ONLY mode for Incremental CDC Source framework (#2901) 1 year ago
Hongshun Wang 3bf886b94d [cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source (#2901) 1 year ago
Hongshun Wang 35d3c0ff28
[cdc-base][hotfix] Fix SourceSplitSerializer to get totalFinishedSplitSize from recovery in 4th version
This closes #2992.
1 year ago
gongzhongqiang a24c5d1b24
[cdc][e2e] Unify logic to clean docker image when connector e2e test finished (#2978) 1 year ago
He Wang f3762a1b30
[pipeline-connector][mysql] fix timestamp with timezone format (#2952)
* fix ts with tz parser

* test timestamp with default value

* fix related test

* use timestamp string in test cases
1 year ago
Hongshun Wang 15a734efa0 [cdc-connector][oracledb] Fix oracle read exceed high_watermark in backfill phase 1 year ago
张田 1b643026fe
[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector (#2895) 1 year ago
Kunni 812c33d27b
[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe (#2954) 1 year ago
FocusComputing b42bc60ab9
[source-connector][mysql] speedup searching binlog by timestamp (#2924)
* [feature] speedup search mysql binlog when mysql-cdc-connector consume binlog by timestamp

* improve code

* improve code

* code improve

* test case add and code improve

* code improve

* code improve

* code improve, ut add and bugfix for purged log

---------

Co-authored-by: TJX2014 <tangjinxin@deepexi.com>
1 year ago
joyCurry30 055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886) 1 year ago
Leonard Xu a5fa2dc6c8
[hotfix][cdc-connector][mysql] Expose row_kind metadata column for mysql cdc source. (#2927)
We use 'row_kind' name instead of 'op' or 'op_type', the operation type is a concept of database and database only has 'update'
type and hasn't 'update_before' and 'update_after' type.
1 year ago
Xianxun Ye 8eba910063
[cdc-connector][mysql] Support metadata 'operation' virtual column for MySql Connector. (#2913) 1 year ago
Hongshun Wang 6b6d9fcb0b
[cdc-connector][mongodb] Avoid mongodb source to read data after high_watermark in backfill phase (#2893) 1 year ago
He Wang 26dfeeb563
[cdc-connector][oceanbase] Fallback to current timestamp when query gts failure (#2868) 1 year ago
Hongshun Wang 2c557c6a78
[cdc-connector][sqlserver][tests] Fix UT errors by correcting right output (#2864) 1 year ago
GOODBOY008 08beca52d0 [cdc] Add Deprecated annotation to source function which connector implemented incremental 1 year ago
Hongshun Wang 568ed79005
[postgres] Add commits of PostgresConnection back to distinguish with debezium's origin class (#2839) 1 year ago
Xin Gong 08d6b8178f
[cdc-connector][sqlserver] Fix SqlServerTableSource params order error (#2847) 1 year ago
Hongshun Wang f15faac298
[docs] Fix overview docs to remove prefix of pipeline options (#2833) 1 year ago
PengFei Li 72bcb1df02
[pipeline-connector][starrocks] Fix char/varchar length inconsistency between cdc and starrocks (#2829) 1 year ago
gongzhongqiang c484bb447c
[build][hotfix] Remove duplicate dependency (#2828) 1 year ago
Qingsheng Ren daceb42168 [build] Use ${project.version} instead of ${revision} for dependency version
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Jiabao Sun 8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820)
This closes #2820.
1 year ago
Dian Qi f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event (#2682)
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
Jiabao Sun 7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816) 1 year ago