Commit Graph

870 Commits (1dc201f9b397028f50e493bb21bff34ddfb21d99)
 

Author SHA1 Message Date
gongzhongqiang 1dc201f9b3
[FLINK-34180] Migrate doc website from ververica to flink (#3028) 11 months ago
Hang Ruan 86272bf102
[FLINK-34183][cdc][license] Update NOTICE files (#3107) 11 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
11 months ago
Hang Ruan a6c1b06e11 [FLINK-34184][cdc][docs] Add license for all document files
This closes #3092.
11 months ago
Hang Ruan f1461f2b43 [hotfix][cdc][docs] Update LICENSE file 11 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 11 months ago
gongzhongqiang 96888b2ce0
[FLINK-34577] Add IssueNavigationLink for IDEA git log (#3096) 11 months ago
gongzhongqiang 99a86fbb92
[FLINK-34578][cdc][build] Remove outdated issue templates
This closes #3097.
11 months ago
gongzhongqiang f7fa317580
[FLINK-34187][cdc][build] Setup Github CI for Flink CDC project
This closes #3022.
11 months ago
e-mhui 6da9684999
[cdc-connector][oracle] Use database name in upper case at the snapshot phase to fix fetching two different db name for the same table at the snapshot phase and incremental phase(#2088) 11 months ago
e-mhui ea7b0e8dbb
[cdc-base] Support to parse Oracle/SqlServer/PostgresSQL CDC schema change events (#2315) 11 months ago
Hongshun Wang a2ad627fed [cdc-connector][mongodb] Expose capture newly added tables ability to Mongodb CDC source 11 months ago
Hongshun Wang 03a287a9c2 [cdc-connector][postgres] Expose capture newly added tables ability to Postgres CDC source 11 months ago
Hongshun Wang 1eeda75eaa [cdc-connector][cdc-base] Support capture newly added tables with un-blocking stream read for CDC Framework(#3024) 11 months ago
Yaroslav Tkachenko 1562bc29a3 [cdc-base] Support Scan Newly Added Tables feature 11 months ago
Check Null 167bb403a3
[hotfix][docs] fix typo 'escription' to 'description' (#3050) 1 year ago
Hongshun Wang 0ca718c31f
[cdc-connector][oracle] Expose SNAPSHOT_ONLY mode for Oracle CDC Source (#3005) 1 year ago
gongzhongqiang d058102c5c
[cdc-connector][oracle]Add oracle 21 version to OracleValidator (#3054) 1 year ago
yuxiqian 82ccf00e6a
[hotfix][cdc-connector][mongodb] Fix scanFullChangelog requires all collections 1 year ago
Hongshun Wang 7ea197242f
[debezium] Upgrade to Debezium 1.9.8.Final(#3033) (#3034) 1 year ago
Xin Gong 10e542c3ff
[cdc-connector][sqlserver] sqlserver support use specific chunk column as a split key (#2972)
This closes #2971.
1 year ago
Hongshun Wang 3be3417de2
[cdc-connector][postgres] Fix potential PostgresSQL database connection leak (#3013)
This closes #2980.
1 year ago
Xin Gong 20e44e6966
[cdc-connector][oracle] Oracle supports user specific chunk column (#2976)
This closes #2973.
1 year ago
joyCurry30 c98f899af8
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888) 1 year ago
Hongshun Wang a2d36a892e
[cdc-connector][mongodb][hotfix] Stop executing log reading in MongoDBStreamFetchTask#close (#3029)
This closes #3029.
1 year ago
lzshlzsh 9ce36569fb
[cdc-connector][postgres] Fix data lost problem when new lsn committed to slot between snapshotState and notifyCheckpointComplete (#2539)
This closes #2538.
Co-authored-by: sammieliu <sammieliu@tencent.com>
1 year ago
Hongshun Wang e3d6c7e0aa
[cdc-connector][postgres] Apply DBZ-5398 postgres connector to handle functional unique index (#2842)
This closes #2710.
1 year ago
Kunni 9abf2cf900
[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not included in capturedTableFilter (#2986)
This closes #2981
1 year ago
Xin Gong 44692aa2d2
[docs][hotfix] Update dependency version from 2.5-SNAPSHOT to 3.0-SNAPSHOT (#2994) 1 year ago
Hongshun Wang e3f6829263 [cdc-connector][mongodb] Add SNAPSHOT_ONLY mode for Mongodb CDC Source 1 year ago
Hongshun Wang 0e4f835f6d [cdc-connector][Postgres] Add SNAPSHOT_ONLY mode for Postgres CDC Source 1 year ago
Hongshun Wang 1cbdb4f8ae [cdc-connector][cdc-base] Add SNAPSHOT_ONLY mode for Incremental CDC Source framework (#2901) 1 year ago
Hongshun Wang 3bf886b94d [cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source (#2901) 1 year ago
Hongshun Wang 35d3c0ff28
[cdc-base][hotfix] Fix SourceSplitSerializer to get totalFinishedSplitSize from recovery in 4th version
This closes #2992.
1 year ago
Kunni 146ed9d0be
[hotfix][cdc-common] Fix NoSuchMethodError of CollectionUtil.newHashMapWithExpectedSize
This closes #2943
1 year ago
gongzhongqiang a24c5d1b24
[cdc][e2e] Unify logic to clean docker image when connector e2e test finished (#2978) 1 year ago
He Wang f3762a1b30
[pipeline-connector][mysql] fix timestamp with timezone format (#2952)
* fix ts with tz parser

* test timestamp with default value

* fix related test

* use timestamp string in test cases
1 year ago
Kunni 557944488b
[doc] fix invalid page in website and update yaml in tutorial.
This closes #2966.
1 year ago
Hongshun Wang 15a734efa0 [cdc-connector][oracledb] Fix oracle read exceed high_watermark in backfill phase 1 year ago
张田 1b643026fe
[pipeline-connector][starrocks] Optimize char type mapping for starrocks pipeline connector (#2895) 1 year ago
Kunni 812c33d27b
[pipeline-connector][doris][starrocks] Remove SimpleDateFormat for thread safe (#2954) 1 year ago
FocusComputing b42bc60ab9
[source-connector][mysql] speedup searching binlog by timestamp (#2924)
* [feature] speedup search mysql binlog when mysql-cdc-connector consume binlog by timestamp

* improve code

* improve code

* code improve

* test case add and code improve

* code improve

* code improve

* code improve, ut add and bugfix for purged log

---------

Co-authored-by: TJX2014 <tangjinxin@deepexi.com>
1 year ago
Kunni 7ab1e87842
[build] Add github labeler for pipeline connector. (#2851) 1 year ago
He Wang cebfe2e5ca
[docs][cdc-connector][oceanbase] update docker image and os compatibility in quickstart (#2897)
* [docs][cdc-connector] update docker image and description in oceanbase quickstart

* revert removal by accident
1 year ago
TorinJie c12c44d969
[docs] Add Supported Connectors and Supported Flink Versions to Overview. (#2920) 1 year ago
joyCurry30 055b0af477
[cdc-common][pipeline-doris] Fix typo and wrong value for 'precision' of time type. (#2886) 1 year ago
Leonard Xu a5fa2dc6c8
[hotfix][cdc-connector][mysql] Expose row_kind metadata column for mysql cdc source. (#2927)
We use 'row_kind' name instead of 'op' or 'op_type', the operation type is a concept of database and database only has 'update'
type and hasn't 'update_before' and 'update_after' type.
1 year ago
Xianxun Ye 8eba910063
[cdc-connector][mysql] Support metadata 'operation' virtual column for MySql Connector. (#2913) 1 year ago
Hongshun Wang 6b6d9fcb0b
[cdc-connector][mongodb] Avoid mongodb source to read data after high_watermark in backfill phase (#2893) 1 year ago
He Wang 26dfeeb563
[cdc-connector][oceanbase] Fallback to current timestamp when query gts failure (#2868) 1 year ago