Commit Graph

45 Commits (e7964b160c1df3861571ba2199ba04d91d887ff2)

Author SHA1 Message Date
gongzhongqiang 1a68e2cc83 [FLINK-36086] Add test for sqlserver restart during one transaction and add new version SourceSplitSerializer 4 days ago
gongzhongqiang 12890f8bdb [FLINK-36086] Set isSnapshotCompleted only immediately after snapshot
Co-authored-by: Sergei Morozov <morozov@tut.by>
4 days ago
yuxiqian e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
This closes  #3860
1 month ago
Hongshun Wang bcd70df85c
[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat
This closes #3667
1 month ago
ouyangwulin 0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797) 2 months ago
Hongshun Wang 12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510) 2 months ago
Sergei Morozov b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
This closes #3794.
2 months ago
Xin Gong 0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] (#3755) 2 months ago
yuxiqian 2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
This closes #3792
3 months ago
liuxiaodong ee9cd828c3
[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics (#3619)
Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
Hang Ruan 23e8149e6a
[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit (#3763) 3 months ago
Xin Gong 1d4e366969
[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions
This closes  #3754
3 months ago
Hongshun Wang 4bf5a395a5
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly
This closes #3519.
7 months ago
lipl f6d1d4810a
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly (#3497)
* resolve conficts

* polish code to trigger ci

---------

Co-authored-by: Kael <kael@fts.dev>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
7 months ago
Hongshun Wang 0c49959f67
[FLINK-35524][cdc-base] Clear connections pools when reader exist. (#3388) 7 months ago
Hongshun Wang 47f5660055
[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter (#3319) 7 months ago
SeungMin 91fc7bb506
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key
This closes #3448.
7 months ago
gongzhongqiang c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481) 7 months ago
ChengJie1053 2d50e43137
[minor][cdc-connector][postgres] PostgresDialect removes useless code
This closes #3416.
7 months ago
Joao Boto 94a0415475
[FLINK-34883] Fix postgres uuid column as PK (#3282)
* [FLINK-34883] Fix postgres uuid column as PK

* [FLINK-34883] Fix column comment.
7 months ago
Shawn Huang 6350eec66c
[FLINK-35301][cdc] Avoid deadlock when loading driver classes
This closes  #3300.
9 months ago
Shawn Huang 8e8fd304af
[FLINK-35298][cdc][metrics] Improve the fetch delay metrics
This closes #3298.
9 months ago
Hongshun Wang bdca0e328b
[FLINK-35128][cdc-connector][cdc-base] Re-calculate the starting changelog offset after the new table added (#3230) 10 months ago
Leonard Xu ddf557c8e1 [tests][cdc-connector][db2] Improve the DB2 tests
This closes #2870
10 months ago
Leonard Xu 8deddab6eb [minor][cdc-connector][db2] Fix typos and improve the code style 10 months ago
Hongshun Wang 48ca8623bb
[FLINK-34634][cdc-base][mysql] Fix that Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed (#3134) 11 months ago
xleoken 5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110) 11 months ago
Hang Ruan e10c8691ad
[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink
This closes #3089.
12 months ago
Hang Ruan eeb4bab92d [FLINK-34184][cdc][license] Update Copyright from Ververica to Apache 12 months ago
e-mhui ea7b0e8dbb
[cdc-base] Support to parse Oracle/SqlServer/PostgresSQL CDC schema change events (#2315) 1 year ago
Hongshun Wang 1eeda75eaa [cdc-connector][cdc-base] Support capture newly added tables with un-blocking stream read for CDC Framework(#3024) 1 year ago
Yaroslav Tkachenko 1562bc29a3 [cdc-base] Support Scan Newly Added Tables feature 1 year ago
lzshlzsh 9ce36569fb
[cdc-connector][postgres] Fix data lost problem when new lsn committed to slot between snapshotState and notifyCheckpointComplete (#2539)
This closes #2538.
Co-authored-by: sammieliu <sammieliu@tencent.com>
1 year ago
Hongshun Wang 0e4f835f6d [cdc-connector][Postgres] Add SNAPSHOT_ONLY mode for Postgres CDC Source 1 year ago
Hongshun Wang 1cbdb4f8ae [cdc-connector][cdc-base] Add SNAPSHOT_ONLY mode for Incremental CDC Source framework (#2901) 1 year ago
Hongshun Wang 35d3c0ff28
[cdc-base][hotfix] Fix SourceSplitSerializer to get totalFinishedSplitSize from recovery in 4th version
This closes #2992.
1 year ago
Hongshun Wang f57d6f6e67 [cdc-connector][sqlserver] Expose ability to skip backfill in snapshot period for SqlServer CDC.(#2783)
This closes #2783.
1 year ago
Hongshun Wang c6cb3b2371 [cdc-connector][postgres] Expose ability to skip backfill in snapshot period for Postgres CDC. 1 year ago
Hongshun Wang 4e248fad33 [cdc-connector][base] Support skip snapshot backfill for incremental snapshot connector 1 year ago
Hongshun Wang 13be14fe3f [cdc-connector][base][tests] Introduce snapshot phase hooks for better snapshot test 1 year ago
Hongshun Wang 57e4793b21
[cdc-base] Extract the common parts of each ScanFetchTask into AbstractScanFetcherTask.
This closes #2690.
1 year ago
Leonard Xu 995d524416 [3.0][common] Use built-in API annotations to make common module free with flink
This closes #2695.
1 year ago
Maciej Bryński 1e6b983bdd
[build] Bump Flink version to 1.18.0 (#2463)
This closes #2670.
1 year ago
joyCurry30 d01f0a9791
[pom] Use ${revision} replace specific version. (#2623) 1 year ago
Leonard Xu 82a652ca6f
[3.0][kickoff] Introduce basic modules for Flink CDC 3.0
This closes #2610
1 year ago