Commit Graph

243 Commits (bf76afb9bfb1b28ab4e428cb1c10877e395281e1)

Author SHA1 Message Date
gongzhongqiang 721c6d9608 [build] Bump testcontainers version and polish dependency 1 year ago
North.Lin d4461f2383 [hotfix][mysql] Keep assigned splits in order to fix wrong meta group calculation
This closes #2421.

Co-authored-by: Leonard Xu <leonard@apache.org>
(cherry picked from commit dddab4d62b)
1 year ago
Hang Ruan 2ec183a6c1 [mysql] Add finished unack splits to state for the MysqlSourceReader (#2399)
(cherry picked from commit 84e97dfea2)
1 year ago
Hang Ruan e1c5b612b5 [hotfix][mysql] Trim default value for BIGINT and SMALLINT types when parsing MySQL DDL (#2418)
(cherry picked from commit 8e7378d8f9)
1 year ago
Paddy Gu 4fc434e4f8 [mysql] Filter databases that do not need to be read when discovering tables (#2160)
(cherry picked from commit 92aca18152)
1 year ago
Malcolmjian 45b003d5f8 [mysql] quota the field names when executing mysql query (#2381) (#2388)
Co-authored-by: DESKTOP-TQDONF3\狗狗jian <zhangjian@adream.org>
(cherry picked from commit f7df47e2ee)
1 year ago
zhaomin 246e4013e5 [test][mysql] Provide the server-time-zone setting in MySqlSourceExampleTest#testConsumingAllEvents (#2364)
(cherry picked from commit a3ddc488d5)
1 year ago
FocusComputing 20da7adc2c [hotfix][mysql] Catch underlying throwable in snapshot reading.
This closes ##2362.
Co-authored-by: TJX2014 <tangjinxin@deepexi.com>

(cherry picked from commit 094fff41ee)
1 year ago
Hang Ruan 12ebbba750 [hotfix][mysql] Fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource (#2384)
* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource

* [hotfix][mysql] fix failed test LegacyMySqlSourceTest#testSnapshotOnFailedSource

(cherry picked from commit b8f468effe)
1 year ago
Tyrantlucifer 7bb5253465 [polish] Add type parameter for MySqlRecords(#2300)
(cherry picked from commit bca60a44bb)
1 year ago
BIN 409936e28a [hotfix] update dbz option name 'xx. whitelist' to 'xx.include.list'(xx = database, schema or table) (#2212)
(cherry picked from commit ba5fcbc97b)
1 year ago
Leonard Xu 6dba62ece2 [debezium] Fix DebeizumSourceFunction can not do savepoint after close (#2259) 2 years ago
Hang Ruan 8221f51ca8 [mysql] skip closing reader when the reader received the binlog split (#2261) 2 years ago
Hang Ruan cc364a5efc [MySQL] Optimize how to construct config table.include.list (#2274) 2 years ago
empcl 771eff5aab [MySQL] Fix the startup mode exception message (#2264)
Co-authored-by: chenlei677 <chenlei677@jd.com>
2 years ago
SileiWu bcd2ae9e6d [hotfix][mysql] remove unused code (#2231) 2 years ago
Hang Ruan 67c445f2cc
[mysql] Fix assigning duplicate snapshot splits when enable scan newly added tables (#2326) 2 years ago
Hang Ruan 7dbac7277e
[mysql] Remove the finished snapshot splits for the binlog split when restoring from the checkpoint (#2292) (#2318) 2 years ago
gongzhongqiang 53ff798ef6
[docs][hotfix] Update debezium reference links to 1.9 version
This closes #2225.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Co-authored-by: Leonard Xu <leonard@apache.org>
2 years ago
Leonard Xu 92e9d9ea58
[build] Update the copyright year to 2023 (#2205) 2 years ago
wallkop debd6ef404
[mysql] Fix GTID issues to recover from checkpoint normally in specifying startup mode (#2220) 2 years ago
Tigran Manasyan 2b017346c3
[debezium] Bump debezium version to 1.9.7.Final (#2156)
Co-authored-by: gongzhongqiang <764629910@qq.com>
2 years ago
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
2 years ago
Leonard Xu 6f6c978e3d
[tests][mysql] Shutdown mysql container timely for legacy mysql tests
This closes  #2213.
2 years ago
Hang Ruan a95659eea5 [hotfix][Mysql] MySqlBinlogSplitAssigner should support method isStreamSplitAssigned 2 years ago
含风 a6f702d862 [MySQL] Remove deleted tables when using a new table filter and restarting from checkpoint 2 years ago
Leonard Xu 73ba409e25 [mysql] Fix MySql CDC Connector outputs duplicated binlog when enable newly-added-table 2 years ago
Leonard Xu 60eee3a1c5 [mysql][minor] Print clear log information for key path 2 years ago
Jiabao Sun afefe40944
[cdc-base] Close idle readers when snapshot finished (#2202)
* [cdc-base] Close idle readers when snapshot finished
2 years ago
Hang Ruan bb60bfede4
[mysql-cdc] Supports MYSQL_TYPE_TYPED_ARRAY column type when parsing the table map event
This closes #2001
2 years ago
Leonard Xu 892f2d6258 [mysql-cdc][hotfix] Optimize the error msg when binlog expire in source 2 years ago
Leonard Xu b3cd17e1ce [mysql-cdc] Optimize the error msg when binlog expire or server id conflict
This closes #2010.
2 years ago
He Wang 888f92d1a2
[oceanbase] add jdbc options and support oracle mode (#1854) 2 years ago
Leonard Xu 7eceafad9b [mysql-cdc] Add handler for catching async exceptions in snapshot reading executor
This closes #2016.
2 years ago
Hang Ruan 70db0d2958
[hotfix][mysql-cdc] Use session timezone instead of local time zone as the default server time zone
This closes #2015.
2 years ago
Hang Ruan c280d5bcde
[mysql] Fix NullPointerException when database name or table name contains dot
This closes #2006.
2 years ago
Hang Ruan ecad50cc6b [mysql] Fix NullPointerException caused by mysql ignores the capitalization when splitting chunks 2 years ago
Tyrantlucifer 7504217968
[core] support print configuration options for connectors (#2099) 2 years ago
Hang Ruan 0f8023d808
[mysql] Support tables which do not contain a primary key (#2150)
Co-authored-by: zhuyuan03 <zhuyuan03@corp.netease.com>
2 years ago
Hang Ruan 16df76f447
[tests][mysql] Skip unnecessary IT Cases which uses legacy debezium source implementation
This closes #2028.
2 years ago
Hang Ruan 07e4722456
[mysql] Add note for MySQL TINYINT(1) type to Flink SQL Boolean type
This closes #2030.
2 years ago
JasonLee a968a64efa
[mysql-cdc] Fix race condition between split and coordinator thread that async exception might not be caught 2 years ago
zhaomin fe5ee766d5 [mysql/oracle] Fix the wrong comments in ChunkSplitter 2 years ago
Leonard Xu e1ee372481 [mysql] Add various test cases to cover newly added table process from read binlog blocking to read binlog un-blocking 2 years ago
Leonard Xu 4b5f941442 [mysql] Optimize the newly added table process from read binlog blocking to read binlog un-blocking 2 years ago
Leonard Xu 12f700b159 [minor][mysql] Rename SplitsSize to SplitsNumber 2 years ago
Leonard Xu c26fb70512 [hotfix][mysql] Correct meta group id as it is 0 based 2 years ago
Leonard Xu b2db96b1c1 [hotfix][base][tidb][mysql] Fix wrong condition for execution timeout 2 years ago
wuzhenhua 8f920ac552
[minor][common] Improve the changelogMode expression (#1793) 2 years ago
Qingsheng Ren 70f6ad3897
[mysql] Fix backward compatibility on deserializing binlog offset from old versions (#1758)
This closes #1757
2 years ago