Commit Graph

221 Commits (d8c1e335dcf0b66595e84f85266c21d56a8252c5)

Author SHA1 Message Date
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
2 years ago
Leonard Xu 6f6c978e3d
[tests][mysql] Shutdown mysql container timely for legacy mysql tests
This closes  #2213.
2 years ago
Hang Ruan a95659eea5 [hotfix][Mysql] MySqlBinlogSplitAssigner should support method isStreamSplitAssigned 2 years ago
含风 a6f702d862 [MySQL] Remove deleted tables when using a new table filter and restarting from checkpoint 2 years ago
Leonard Xu 73ba409e25 [mysql] Fix MySql CDC Connector outputs duplicated binlog when enable newly-added-table 2 years ago
Leonard Xu 60eee3a1c5 [mysql][minor] Print clear log information for key path 2 years ago
Jiabao Sun afefe40944
[cdc-base] Close idle readers when snapshot finished (#2202)
* [cdc-base] Close idle readers when snapshot finished
2 years ago
Hang Ruan bb60bfede4
[mysql-cdc] Supports MYSQL_TYPE_TYPED_ARRAY column type when parsing the table map event
This closes #2001
2 years ago
Leonard Xu 892f2d6258 [mysql-cdc][hotfix] Optimize the error msg when binlog expire in source 2 years ago
Leonard Xu b3cd17e1ce [mysql-cdc] Optimize the error msg when binlog expire or server id conflict
This closes #2010.
2 years ago
He Wang 888f92d1a2
[oceanbase] add jdbc options and support oracle mode (#1854) 2 years ago
Leonard Xu 7eceafad9b [mysql-cdc] Add handler for catching async exceptions in snapshot reading executor
This closes #2016.
2 years ago
Hang Ruan 70db0d2958
[hotfix][mysql-cdc] Use session timezone instead of local time zone as the default server time zone
This closes #2015.
2 years ago
Hang Ruan c280d5bcde
[mysql] Fix NullPointerException when database name or table name contains dot
This closes #2006.
2 years ago
Hang Ruan ecad50cc6b [mysql] Fix NullPointerException caused by mysql ignores the capitalization when splitting chunks 2 years ago
Tyrantlucifer 7504217968
[core] support print configuration options for connectors (#2099) 2 years ago
Hang Ruan 0f8023d808
[mysql] Support tables which do not contain a primary key (#2150)
Co-authored-by: zhuyuan03 <zhuyuan03@corp.netease.com>
2 years ago
Hang Ruan 16df76f447
[tests][mysql] Skip unnecessary IT Cases which uses legacy debezium source implementation
This closes #2028.
2 years ago
Hang Ruan 07e4722456
[mysql] Add note for MySQL TINYINT(1) type to Flink SQL Boolean type
This closes #2030.
2 years ago
JasonLee a968a64efa
[mysql-cdc] Fix race condition between split and coordinator thread that async exception might not be caught 2 years ago
zhaomin fe5ee766d5 [mysql/oracle] Fix the wrong comments in ChunkSplitter 2 years ago
Leonard Xu e1ee372481 [mysql] Add various test cases to cover newly added table process from read binlog blocking to read binlog un-blocking 2 years ago
Leonard Xu 4b5f941442 [mysql] Optimize the newly added table process from read binlog blocking to read binlog un-blocking 2 years ago
Leonard Xu 12f700b159 [minor][mysql] Rename SplitsSize to SplitsNumber 2 years ago
Leonard Xu c26fb70512 [hotfix][mysql] Correct meta group id as it is 0 based 2 years ago
Leonard Xu b2db96b1c1 [hotfix][base][tidb][mysql] Fix wrong condition for execution timeout 2 years ago
wuzhenhua 8f920ac552
[minor][common] Improve the changelogMode expression (#1793) 2 years ago
Qingsheng Ren 70f6ad3897
[mysql] Fix backward compatibility on deserializing binlog offset from old versions (#1758)
This closes #1757
2 years ago
Qingsheng Ren f2d2b98a3e [mysql] Improve error message under the case that start reading from earliest but schema change happened before (#1724) 2 years ago
Qingsheng Ren f2bef23bc7 [mysql] Use event filter to drop events earlier than the specified timestamp in timestamp startup mode (#1724) 2 years ago
ehui 6d0cdbcc6e
[mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart  (#1627)
* [mysql] Fix MySqlBinlogSplitAssigner may reassign split after exception restart
2 years ago
Leonard Xu a7f1970e1f [build] Bump version to 2.4-SNAPSHOT 2 years ago
Leonard Xu e4dcd10ec8 [oracle][mysql] Improve the Oracle all data types test and clean up debug logs 2 years ago
Qingsheng Ren c07451884d [hotfix][mysql] Remove unused constructor in MySqlTableSource 2 years ago
Qingsheng Ren aca5643704 [mysql] Support starting reading binlog from earliest offset / specific offset / timestamp (#1661)
This closes #254
2 years ago
Tigran Manasyan 5b3dd9884e
[common] Bump Flink version to 1.15.2 (#1504)
This closes #1363. 

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Hang Ruan a4b969d4a3
[mysql] ChunkSplitter supports to snapshot when splitting chunks for a table (#1463)
This closes #1463.

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 years ago
lidoudou1993 8b2094c5f8
[mysql] Use the latest received meta of binlog split when request the next meta (#1479)
Co-authored-by: lidoudou3 <lidoudou1@jd.com>
2 years ago
sunny 40cd758656
[minor] Use Collections.singletonList instead of Arrays.asList if possible (#1569) 2 years ago
Leonard Xu d3435381a6 [mysql] Avoid duplicate split requests when add new table.(#1156)
This closes #1149.
2 years ago
yurunchuan ad80e47c42 [mysql] Avoid duplicate split requests when add new table (#1156) 2 years ago
Leonard Xu e1ec9906ce [hotfix][typo] Fix typo from schemaLess to schemaless 2 years ago
Hang Ruan f41faad8dc
[mysql] Fix parse error when ALTER SQL statement contains default string value and collate. (#1544)
This closes #1506
2 years ago
Hang Ruan 14213087c1
[mysql] fix parsing ddl error when use string default values for numeric types (#1522)
This closes #1522.
2 years ago
Leonard Xu a264188c67
[mysql] Enumerate captured tables lazily (#1507)
This closes #1507.
2 years ago
Leonard Xu 71c16d5d52
[mysql] Reduce the memory usage of JM by sharing table schemas between splits (#1523)
This closes #865.
2 years ago
empcl cf8a2f4b07
[hotfix][docs] Fix comment typo in MysqlSnapshotSplit (#1513)
Co-authored-by: chenlei677 <chenlei677@jd.com>
2 years ago
Leonard Xu 72c806cb9d
[mysql] Let all records of one snapshot split don't cross checkpoints (#1505)
This closes #1505.
2 years ago
Sergey Nuyanzin 9f97e06f32
[tests] Remove usage of deprecated EnvironmentSettings.Builder#useBlinkPlanner (#1493)
This closes #1493.
2 years ago
Leonard Xu 238305b2d9
[cdc-base][mysql] Fix split key comparison when may contain different types (#1499)
This closes #1496.
2 years ago