Commit Graph

633 Commits (release-2.4)
 

Author SHA1 Message Date
Jiabao Sun ddd0680009
[cdc-base] JdbcSourceConfig can be template type of DataSourceDialect (#1639) 2 years ago
lidoudou1993 8b2094c5f8
[mysql] Use the latest received meta of binlog split when request the next meta (#1479)
Co-authored-by: lidoudou3 <lidoudou1@jd.com>
2 years ago
sunny 40cd758656
[minor] Use Collections.singletonList instead of Arrays.asList if possible (#1569) 2 years ago
He Wang b1b092c97e
[oceanbase] Add new deserialization schema with runtime converter (#1356)
This closes #980.
2 years ago
Leonard Xu d3435381a6 [mysql] Avoid duplicate split requests when add new table.(#1156)
This closes #1149.
2 years ago
yurunchuan ad80e47c42 [mysql] Avoid duplicate split requests when add new table (#1156) 2 years ago
Leonard Xu fcbed91311 [postgres] Upgrade org.postgresql:postgresql from 42.2.14 to 42.2.26 for CVE-2022-31197 (#1616) 2 years ago
lxxawfl c37b9ed1e9 [test][e2e] Upgrade org.postgresql:postgresql from 42.3.1 to 42.2.26 for CVE-2022-31197(#1616) 2 years ago
Leonard Xu e1ec9906ce [hotfix][typo] Fix typo from schemaLess to schemaless 2 years ago
Hang Ruan 347911c7a0 [cdc-base] Reduce the memory usage of JM by sharing table schemas between splits 2 years ago
Hang Ruan f44d2092c7
[cdc-base] Release the scan fetcher thread resource after reading finished (#1619) 2 years ago
Hang Ruan 806a8505d3
[cdc-base] Optimize pure binlog phase check logic to improve performance (#1620)
This closes #1620.
2 years ago
Hang Ruan 8df5b110ab
[cdc-base] Let all records of one snapshot split don't cross checkpoints (#1622)
This closes #1622.
2 years ago
fbad aac6e31718 [postgres] Introduce changelog mode configuration with upsert/all modes 2 years ago
fbad 9eab82a2f8 [common] Introduce changelog mode configuration with upsert/all modes 2 years ago
hehuiyuan 7b4f31b4e4
[hotfix][docs] Fix docs for scan.incremental.snapshot.chunk.size (#1617) 2 years ago
Hang Ruan 48b8c366fa
[cdc-base] Adopt streaming merge during snapshotSplit scan to avoid OOM
This closes #1618.
2 years ago
Amber Moe 0e4954b4e6 [docs][oceanbase][zh] Add video tutorials that synchronizes data from OceanBase to Elasticsearch (#1604)
This closes #1601
2 years ago
Amber Moe 500aa85d92 [docs][oceanbase] Add video tutorials that synchronizes data from OceanBase to Elasticsearch (#1605)
This closes #1605
2 years ago
Hang Ruan f41faad8dc
[mysql] Fix parse error when ALTER SQL statement contains default string value and collate. (#1544)
This closes #1506
2 years ago
leixin 569c6a525b
[docs][mysql] Add regex examples for multiple tables (#1564)
Co-authored-by: leixin1 <leixin1@jd.com>
2 years ago
He Wang aabec52fcf
[oceanbase] Shade apache commons dependency to avoid class conflict (#1532)
This closes #1352.
2 years ago
gongzhongqiang 38cc01d0eb
[postgres] add geometry type support. (#1554) 2 years ago
gongzhongqiang cdfc86f670
[build] Polish CI scripts and remove useless code (#1540)
This closes #1540.
2 years ago
Hang Ruan 14213087c1
[mysql] fix parsing ddl error when use string default values for numeric types (#1522)
This closes #1522.
2 years ago
Leonard Xu a264188c67
[mysql] Enumerate captured tables lazily (#1507)
This closes #1507.
2 years ago
Leonard Xu 71c16d5d52
[mysql] Reduce the memory usage of JM by sharing table schemas between splits (#1523)
This closes #865.
2 years ago
empcl cf8a2f4b07
[hotfix][docs] Fix comment typo in MysqlSnapshotSplit (#1513)
Co-authored-by: chenlei677 <chenlei677@jd.com>
2 years ago
Leonard Xu 72c806cb9d
[mysql] Let all records of one snapshot split don't cross checkpoints (#1505)
This closes #1505.
2 years ago
Sergey Nuyanzin 9f97e06f32
[tests] Remove usage of deprecated EnvironmentSettings.Builder#useBlinkPlanner (#1493)
This closes #1493.
2 years ago
Leonard Xu 238305b2d9
[cdc-base][mysql] Fix split key comparison when may contain different types (#1499)
This closes #1496.
2 years ago
leixin dbd184ec36
[docs][mysql] Update the description of mysql server-time-zone option (#1497)
Co-authored-by: leixin1 <leixin1@jd.com>
2 years ago
Kyle Dong b3ebf3da69
[mysql] Use local timezone as the default value of 'server-time-zone' option (#1407)
This closes  #1406.
2 years ago
JiaJia 11c1d84dfa
[docs][postgres] Add two frequently debezium options in Postgres connector document (#1142)
This closes #1142.
3 years ago
vanliu ed980ef499
[mongodb] Allow mongo ARRAY to be converted to string type in Flink (#1475) 3 years ago
skylines 1b17a751cc
[hotfix][docs] Fix the page links in MySQL Chinese document (#1466)
This closes #1466.
3 years ago
He Wang d0d40d05c7
[oceanbase][test] Use memory mode of obcdc and double startup timeout duration (#1474)
This closes #1473.
3 years ago
Leonard Xu cfbd00fa34 [mysql][polardbx] Stop container timely in tests (#1468) 3 years ago
Hang Ruan 7c9b30276d [mysql][ploardbx] Support all charsets in column level (#1166)
This closes #1166.
3 years ago
Jiabao Sun 3d255fca83
[mongodb] Expose updateLookup option for stream source. (#1461) 3 years ago
He Wang e83810ff67
[oceanbase] Use utc offset as 'server-time-zone' option's default value (#1443) 3 years ago
lidoudou1993 6a2f470ae3
[mysql][minor] Skip capture newly added tables according snapshotassigner's status (#1449)
Co-authored-by: lidoudou3 <lidoudou1@jd.com>
3 years ago
Leonard Xu 638474d6c7 [polardbx][test] Bump the polardb-x image version from 2.0.1 to 2.10 (#1423) 3 years ago
He Wang 299cfc8232 [build][test] Specify surefire provider to surefire-junit47 (#1423)
This closes #1416, #1423
3 years ago
legendtkl 617a29be2c
[hotfix][docs] Fix typo in bug report doc (#1460)
Co-authored-by: taokelu <taokelu@bytedance.com>
3 years ago
Leonard Xu dda1c3e6a1 [minor][oracle] Rename JdbcConfigurationUtil to OracleJdbcUrlUtils 3 years ago
dujie 0292a39a3c [oracle] Support custom JDBC URL for Oracle (#1258)
This closes #1244.
3 years ago
empcl 45fd69692f
[docs] Correct the data type of 'server-id' option to String (#1444)
Co-authored-by: chenlei677 <chenlei677@jd.com>
3 years ago
Hang Ruan 6a56985fa8
[hotfix][test] Fix MySqlSourceITCase failure due to StreamExecutionEnvironment#getConfiguration returned unmodifiable object (#1446) 3 years ago
Hang Ruan 2bb5b6f625
[test] Fix tests missed 'update_before' records if the primary keys of source and sink are different (#1451) 3 years ago