Commit Graph

48 Commits (fdcb2f02e0523ea3521c63a5d2b891c6a385253d)

Author SHA1 Message Date
Hang Ruan d3ed1a7714
[postgres] Fix the slot name conflict bug (#2251) (#2281) 2 years ago
BIN ba5fcbc97b
[hotfix] update dbz option name 'xx. whitelist' to 'xx.include.list'(xx = database, schema or table) (#2212) 2 years ago
gongzhongqiang 53ff798ef6
[docs][hotfix] Update debezium reference links to 1.9 version
This closes #2225.

Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
Co-authored-by: Leonard Xu <leonard@apache.org>
2 years ago
Leonard Xu 92e9d9ea58
[build] Update the copyright year to 2023 (#2205) 2 years ago
Hang Ruan 960ef134bc [postgres] scan.incremental.snapshot.enabled is closed by default 2 years ago
Hang Ruan 6d6881663a [postgres] Backfill task will be able to end when there is not new change data but read the ending lsn 2 years ago
Hang Ruan 1a69cef424 [postgres] Create slot for backfill task before snapshot reading
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 years ago
Hang Ruan da5e6a7872 [postgres] Prepare a slot for the unique global stream split
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 years ago
Tigran Manasyan 2b017346c3
[debezium] Bump debezium version to 1.9.7.Final (#2156)
Co-authored-by: gongzhongqiang <764629910@qq.com>
2 years ago
Hang Ruan 2d08513f39
[Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
Co-authored-by: Xiao Meng <21000+xiaom@users.noreply.github.com>
Co-authored-by: Yaroslav Tkachenko <260702+sap1ens@users.noreply.github.com>
2 years ago
Tyrantlucifer 7504217968
[core] support print configuration options for connectors (#2099) 2 years ago
Sergey Nuyanzin c3a88f0638
[common] Bump flink to 1.17.0 (#2057)
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 years ago
Hang Ruan 727a0706a8
[postgres] Change config option slot.name to be required (#1996) 2 years ago
fbad aac6e31718 [postgres] Introduce changelog mode configuration with upsert/all modes 2 years ago
gongzhongqiang 38cc01d0eb
[postgres] add geometry type support. (#1554) 2 years ago
Sergey Nuyanzin 9f97e06f32
[tests] Remove usage of deprecated EnvironmentSettings.Builder#useBlinkPlanner (#1493)
This closes #1493.
3 years ago
Hang Ruan 2bb5b6f625
[test] Fix tests missed 'update_before' records if the primary keys of source and sink are different (#1451) 3 years ago
Leonard Xu a10ae4624e
[build] Use correct year and copyright owner in license files (#1390)
This closes #1389.
3 years ago
Sergey Nuyanzin 2f3c872306
[build] Bump Flink version to 1.14.4 (#1284)
This closes #1284
3 years ago
Qingsheng Ren f9a8c403c8
[common] Apply filter on ResolvedSchema to keep physical columns only (#1092) 3 years ago
Zongwen Li a8879bf4b0
[mongodb] Correct the TypeInformation argument of DebeziumDeserializationSchema in SourceFuntion (#780) 3 years ago
gongzhongqiang 1b34887c08
[common] Use ResolvedSchema instead of deprecated TableSchema API (#782) 3 years ago
gongzhongqiang 5c7e2602be
[sqlserver] Add SqlServer cdc connector (#662)
Co-authored-by: Leonard Xu <leonard@apache.org>
3 years ago
Leonard Xu 29a441a571 [postgres] Support 'schema-name' metadata column for postgres-cdc connector 3 years ago
gongzhongqiang 0bd39e5310
[postgres] Support metadata columns for postgres-cdc connector (#500)
Co-authored-by: Leonard Xu <xbjtdcq@163.com>
3 years ago
Jark Wu 12f27acda2
[mysql] Support metadata columns for mysql-cdc connector (#496) 3 years ago
dongdongking008 d40765eb32
[postgres] Fix postgres-cdc connector cannot recognize the optional option 'slot.name' 4 years ago
gongzhongqiang 08e9c756e1
[docs] Update the debezium document link to version 1.5 4 years ago
Shengkai 2f644007e2
[mysql] Validate MySQL server configuration (version, binlog_format, binlog_row_image) before start job
This closes #211
4 years ago
Leonard Xu 8162dc7ae3
[build] Rename group.id and packge name from 'com.alibaba.ververica' to 'com.ververica' (#287) 4 years ago
Shengkai fcea3d14f7
[common] Fix schema history run out of memory
Fix schema history run out of memory, this close (#207)

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
4 years ago
Leonard Xu 1436410adf
[debezium] Bump Flink version to 1.13.0 (#176) 4 years ago
Jark Wu 116cea690d
[mysql] Minor code improvement 4 years ago
Jark Wu 8925d943bf
[build] Format code with Spotless/google-java-format 4 years ago
赵万梓 c34d9776e7
[postgres] Flush LSN offset to PG even if no updates to the monitored tables to avoid infinite WAL segments (#111)
This closes #111
4 years ago
Jark Wu 4127661092
[postgres] Flush LSN offset to PG after checkpoint complete to avoid infinite WAL segments 4 years ago
Jark Wu 0ce58b4ff5
[postgres] Support 'slot.name' option for postgres-cdc connector 4 years ago
Jark Wu c47526737e
[mysql] Improve implementation of specifying binlog position and add tests 4 years ago
jiabao.sun 2dfb59f3c7
[build] Bump up Flink version to 1.12.1 (#95) 4 years ago
Jark Wu 05a28a4428
[build] Set up CI with Azure Pipelines (#108)
This requires to upgrade testcontainers to 1.15.1 to fix can't pull images problem
4 years ago
陈小东 6c4f1f8528 [fix bug] offset state missing if no binlog fetched tile checkpoint after restore. 4 years ago
Jark Wu 3dc2f0d5cf
[mysql][postgres] Use underscore for the database.server.name to avoid Kafka warning log 5 years ago
Jark Wu 5e9aa0b733
[mysql] Ignore exceptions when encountered unparseable DDL 5 years ago
Jark Wu f6b7b35a35
Support to parse MySQL TIMESTAMP type and support "server-time-zone" option
This fixes #17 and #16
5 years ago
qinshiwei c89b46f14a
Support "debezium.*" option to pass through the Debezium's properties
This closes #15
5 years ago
Jark Wu 97b95eda77
Move test utils to a separate module 5 years ago
Jark Wu ad6eeb0fa6
[mysql][postgres] Rename MySqlBinlogSource and PostgreSqlChangelogSource to MySQLSource and PostgreSQLSource 5 years ago
Jark Wu 94e7703f96
[postgres] Add PostgreSQL CDC source connector 5 years ago