This project provides a set of source connectors for Apache Flink® directly ingesting changes coming from different databases using Change Data Capture(CDC).
Users can consume changes on multiple databases and tables in a single job without Debezium and Apache Kafka® deployed.
Getting Started
CDC Connectors for Apache Flink® provides a series of quick start demos without any dependencies or java code, only a Linux or MacOS computer with Docker installed is enough. With these demos, you can quickly feel the power and convenience of Apache Flink® CDC.
-- creates a mysql cdc table sourceCREATE TABLE mysql_binlog ( id INT NOT NULL, name STRING, description STRING, weight DECIMAL(10,3), PRIMARY KEY(id) NOT ENFORCED) WITH ( 'connector' = 'mysql-cdc', 'hostname' = 'localhost', 'port' = '3306', 'username' = 'flinkuser', 'password' = 'flinkpw', 'database-name' = 'inventory', 'table-name' = 'products');-- read snapshot and binlog data from mysql-- and do some transformation-- and show on the clientSELECT id, UPPER(name), description, weight FROM mysql_binlog;
Connect to Your Favorite Database
CDC Connectors for Apache Flink® supports ingesting snapshot data and real time changes from databases to Flink® and then transform and sink to various downstream systems.
