flink-cdc-connectors

Commit Graph

Author	SHA1	Message	Date
yuxiqian	0a4c256433	[FLINK-37262][pipeline-connector/mysql] Fix missing PARSE_ONLINE_SCHEMA_CHANGES option in MySqlDataSourceFactory This closes #3910	2 weeks ago
North Lin	8815f2b879	[FLINK-34865][pipeline-connector/mysql] Support sync newly added table's comment This closes #3869	1 month ago
North Lin	bbef6213a6	[hotfix][pipeline-connector][mysql] Fix missed optional option in MySqlDataSourceFactory This closes #3867	1 month ago
Seung-Min Lee	a1c9c19d7d	[FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase This closes #3658	1 month ago
North Lin	9ad071c1fa	[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector (#3608 ) * [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector * reformat code * Update MySqlPipelineITCase.java * pass a boolean value instead of Properties * uodate FAQ * add a method to get tinyInt1isBit * add new cdc config `treat-tinyint1-as-boolean` * Update MySqlChunkSplitter.java * change param name	1 month ago
yuxiqian	e2b8f70e0d	[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs This closes #3860	1 month ago
North Lin	b5d9673258	[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment This closes #3482 Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	1 month ago
yuxiqian	39fd00ce49	[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes (#3668 ) Co-authored-by: MOBIN-F <18814118038@163.com>	1 month ago
moses	98f9f15132	[hotfix][docs] Add missed enumeration in MySQL Source This closes #3832	2 months ago
yuxiqian	9f44c523e4	[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case (#3809 ) Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	2e03f9ad49	[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata This closes #3801	2 months ago
Hang Ruan	a0ae3320fa	[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform (#3758 ) Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>	2 months ago
yuxiqian	6d21941661	[hotfix] Fix Java 11 target compatibility & add tests (#3633 ) * [hotfix] Fix Java 11 target compatibility Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> # Conflicts: # .github/workflows/flink_cdc_java_8.yml # .github/workflows/flink_cdc_migration_test_base.yml # pom.xml * fix: clarify GiHub workflow names Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> --------- Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	57a1a7df93	[FLINK-36408][pipeline-connector][mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision (#3625 )	4 months ago
yuxiqian	cb1b232794	[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup This closes #3580	6 months ago
yuxiqian	0e9a176b08	[hotfix][pipeline-connector/mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax This closes #3579.	6 months ago
Hongshun Wang	afe9c3c0ad	[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true This closes #3573.	6 months ago
Kunni	3c1517f70f	[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent This closes #3570.	6 months ago
yuxiqian	ee843e2f24	[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent This closes #3563. Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>	6 months ago
Kunni	565032e3af	[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-table.enabled option for MySQL Source This closes #3560.	6 months ago
yuxiqian	78fda8b5ab	[FLINK-35243][cdc-common] Extends more schema change event types support This close #3521.	6 months ago
Junbo wang	15ab85860b	[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column (#3490 ) Co-authored-by: wangjunbo <wangjunbo@qiyi.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	7 months ago
Hang Ruan	07446d1f9d	[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData (#3511 )	7 months ago
North Lin	09f36a4a05	[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. (#3411 ) Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com> Co-authored-by: north.lin <north.lin@yunlsp.com>	7 months ago
hk__lrzy	21fade0e22	[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. (#3352 ) Co-authored-by: haoke <haoke@bytedance.com>	7 months ago
lvyanquan	4561a8a32b	[FLINK-34638][cdc-common] Support column with default value	7 months ago
yux	2bd2e4ce24	[FLINK-35121][common] Adds validation for pipeline definition options	9 months ago
North Lin	c958daf8ab	[FLINK-35540][cdc-common] Fix table missed when database and table are with the same name This closes #3396.	9 months ago
yux	17ff659ff7	[hotfix][build] Remove test-jar from parent pom and only add to necessary modules This closes #3397. Co-authored-by: Qingsheng Ren <renqschn@gmail.com>	9 months ago
yux	01ec7da989	[FLINK-35055][cdc] Exclude connector dependencies with questionable licenses from fat jar packages (#3212 )	10 months ago
Thorne	0d797a6021	[FLINK-34903][cdc][mysql] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables (#3186 )	10 months ago
Qishang Zhong	18dd51fe22	[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BINARY data type of Add column DDL (#3145 )	11 months ago
xleoken	5f4f86fb31	[hotfix] Change old com.ververica dependencies to org.apache.flink (#3110 )	11 months ago
Hang Ruan	e10c8691ad	[FLINK-34584][cdc][build] Rename package from com.ververica to org.apache.flink This closes #3089.	12 months ago
Hang Ruan	eeb4bab92d	[FLINK-34184][cdc][license] Update Copyright from Ververica to Apache	12 months ago
Hongshun Wang	7ea197242f	[debezium] Upgrade to Debezium 1.9.8.Final(#3033 ) (#3034 )	1 year ago
joyCurry30	c98f899af8	[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column in DropColumnEvent/AddColumnEvent. (#2888 )	1 year ago
Kunni	9abf2cf900	[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not included in capturedTableFilter (#2986 ) This closes #2981	1 year ago
Hongshun Wang	3bf886b94d	[cdc-connector][mysql] Add SNAPSHOT_ONLY mode for Mysql CDC Source (#2901 )	1 year ago
He Wang	f3762a1b30	[pipeline-connector][mysql] fix timestamp with timezone format (#2952 ) * fix ts with tz parser * test timestamp with default value * fix related test * use timestamp string in test cases	1 year ago
Hongshun Wang	f15faac298	[docs] Fix overview docs to remove prefix of pipeline options (#2833 )	1 year ago
gongzhongqiang	c484bb447c	[build][hotfix] Remove duplicate dependency (#2828 )	1 year ago
Jiabao Sun	8a08ded410	[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion (#2820 ) This closes #2820.	1 year ago
Jiabao Sun	7d7c1af553	[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema (#2816 )	1 year ago
Jiabao Sun	8c75db145d	[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema (#2811 )	1 year ago
Leonard Xu	0eae214183	[pipeline-connector][mysql] Enable send schema change by default (#2815 ) This closes #2815.	1 year ago
Jiabao Sun	8ca3091805	[cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema	1 year ago
Jiabao Sun	08c5dfed83	[cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	1 year ago
Jiabao Sun	174282d3ef	[cdc-pipeline-connector][mysql] Support more mysql types	1 year ago
Hang Ruan	ec3d558485	[cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector	1 year ago

1 2

52 Commits (0211a136cf63a65c0b9a9c3aab322736ceed0faf)