flink-cdc-connectors

Commit Graph

Author	SHA1	Message	Date
North Lin	8815f2b879	[FLINK-34865][pipeline-connector/mysql] Support sync newly added table's comment This closes #3869	2 weeks ago
North Lin	bbef6213a6	[hotfix][pipeline-connector][mysql] Fix missed optional option in MySqlDataSourceFactory This closes #3867	2 weeks ago
Seung-Min Lee	a1c9c19d7d	[FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase This closes #3658	2 weeks ago
Olivier	7997f51c55	[FLINK-35067][cdc-connector][postgres] Adding metadata 'row_kind' for Postgres CDC Connector. This closes #3716. Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	2 weeks ago
Kunni	a16abd5d24	[FLINK-36913][pipeline-connector][kafka] Introduce option to define custom mapping from upstream table id to downstream topic name This closes #3805	2 weeks ago
wudi	2fa215e5c4	[FLINK-35600][pipeline-connector/mysql] Add timestamp for low and high watermark This closes #3415	2 weeks ago
Kunni	afd4a74c0a	[FLINK-35802][pipeline-connectors/mysql] Clean ChangeEventQueue to avoid deadlock when calling BinaryLogClient#disconnect method This closes #3463	2 weeks ago
Petrichor	177da16fac	[FLINK-36351][pipeline-connector/doris] Support the conversion of Flink TIME type to Doris String type This closes #3620	2 weeks ago
Sergei Morozov	5691b7bf97	[FLINK-36406][cdc-runtime] Close MetadataApplier when the job stops This closes #3623	2 weeks ago
North Lin	9ad071c1fa	[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector (#3608 ) * [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector * reformat code * Update MySqlPipelineITCase.java * pass a boolean value instead of Properties * uodate FAQ * add a method to get tinyInt1isBit * add new cdc config `treat-tinyint1-as-boolean` * Update MySqlChunkSplitter.java * change param name	2 weeks ago
Jason Zhang	47e5cd6d89	[hotfix][pipeline-connector][maxcompute] Fix MaxCompute Pipeline Connector tests by upgrading maxcompute-emulator This closes #3862	2 weeks ago
yuxiqian	e2b8f70e0d	[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs This closes #3860	2 weeks ago
North Lin	b5d9673258	[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment This closes #3482 Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	2 weeks ago
Wink	79e868b864	[FLINK-36741][transform] Fix the decimal precision and length lost during transform This closes #3740	2 weeks ago
hiliuxg	8b554458d3	[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent This closes #3824. Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	2 weeks ago
Hongshun Wang	bcd70df85c	[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat This closes #3667	2 weeks ago
Junbo wang	0f675061e1	[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication This closes #3728	2 weeks ago
yuxiqian	56dbb1fd53	[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris This closes #3673	2 weeks ago
moses	4dc31d8c61	[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style This closes #3852	2 weeks ago
hiliuxg	32934393ce	[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon This closes #3828.	2 weeks ago
MOBIN	a130718c96	[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20 This closes #3784 Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	3 weeks ago
Kunni	75b8a0cdf3	[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink This closes #3818 Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>	3 weeks ago
yuxiqian	39fd00ce49	[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes (#3668 ) Co-authored-by: MOBIN-F <18814118038@163.com>	3 weeks ago
Shawn Huang	085684b773	[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished (#3793 )	3 weeks ago
Kunni	7b01d9ca40	[hotfix][ci] Fix CI failure due to implicit conflicts This closes #3846	3 weeks ago
Jzjsnow	630e0d70c2	[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover This closes #3802 Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>	3 weeks ago
Kunni	28985db062	[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record This closes #3788	3 weeks ago
Kunni	d3c049d8a7	[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0 This closes #3644	3 weeks ago
Jason Zhang	92081dfe58	[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink This closes #3254.	3 weeks ago
moses	98f9f15132	[hotfix][docs] Add missed enumeration in MySQL Source This closes #3832	3 weeks ago
Umesh Dangat	baba9c6ae6	[FLINK-37017][cdc-common] Supports map and array types for binary record data This closes #3434.	4 weeks ago
yuanoOo	6a345aaa80	[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC This closes #3360.	4 weeks ago
stayrascal	dca94bdd71	[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem This closes #3760 Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>	4 weeks ago
yuxiqian	ddb5f00df5	[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` (#3831 ) Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	4 weeks ago
yuxiqian	9f44c523e4	[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case (#3809 ) Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	1 month ago
yuxiqian	2e03f9ad49	[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata This closes #3801	1 month ago
Hang Ruan	a0ae3320fa	[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform (#3758 ) Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>	1 month ago
yuxiqian	6d21941661	[hotfix] Fix Java 11 target compatibility & add tests (#3633 ) * [hotfix] Fix Java 11 target compatibility Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> # Conflicts: # .github/workflows/flink_cdc_java_8.yml # .github/workflows/flink_cdc_migration_test_base.yml # pom.xml * fix: clarify GiHub workflow names Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> --------- Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	1 month ago
yuxiqian	dfbaf617e2	[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18 This closes #3647.	2 months ago
ouyangwulin	0b0bb02023	[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797 )	2 months ago
Hongshun Wang	12cf22f7b4	[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510 )	2 months ago
Sergei Morozov	b50d1728e0	[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source This closes #3794.	2 months ago
Xin Gong	0037c4379e	[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] (#3755 )	2 months ago
yuxiqian	2e54caf9dd	[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests This closes #3792	2 months ago
Hang Ruan	fd82126c7d	[FLINK-36878][pipeline-connector][kafka] Shade org.apache.kafka with org.apache.flink.kafka.shaded.org.apache.kafka instead of cdc path This closes #3790.	2 months ago
liuxiaodong	ee9cd828c3	[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics (#3619 ) Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com> Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>	2 months ago
yuxiqian	26f5880fbf	[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases (#3712 )	2 months ago
Hang Ruan	23e8149e6a	[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit (#3763 )	2 months ago
Xin Gong	1d4e366969	[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions This closes #3754	2 months ago
Leonard Xu	d0b2fe38a2	[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 (#3748 )	2 months ago

1 2 3 4 5 ...

271 Commits (master)