279 Commits (0211a136cf63a65c0b9a9c3aab322736ceed0faf)

Author	SHA1	Message	Date
Ferenc Csaky	0211a136cf	[FLINK-37152][build] Update Flink version to 1.20 ... This closes #3868.	5 days ago
yuxiqian	858371c845	[FLINK-37306][tests] Fix MySQLSourceITCase failure in non-UTC timezone ... This closes #3917	1 week ago
yohei yoshimuta	39608ed663	[FLINK-36945][cdc-connector/mysql] Support parsing rename multiple tables in one statement ... This closes #3876.	2 weeks ago
Kunni	cd1fb6f980	[FLINK-37191][cdc-connector/mysql] Avoid back filling when lowWatermark is equal to highWatermark in BinlogSplit ... This closes #3902	2 weeks ago
yuxiqian	0a4c256433	[FLINK-37262][pipeline-connector/mysql] Fix missing PARSE_ONLINE_SCHEMA_CHANGES option in MySqlDataSourceFactory ... This closes #3910	2 weeks ago
yuxiqian	82bf8a08ef	[tests][ci] Miscellaneous improvements on CI robustness ... This closes #3911	2 weeks ago
Shawn Huang	6686bcb4ad	[hotfix][license] Update legacy license ... This closes #3908	2 weeks ago
Junbo wang	c28431832c	[FLINK-36698][pipeline-connector][elasticsearch] Elasticsearch Pipeline Sink supports index sharding ... This closes #3723. Co-authored-by: wangjunbo <wangjunbo@qiyi.com>	3 weeks ago
North Lin	8815f2b879	[FLINK-34865][pipeline-connector/mysql] Support sync newly added table's comment ... This closes #3869	1 month ago
North Lin	bbef6213a6	[hotfix][pipeline-connector][mysql] Fix missed optional option in MySqlDataSourceFactory ... This closes #3867	1 month ago
Seung-Min Lee	a1c9c19d7d	[FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase ... This closes #3658	1 month ago
Olivier	7997f51c55	[FLINK-35067][cdc-connector][postgres] Adding metadata 'row_kind' for Postgres CDC Connector. ... This closes #3716. Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	1 month ago
Kunni	a16abd5d24	[FLINK-36913][pipeline-connector][kafka] Introduce option to define custom mapping from upstream table id to downstream topic name ... This closes #3805	1 month ago
wudi	2fa215e5c4	[FLINK-35600][pipeline-connector/mysql] Add timestamp for low and high watermark ... This closes #3415	1 month ago
Kunni	afd4a74c0a	[FLINK-35802][pipeline-connectors/mysql] Clean ChangeEventQueue to avoid deadlock when calling BinaryLogClient#disconnect method ... This closes #3463	1 month ago
Petrichor	177da16fac	[FLINK-36351][pipeline-connector/doris] Support the conversion of Flink TIME type to Doris String type ... This closes #3620	1 month ago
Sergei Morozov	5691b7bf97	[FLINK-36406][cdc-runtime] Close MetadataApplier when the job stops ... This closes #3623	1 month ago
North Lin	9ad071c1fa	[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector (#3608) ... * [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector * reformat code * Update MySqlPipelineITCase.java * pass a boolean value instead of Properties * uodate FAQ * add a method to get tinyInt1isBit * add new cdc config `treat-tinyint1-as-boolean` * Update MySqlChunkSplitter.java * change param name	1 month ago
Jason Zhang	47e5cd6d89	[hotfix][pipeline-connector][maxcompute] Fix MaxCompute Pipeline Connector tests by upgrading maxcompute-emulator ... This closes #3862	1 month ago
yuxiqian	e2b8f70e0d	[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs ... This closes #3860	1 month ago
North Lin	b5d9673258	[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment ... This closes #3482 Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	1 month ago
Wink	79e868b864	[FLINK-36741][transform] Fix the decimal precision and length lost during transform ... This closes #3740	1 month ago
hiliuxg	8b554458d3	[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent ... This closes #3824. Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	1 month ago
Hongshun Wang	bcd70df85c	[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat ... This closes #3667	1 month ago
Junbo wang	0f675061e1	[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication ... This closes #3728	1 month ago
yuxiqian	56dbb1fd53	[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris ... This closes #3673	1 month ago
moses	4dc31d8c61	[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style ... This closes #3852	1 month ago
hiliuxg	32934393ce	[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon ... This closes #3828.	1 month ago
MOBIN	a130718c96	[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20 ... This closes #3784 Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>	1 month ago
Kunni	75b8a0cdf3	[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink ... This closes #3818 Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>	1 month ago
yuxiqian	39fd00ce49	[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes (#3668) ... Co-authored-by: MOBIN-F <18814118038@163.com>	1 month ago
Shawn Huang	085684b773	[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished (#3793)	1 month ago
Kunni	7b01d9ca40	[hotfix][ci] Fix CI failure due to implicit conflicts ... This closes #3846	2 months ago
Jzjsnow	630e0d70c2	[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover ... This closes #3802 Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>	2 months ago
Kunni	28985db062	[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record ... This closes #3788	2 months ago
Kunni	d3c049d8a7	[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0 ... This closes #3644	2 months ago
Jason Zhang	92081dfe58	[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink ... This closes #3254.	2 months ago
moses	98f9f15132	[hotfix][docs] Add missed enumeration in MySQL Source ... This closes #3832	2 months ago
Umesh Dangat	baba9c6ae6	[FLINK-37017][cdc-common] Supports map and array types for binary record data ... This closes #3434.	2 months ago
yuanoOo	6a345aaa80	[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC ... This closes #3360.	2 months ago
stayrascal	dca94bdd71	[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem ... This closes #3760 Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>	2 months ago
yuxiqian	ddb5f00df5	[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` (#3831) ... Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	9f44c523e4	[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case (#3809) ... Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	2e03f9ad49	[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata ... This closes #3801	2 months ago
Hang Ruan	a0ae3320fa	[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform (#3758) ... Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>	2 months ago
yuxiqian	6d21941661	[hotfix] Fix Java 11 target compatibility & add tests (#3633) ... * [hotfix] Fix Java 11 target compatibility Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> # Conflicts: # .github/workflows/flink_cdc_java_8.yml # .github/workflows/flink_cdc_migration_test_base.yml # pom.xml * fix: clarify GiHub workflow names Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> --------- Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>	2 months ago
yuxiqian	dfbaf617e2	[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18 ... This closes #3647.	2 months ago
ouyangwulin	0b0bb02023	[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797)	2 months ago
Hongshun Wang	12cf22f7b4	[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510)	2 months ago
Sergei Morozov	b50d1728e0	[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source ... This closes #3794.	2 months ago