3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
...
This closes #3744 .
3 months ago
01a1e5fba5
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type ( #3683 )
3 months ago
dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 ( #3660 )
...
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
...
This closes #3691 .
3 months ago
13248faa22
[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp
...
This closes #3332
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
ae986ab3f6
[FLINK-36609][pipeline-connector][paimon] Add partition columns to primary keys
...
This closes #3641 .
4 months ago
f38341b02e
[FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
...
This closes #3652 .
4 months ago
ff77a490bd
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
...
This closes #3639
4 months ago
8647fe4986
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColunEvent
...
This closes #3622 .
4 months ago
57a1a7df93
[FLINK-36408][pipeline-connector][mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision ( #3625 )
4 months ago
ecfee702dc
[FLINK-36560][pipeline-connector][paimon] Fix the issue that timestamp_ltz field is not correctly converted
...
This closes #3648 .
4 months ago
be9b52750c
[FLINK-36572][pipeline-connector][starrocks] Fix the issue that the local time zone is wrongly set
...
This closes #3655 .
4 months ago
7f6d9115ae
[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error ( #3678 )
4 months ago
d5f1b9ace8
[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase ( #3602 )
4 months ago
84f97ed4c1
[FLINK-36474][route] Support merging timestamp columns when routing
...
This closes #3636 .
4 months ago
e692e7b4bc
[FLINK-36052][docs][cdc-pipeline-connector/es] Add flink cdc pipeline elasticsearch connector docs
...
This closes #3649 .
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
4 months ago
086bd9996a
[FLINK-36618][cdc-connector][postgres] Improve PostgresDialect.discoverDataCollections to reduce the bootstrap time
...
This closes #3672 .
4 months ago
f24399cf5a
[FLINK-36211][pipeline-connector/kafka] shade org.apache.flink.streaming.connectors.kafka to avoid conflict with flink-connector-kafka jar. ( #3595 )
4 months ago
ecce75949a
[FLINK-36463][cdc-connector][mysql] Forbid to override some debezium options ( #3631 )
4 months ago
d5f549f91f
[FLINK-36326][cdc-connector][mysql] Send BinlogSplitUpdateRequestEvent only once to fix auto scan newly-added table failure ( #3613 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
4 months ago
daf27fa7a8
[hotfix][test] Reorganize test cases
4 months ago
a5b666a325
[FLINK-35503] Add support for running Oracle connector unit test on ARM architecture ( #3600 )
5 months ago
cb1b232794
[minor][tests] Fix test testDanglingDroppingTableDuringBinlogMode due to imprecise timestamp startup
...
This closes #3580
6 months ago
0e9a176b08
[hotfix][pipeline-connector/mysql] Fix primary key restraints missing when using inline `PRIMARY KEY` declaration syntax
...
This closes #3579 .
6 months ago
afe9c3c0ad
[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true
...
This closes #3573 .
6 months ago
3c1517f70f
[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent
...
This closes #3570 .
6 months ago
aea2b6aa9c
[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run ( #3555 )
6 months ago
52f2019469
[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp
...
This closes #3561 .
6 months ago
ee843e2f24
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
...
This closes #3563 .
Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>
6 months ago
565032e3af
[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-table.enabled option for MySQL Source
...
This closes #3560 .
6 months ago
6205a5a0f1
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
...
This closes #3558 .
6 months ago
77c63385d9
[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart ( #3548 )
...
Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>
6 months ago
aedccb698e
[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCommittableChannelComputer Topology name
...
This closes #3559
6 months ago
78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
...
This close #3521 .
6 months ago
7f08c6caba
[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration
...
This closes #3553
6 months ago
0470fdbbc1
[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink
...
This closes #3549
6 months ago
cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network ( #3439 )
6 months ago
c5396fbf29
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version
...
This closes #3542 .
6 months ago
d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts ( #3540 )
7 months ago
8137f9d746
[FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions
...
This closes #3495 .
7 months ago
ac14dba9fb
[FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline
7 months ago
15ab85860b
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column ( #3490 )
...
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
7 months ago
64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
...
This closes #3499 .
7 months ago
3bb1f3ca45
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit
...
This closes #3504 .
7 months ago
e0d6d1d1a8
[FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option to make sure the same record sending to the same partition. ( #3522 )
7 months ago
4bf5a395a5
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly
...
This closes #3519 .
7 months ago
07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData ( #3511 )
7 months ago
09f36a4a05
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. ( #3411 )
...
Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com>
Co-authored-by: north.lin <north.lin@yunlsp.com>
7 months ago
b937db25d5
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling ( #3506 )
7 months ago
9d6154f123
[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink ( #3461 )
7 months ago
21fade0e22
[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. ( #3352 )
...
Co-authored-by: haoke <haoke@bytedance.com>
7 months ago
5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
...
This closes #3339 .
7 months ago
4561a8a32b
[FLINK-34638][cdc-common] Support column with default value
7 months ago
1778ef685a
Revert "[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available "
...
This reverts commit 3315be3c8f
7 months ago
7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
...
This closes #3449 .
Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
7 months ago
3315be3c8f
[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available
...
This closes #3508 .
7 months ago
f6d1d4810a
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly ( #3497 )
...
* resolve conficts
* polish code to trigger ci
---------
Co-authored-by: Kael <kael@fts.dev>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
7 months ago
986f37b307
[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file ( #3432 )
7 months ago
0c49959f67
[FLINK-35524][cdc-base] Clear connections pools when reader exist. ( #3388 )
7 months ago
47f5660055
[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter ( #3319 )
7 months ago
a39959f4b3
[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris pipeline sink
...
This closes #3473
7 months ago
b15a226ccd
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2
...
This closes #3335
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
7 months ago
241eb03a74
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0
...
This closes #3489 .
7 months ago
91fc7bb506
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key
...
This closes #3448 .
7 months ago
ea71b2302d
[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set before call getBinlogPosition method
...
This closes #3488 .
7 months ago
313bace106
[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchema doc description
...
This closes #3443 .
7 months ago
c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils ( #3481 )
7 months ago
332e1f330d
[minor][cdc-connector][sqlserver] Fix some typos ( #3421 )
7 months ago
9a97182fbb
[minor][cdc-connector][mysql] Code optimization for constants
...
This closes #3385
7 months ago
2d50e43137
[minor][cdc-connector][postgres] PostgresDialect removes useless code
...
This closes #3416 .
7 months ago
94a0415475
[FLINK-34883] Fix postgres uuid column as PK ( #3282 )
...
* [FLINK-34883] Fix postgres uuid column as PK
* [FLINK-34883] Fix column comment.
7 months ago
a2539f5cfa
[hotfix][docs][postgres] Remove unsupported erroneous example code
...
This closes #3464
7 months ago
2d1eb0aff1
[FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add table ( #3203 )
...
* [cdc-connector][oracle] Oracle cdc support newly add table
* [cdc-connector][oracle] Fix code style
* [cdc-connector][oracle] Address comment
7 months ago
302a691225
[FLINK-35354] Support host mapping in Flink tikv cdc ( #3336 )
...
* [FLINK-35337][cdc] Keep up with the latest version of tikv client
* [FLINK-35354]Support host mapping in Flink tikv cdc
* [FLINK-35354] Add doc for host mapping feature
* [FLINK-35354] fixed annotation import
8 months ago
80920aaa28
[FLINK-35297][mysql] Add validation for option connect.timeout because of HikariConfig limitation ( #3295 )
8 months ago
2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options
9 months ago
c958daf8ab
[FLINK-35540][cdc-common] Fix table missed when database and table are with the same name
...
This closes #3396 .
9 months ago
17ff659ff7
[hotfix][build] Remove test-jar from parent pom and only add to necessary modules
...
This closes #3397 .
Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
9 months ago
e2ccc836a0
[FLINK-34908][pipeline-connector][doris] Fix MySQL to doris pipeline will lose precision for timestamp type
...
This closes #3207 .
9 months ago
1a360635c7
[FLINK-35092][cdc][starrocks] Add starrocks integration test cases
9 months ago
8eb7e53965
[FLINK-35120][doris] Add Doris integration test cases
9 months ago
8a7fdd5ae3
[minor][cdc-connector][paimon] Remove duplicate interface implements
9 months ago
0214166049
[FLINK-35325][cdc-connector][paimon] Support specify column order when adding new columns to a table
...
This closes #3323 .
9 months ago
5b28d1a579
[FLINK-35129][postgres] Introduce scan.lsn-commit.checkpoints-num-delay option to control LSN offset commit lazily
...
This close #3349 .
9 months ago
0e8b2c7cc5
[FLINK-35430][cdc-connector][kafka] Pass the time zone infor to JsonSerializationSchema
...
This closes #3359 .
9 months ago
19c382c0f2
[FLINK-35409][cdc][mysql] Request more splits if all splits are filtered from addSplits method
...
This closes #3342 .
9 months ago
b2cb30f240
[FLINK-35408][mysql] Introduce 30 minutes tolerance when validate the time-zone setting
...
This closes #3341 .
9 months ago
6350eec66c
[FLINK-35301][cdc] Avoid deadlock when loading driver classes
...
This closes #3300 .
9 months ago
18b0627e34
[FLINK-35295][mysql] Improve jdbc connection pool initialization failure message
...
This closes #3293 .
9 months ago
bddcaae784
[FLINK-35294][mysql] Use source config to check if the filter should be applied in timestamp starting mode
...
This closes #3291 .
9 months ago
8e8fd304af
[FLINK-35298][cdc][metrics] Improve the fetch delay metrics
...
This closes #3298 .
9 months ago
fa6e7ea512
[FLINK-35245][cdc-connector][tidb] Add metrics for flink-connector-tidb-cdc
10 months ago
a7cb46f762
[FLINK-35274][cdc-connector][db2] Fix occasional failure issue with Flink CDC Db2 UT
10 months ago
002b16ed4e
[FLINK-35244][cdc-connector][tidb] Correct the package for flink-connector-tidb-cdc test
10 months ago
ec643c9dd7
[FLINK-35235][pipeline-connector][kafka] Fix missing dependencies in the uber jar of Kafka pipeline sink
10 months ago
6232d84052
[FLINK-35173][cdc][mysql] Debezium custom time serializer for MySQL connector ( #3240 )
10 months ago
05281e5d6f
[FLINK-34639][cdc][oceanbase] Support debezium deserializer in OceanBase source connector ( #3124 )
10 months ago
bdca0e328b
[FLINK-35128][cdc-connector][cdc-base] Re-calculate the starting changelog offset after the new table added ( #3230 )
10 months ago
ddf557c8e1
[tests][cdc-connector][db2] Improve the DB2 tests
...
This closes #2870
10 months ago
8deddab6eb
[minor][cdc-connector][db2] Fix typos and improve the code style
10 months ago
Kunni
Leonard Xu
ConradJam
yuxiqian
Junbo wang
North Lin
Runkang He
wudi
Xin Gong
Hongshun Wang
Shawn Huang
gongzhongqiang
Jiabao Sun
Sergei Morozov
Kevin Wang
MOBIN
He Wang
proletarians
Qingsheng Ren
wuzexian
Hang Ruan
hk__lrzy
lvyanquan
gongzhongqiang
Wink
lipl
Thorne
Junbo wang
SeungMin
Zhongmin Qiao
ChengJie1053
Joao Boto
skylines
ouyangwulin
joyCurry30
Muhammet Orazov
Xie Yi
Leonard Xu