afe9c3c0ad
[FLINK-36150][pipeline-connector/mysql] tables.exclude should work even scan.binlog.newly-added-table.enabled is true
...
This closes #3573 .
6 months ago
3c1517f70f
[FLINK-36148][pipeline-connector/mysql] Fix that newly added table can not discovered by adding custom parser for CreateTableEvent
...
This closes #3570 .
6 months ago
aea2b6aa9c
[hotfix][cdc-connector][mongodb] Fix LegacyMongoDBSourceExampleTest cannot run ( #3555 )
6 months ago
52f2019469
[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Server TIMESTAMP to Flink SQL timestamp
...
This closes #3561 .
6 months ago
ee843e2f24
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread safe by blocking subsequent schemaChangeEvent
...
This closes #3563 .
Co-authored-by: Hongshun Wang <loserwang1024@gmail.com>
6 months ago
565032e3af
[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-table.enabled option for MySQL Source
...
This closes #3560 .
6 months ago
6205a5a0f1
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryRequestHandler thrown
...
This closes #3558 .
6 months ago
77c63385d9
[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated tables in the BinlogSplit when restart ( #3548 )
...
Co-authored-by: 云时 <mingya.wmy@alibaba-inc.com>
6 months ago
aedccb698e
[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCommittableChannelComputer Topology name
...
This closes #3559
6 months ago
78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
...
This close #3521 .
6 months ago
7f08c6caba
[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration
...
This closes #3553
6 months ago
0470fdbbc1
[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableException in KafkaDataSink
...
This closes #3549
6 months ago
cbb33bb870
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remove dependency on host network ( #3439 )
6 months ago
c5396fbf29
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.elasticsearch.version to a released version
...
This closes #3542 .
7 months ago
d99e718951
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release scripts ( #3540 )
7 months ago
8137f9d746
[FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 versions
...
This closes #3495 .
7 months ago
ac14dba9fb
[FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Connector for Flink CDC Pipeline
7 months ago
15ab85860b
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector supports to set chunk key-column ( #3490 )
...
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
7 months ago
64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
...
This closes #3499 .
7 months ago
3bb1f3ca45
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit
...
This closes #3504 .
7 months ago
e0d6d1d1a8
[FLINK-35442][cdc-connect][kafka] add key.format and partition.strategy option to make sure the same record sending to the same partition. ( #3522 )
7 months ago
4bf5a395a5
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger condition strictly
...
This closes #3519 .
7 months ago
07446d1f9d
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp type in BinaryRecordData ( #3511 )
7 months ago
09f36a4a05
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables capture in mysql pipeline connector. ( #3411 )
...
Co-authored-by: Muhammet Orazov <916295+morazow@users.noreply.github.com>
Co-authored-by: north.lin <north.lin@yunlsp.com>
7 months ago
b937db25d5
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling ( #3506 )
7 months ago
9d6154f123
[FLINK-35791][kafka] Add database and table info of Canal / Debezium json format for Kafka sink ( #3461 )
7 months ago
21fade0e22
[FLINK-35432][pipeline-connector][mysql] Support catch modify event in mysql to send AlterColumnTypeEvent. ( #3352 )
...
Co-authored-by: haoke <haoke@bytedance.com>
7 months ago
5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
...
This closes #3339 .
7 months ago
4561a8a32b
[FLINK-34638][cdc-common] Support column with default value
7 months ago
1778ef685a
Revert "[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available "
...
This reverts commit 3315be3c8f
7 months ago
7ca11359d7
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
...
This closes #3449 .
Co-authored-by: wenmo <32723967+wenmo@users.noreply.github.com>
Co-authored-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
7 months ago
3315be3c8f
[hotfix][starrocks] Fix StarRocks FE startup failure due to insufficient disk space available
...
This closes #3508 .
7 months ago
f6d1d4810a
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed columns correctly ( #3497 )
...
* resolve conficts
* polish code to trigger ci
---------
Co-authored-by: Kael <kael@fts.dev>
Co-authored-by: gongzhongqiang <gongzhongqiang@gigacloudtech.com>
7 months ago
986f37b307
[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching for timestamp in binlog file ( #3432 )
7 months ago
0c49959f67
[FLINK-35524][cdc-base] Clear connections pools when reader exist. ( #3388 )
7 months ago
47f5660055
[FLINK-35344][cdc-base] Move same code from multiple subclasses to JdbcSourceChunkSplitter ( #3319 )
7 months ago
a39959f4b3
[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris pipeline sink
...
This closes #3473
7 months ago
b15a226ccd
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2
...
This closes #3335
Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
7 months ago
241eb03a74
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to support MongoDB 7.0
...
This closes #3489 .
7 months ago
91fc7bb506
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it's not primary key
...
This closes #3448 .
7 months ago
ea71b2302d
[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set before call getBinlogPosition method
...
This closes #3488 .
7 months ago
313bace106
[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchema doc description
...
This closes #3443 .
7 months ago
c5f391cf6a
[FLINK-35865][base] Support Byte and Short in ObjectUtils ( #3481 )
7 months ago
332e1f330d
[minor][cdc-connector][sqlserver] Fix some typos ( #3421 )
7 months ago
9a97182fbb
[minor][cdc-connector][mysql] Code optimization for constants
...
This closes #3385
7 months ago
2d50e43137
[minor][cdc-connector][postgres] PostgresDialect removes useless code
...
This closes #3416 .
7 months ago
94a0415475
[FLINK-34883] Fix postgres uuid column as PK ( #3282 )
...
* [FLINK-34883] Fix postgres uuid column as PK
* [FLINK-34883] Fix column comment.
8 months ago
a2539f5cfa
[hotfix][docs][postgres] Remove unsupported erroneous example code
...
This closes #3464
8 months ago
2d1eb0aff1
[FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add table ( #3203 )
...
* [cdc-connector][oracle] Oracle cdc support newly add table
* [cdc-connector][oracle] Fix code style
* [cdc-connector][oracle] Address comment
8 months ago
302a691225
[FLINK-35354] Support host mapping in Flink tikv cdc ( #3336 )
...
* [FLINK-35337][cdc] Keep up with the latest version of tikv client
* [FLINK-35354]Support host mapping in Flink tikv cdc
* [FLINK-35354] Add doc for host mapping feature
* [FLINK-35354] fixed annotation import
8 months ago
80920aaa28
[FLINK-35297][mysql] Add validation for option connect.timeout because of HikariConfig limitation ( #3295 )
8 months ago
2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options
9 months ago
c958daf8ab
[FLINK-35540][cdc-common] Fix table missed when database and table are with the same name
...
This closes #3396 .
9 months ago
17ff659ff7
[hotfix][build] Remove test-jar from parent pom and only add to necessary modules
...
This closes #3397 .
Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
9 months ago
e2ccc836a0
[FLINK-34908][pipeline-connector][doris] Fix MySQL to doris pipeline will lose precision for timestamp type
...
This closes #3207 .
9 months ago
1a360635c7
[FLINK-35092][cdc][starrocks] Add starrocks integration test cases
9 months ago
8eb7e53965
[FLINK-35120][doris] Add Doris integration test cases
9 months ago
8a7fdd5ae3
[minor][cdc-connector][paimon] Remove duplicate interface implements
9 months ago
0214166049
[FLINK-35325][cdc-connector][paimon] Support specify column order when adding new columns to a table
...
This closes #3323 .
9 months ago
5b28d1a579
[FLINK-35129][postgres] Introduce scan.lsn-commit.checkpoints-num-delay option to control LSN offset commit lazily
...
This close #3349 .
9 months ago
0e8b2c7cc5
[FLINK-35430][cdc-connector][kafka] Pass the time zone infor to JsonSerializationSchema
...
This closes #3359 .
9 months ago
19c382c0f2
[FLINK-35409][cdc][mysql] Request more splits if all splits are filtered from addSplits method
...
This closes #3342 .
9 months ago
b2cb30f240
[FLINK-35408][mysql] Introduce 30 minutes tolerance when validate the time-zone setting
...
This closes #3341 .
9 months ago
6350eec66c
[FLINK-35301][cdc] Avoid deadlock when loading driver classes
...
This closes #3300 .
9 months ago
18b0627e34
[FLINK-35295][mysql] Improve jdbc connection pool initialization failure message
...
This closes #3293 .
9 months ago
bddcaae784
[FLINK-35294][mysql] Use source config to check if the filter should be applied in timestamp starting mode
...
This closes #3291 .
9 months ago
8e8fd304af
[FLINK-35298][cdc][metrics] Improve the fetch delay metrics
...
This closes #3298 .
9 months ago
fa6e7ea512
[FLINK-35245][cdc-connector][tidb] Add metrics for flink-connector-tidb-cdc
10 months ago
a7cb46f762
[FLINK-35274][cdc-connector][db2] Fix occasional failure issue with Flink CDC Db2 UT
10 months ago
002b16ed4e
[FLINK-35244][cdc-connector][tidb] Correct the package for flink-connector-tidb-cdc test
10 months ago
ec643c9dd7
[FLINK-35235][pipeline-connector][kafka] Fix missing dependencies in the uber jar of Kafka pipeline sink
10 months ago
6232d84052
[FLINK-35173][cdc][mysql] Debezium custom time serializer for MySQL connector ( #3240 )
10 months ago
05281e5d6f
[FLINK-34639][cdc][oceanbase] Support debezium deserializer in OceanBase source connector ( #3124 )
10 months ago
bdca0e328b
[FLINK-35128][cdc-connector][cdc-base] Re-calculate the starting changelog offset after the new table added ( #3230 )
10 months ago
ddf557c8e1
[tests][cdc-connector][db2] Improve the DB2 tests
...
This closes #2870
10 months ago
8deddab6eb
[minor][cdc-connector][db2] Fix typos and improve the code style
10 months ago
3385ae8fbc
[cdc-connector][db2] Db2 support incremental source
10 months ago
ef2eece256
[pipeline-connector][paimon] add paimon pipeline data sink connector. ( #2916 )
10 months ago
01ec7da989
[FLINK-35055][cdc] Exclude connector dependencies with questionable licenses from fat jar packages ( #3212 )
10 months ago
253ef9256b
[pipeline-connector][kafka] Add kafka pipeline data sink connector. ( #2938 )
10 months ago
5e52d8620c
[FLINK-35102][cdc][doris-sink] Correct Doris connector varchar type mapping
...
This closes #3224 .
10 months ago
0d797a6021
[FLINK-34903][cdc][mysql] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables ( #3186 )
10 months ago
d4ed7db8dc
[FLINK-35127][cdc][values] Remove HybridSource from ValuesSource to avoid CI failure. ( #3237 )
10 months ago
0562e35da7
[FLINK-35079][cdc-connector][mongo] Fallback to timestamp startup mode when resume token has expired
11 months ago
48ca8623bb
[FLINK-34634][cdc-base][mysql] Fix that Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed ( #3134 )
11 months ago
af7665d338
[FLINK-34689][MySQL][Feature] check binlog_row_value_options ( #3148 )
11 months ago
1b0b9f868d
[minor][cdc-connector][mongo] Fix warning during MongoDB tests ( #3210 )
11 months ago
025653d772
[hotfix] run mvn spotless to fix code style violations. ( #3219 )
11 months ago
18dd51fe22
[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BINARY data type of Add column DDL ( #3145 )
11 months ago
abb98ee257
[FLINK-34690] Cast decimal to VARCHAR as primary key in starrocks sink ( #3150 )
11 months ago
80d461b1b8
[MySQL] Fix for DBZ-7037 and #2217 to not clear tableMapEventByTableId for fake Rotates Event ( #3065 )
11 months ago
8c5437a1f1
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFunction ( #3204 )
11 months ago
6510e670fa
[FLINK-34959][cdc] Update old flink-cdc-connectors artifactId ( #3200 )
11 months ago
a35b8dd44c
[build] Optimize pom to solve the CI error
11 months ago
bcad5d9d11
[cdc-runtime] Introduce TransformSchemaOperator and TransformDataOperator to support transformation
11 months ago
f7f248cda1
[build] fix inconsistent Kafka shading among cdc connectors ( #2988 )
11 months ago
5f4f86fb31
[hotfix] Change old com.ververica dependencies to org.apache.flink ( #3110 )
11 months ago
14b81dc6ec
[FLINK-34715][cdc][cdc-connector][mysql] Correctly close BinlogSplitReader in MySQL UTCase
...
This closes #3161 .
12 months ago
26eb6a99b9
[hotfix][cdc][build] Include cdc-common module when shaded for module flink-sql-connector-mysql-cdc
12 months ago
86272bf102
[FLINK-34183][cdc][license] Update NOTICE files ( #3107 )
12 months ago
Hongshun Wang
Kunni
Jiabao Sun
Sergei Morozov
yuxiqian
Kevin Wang
MOBIN
He Wang
proletarians
Qingsheng Ren
wuzexian
Junbo wang
Hang Ruan
North Lin
hk__lrzy
lvyanquan
gongzhongqiang
Wink
lipl
Thorne
Junbo wang
SeungMin
Zhongmin Qiao
ChengJie1053
gongzhongqiang
Xin Gong
Joao Boto
skylines
ouyangwulin
Shawn Huang
joyCurry30
Muhammet Orazov
Xie Yi
ConradJam
Leonard Xu
Qishang Zhong
shikai93
xleoken
wenmo
Paul Lin