Commit Graph

1218 Commits (5691b7bf977abd608dcf189359be602d93f2eadf)
 

Author SHA1 Message Date
yuxiqian 5e3df7a0de
[hotfix] Fix building status badge in README as workflow files have been refactored (#3807)
* [hotfix] Fix building status badge in README as workflow files have been refactored

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: rename workflow files to `flink_cdc_ci` / `flink_cdc_ci_nightly`

As they're not strictly tied to specific JDK versions.

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
Hang Ruan c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform (#3804) 1 month ago
yuxiqian 2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range (#3785)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian 6d21941661
[hotfix] Fix Java 11 target compatibility & add tests (#3633)
* [hotfix] Fix Java 11 target compatibility

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

# Conflicts:
#	.github/workflows/flink_cdc_java_8.yml
#	.github/workflows/flink_cdc_migration_test_base.yml
#	pom.xml

* fix: clarify GiHub workflow names

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian b0a7d920b9
[FLINK-36866][transform] Fix unable to narrow casting on numeric values
This closes #3786.
1 month ago
yuxiqian 39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
This closes #3780.
2 months ago
yuxiqian dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
This closes  #3647.
2 months ago
ouyangwulin 0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797) 2 months ago
Hongshun Wang 12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510) 2 months ago
Sergei Morozov b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
This closes #3794.
2 months ago
Xin Gong 0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] (#3755) 2 months ago
yuxiqian 2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
This closes #3792
2 months ago
yuxiqian 9f8268c361
[hotfix][build] Add missed third-party OSS NOTICE
This closes  #3756.
2 months ago
Hang Ruan fd82126c7d
[FLINK-36878][pipeline-connector][kafka] Shade org.apache.kafka with org.apache.flink.kafka.shaded.org.apache.kafka instead of cdc path
This closes #3790.
2 months ago
yuxiqian c2e301222c
[docs] Update download links to up-to-date cdc version (#3766)
* [docs] Update download links to up-to-date cdc version

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: replace params to allow dead link checking to pass

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: just don't check any interpolating urls

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
liuxiaodong ee9cd828c3
[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics (#3619)
Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
yuxiqian 26f5880fbf
[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases (#3712) 2 months ago
Hang Ruan 23e8149e6a
[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit (#3763) 2 months ago
Kunni 3fd4cb645d
[hotfix][Doc] fix spelling error in Al model docs. (#3764) 2 months ago
Kunni 06154e9674
[FLINK-36525][transform] Support for AI Model Integration for Data Processing (#3753) 2 months ago
Leonard Xu c969957f02
[hotfix][docs][pipeline-connector/es] Add missed supported flink versions and Elasticsearch versions
This closes  #3752
2 months ago
Xin Gong 1d4e366969
[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions
This closes  #3754
2 months ago
Leonard Xu d0b2fe38a2
[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 (#3748) 2 months ago
Kunni 3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
This closes #3744.
2 months ago
Leonard Xu 01a1e5fba5
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type (#3683) 2 months ago
ConradJam dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 (#3660)
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
yuxiqian 8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
This closes #3691.
3 months ago
yuxiqian 4bd3a2347b
[FLINK-36565][transform] Route allows merging Decimals with various precisions
This closes #3651
3 months ago
yuxiqian 51c679a914
[FLINK-36596][transform] Fix unable to schema evolve with project-less transform rules
This closes  #3665.
3 months ago
MOBIN 5db16ba30c
[FLINK-36093][transform] Fix preTransformoperator wrongly filters columns belong to different transforms
This closes #3572
3 months ago
ConradJam 13248faa22
[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp
This closes #3332

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
Shawn Huang d9ceee050b
[FLINK-36699][cdc-common] fix nullability when converting cdc data type to flink data type (#3713) 3 months ago
Kunni ae986ab3f6
[FLINK-36609][pipeline-connector][paimon] Add partition columns to primary keys
This closes  #3641.
3 months ago
yuxiqian b5ab385b8c
[FLINK-36461][transform] Fix schema evolution failure with un-transformed tables
This closes  #3632.
3 months ago
Runkang He ba74c7c45f
[FLINK-36681][mysql-cdc][docs] Fix the wrong chunks splitting query in incremental snapshot reading section
This closes  #3703.
3 months ago
Kunni f38341b02e
[FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
This closes #3652.
3 months ago
Timi 8b8330e245
[FLINK-36678][docs][deploy] Fix the typo in Flink CDC YARN deployment documentation
This closes #3706.
3 months ago
Junbo wang ff77a490bd
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
This closes  #3639
3 months ago
North Lin 8647fe4986
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColunEvent
This closes  #3622.
3 months ago
yuxiqian 57a1a7df93
[FLINK-36408][pipeline-connector][mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision (#3625) 3 months ago
Kunni ecfee702dc
[FLINK-36560][pipeline-connector][paimon] Fix the issue that timestamp_ltz field is not correctly converted
This closes  #3648.
3 months ago
Sergei Morozov e15bf6f04a
[FLINK-36407][runtime] Shut down coordinatorExecutor upon closing SchemaRegistry (#3624) 3 months ago
Runkang He be9b52750c
[FLINK-36572][pipeline-connector][starrocks] Fix the issue that the local time zone is wrongly set
This closes  #3655.
3 months ago
wudi 7f6d9115ae
[FLINK-36649][cdc-connector][oracle] Fix oracle connection close error (#3678) 3 months ago
yuxiqian 5184c010fd
[hotfix][transform][minor] Fix potential code conflict that SUBSTR built-in function is 1-based index now
This closes #3696
3 months ago
Xin Gong d5f1b9ace8
[FLINK-36247][cdc-connector][mysql] Fix potential transaction leak during MySQL snapshot phase (#3602) 3 months ago
yuxiqian 5d58769fe8
[FLINK-36105][flink-cdc-cli] Fix unable to restore from checkpoint with Flink 1.20 (#3564) 3 months ago
MOBIN 1d2cfd789e
[FLINK-35985][transform] Correct the substring function in transform rule
This closes #3537.
3 months ago
yuxiqian d620c5805e
[FLINK-35982][transform] Fix transform metadata failure when projection block is missed
This closes #3592.
3 months ago
yuxiqian 93c985150c
[FLINK-36221][docs] Add CAST function documentations (#3596) 3 months ago