Commit Graph

1178 Commits (ddb5f00df5bab21e8c91e4a31574d446d8b7a3f7)
 

Author SHA1 Message Date
yuxiqian ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` (#3831)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian 702553736c
[build][hotfix] Allow pinning issues & PRs that never decay
This closes #3816
1 month ago
Thorne 4f881f82d4
[FLINK-36952][source-connector/mongodb] Fix typos in MongoDB connector Chinese documentation (#3811) 1 month ago
yuxiqian 9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case (#3809)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
yuxiqian 8424467239 [FLINK-36690][cdc-runtime] Fix schema operator hanging under extreme parallelized pressure
This closes #3680
2 months ago
yuxiqian 2e03f9ad49 [FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
This closes #3801
2 months ago
yuxiqian a2e433ebdd [cdc-common] Extract column / schema type merging utility methods to `SchemaMergingUtils` 2 months ago
yuxiqian 88d1d6fbd2 [tests][build] Update migration test matrix to 3.2.0 and later 2 months ago
Robin Moffatt dfa6de919f
[hotfix][docs] Fix ToC to include H1
This closes #3773.
2 months ago
Hang Ruan a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform (#3758)
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
2 months ago
yuxiqian 5e3df7a0de
[hotfix] Fix building status badge in README as workflow files have been refactored (#3807)
* [hotfix] Fix building status badge in README as workflow files have been refactored

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: rename workflow files to `flink_cdc_ci` / `flink_cdc_ci_nightly`

As they're not strictly tied to specific JDK versions.

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
Hang Ruan c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform (#3804) 2 months ago
yuxiqian 2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range (#3785)
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
yuxiqian 6d21941661
[hotfix] Fix Java 11 target compatibility & add tests (#3633)
* [hotfix] Fix Java 11 target compatibility

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

# Conflicts:
#	.github/workflows/flink_cdc_java_8.yml
#	.github/workflows/flink_cdc_migration_test_base.yml
#	pom.xml

* fix: clarify GiHub workflow names

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
yuxiqian b0a7d920b9
[FLINK-36866][transform] Fix unable to narrow casting on numeric values
This closes #3786.
2 months ago
yuxiqian 39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
This closes #3780.
2 months ago
yuxiqian dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
This closes  #3647.
2 months ago
ouyangwulin 0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. (#3797) 2 months ago
Hongshun Wang 12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously (#3510) 2 months ago
Sergei Morozov b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
This closes #3794.
2 months ago
Xin Gong 0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] (#3755) 2 months ago
yuxiqian 2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
This closes #3792
2 months ago
yuxiqian 9f8268c361
[hotfix][build] Add missed third-party OSS NOTICE
This closes  #3756.
2 months ago
Hang Ruan fd82126c7d
[FLINK-36878][pipeline-connector][kafka] Shade org.apache.kafka with org.apache.flink.kafka.shaded.org.apache.kafka instead of cdc path
This closes #3790.
2 months ago
yuxiqian c2e301222c
[docs] Update download links to up-to-date cdc version (#3766)
* [docs] Update download links to up-to-date cdc version

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: replace params to allow dead link checking to pass

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

* fix: just don't check any interpolating urls

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
liuxiaodong ee9cd828c3
[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics (#3619)
Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
yuxiqian 26f5880fbf
[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases (#3712) 2 months ago
Hang Ruan 23e8149e6a
[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit (#3763) 2 months ago
Kunni 3fd4cb645d
[hotfix][Doc] fix spelling error in Al model docs. (#3764) 2 months ago
Kunni 06154e9674
[FLINK-36525][transform] Support for AI Model Integration for Data Processing (#3753) 2 months ago
Leonard Xu c969957f02
[hotfix][docs][pipeline-connector/es] Add missed supported flink versions and Elasticsearch versions
This closes  #3752
3 months ago
Xin Gong 1d4e366969
[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions
This closes  #3754
3 months ago
Leonard Xu d0b2fe38a2
[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 (#3748) 3 months ago
Kunni 3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
This closes #3744.
3 months ago
Leonard Xu 01a1e5fba5
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type (#3683) 3 months ago
ConradJam dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 (#3660)
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
yuxiqian 8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
This closes #3691.
3 months ago
yuxiqian 4bd3a2347b
[FLINK-36565][transform] Route allows merging Decimals with various precisions
This closes #3651
3 months ago
yuxiqian 51c679a914
[FLINK-36596][transform] Fix unable to schema evolve with project-less transform rules
This closes  #3665.
3 months ago
MOBIN 5db16ba30c
[FLINK-36093][transform] Fix preTransformoperator wrongly filters columns belong to different transforms
This closes #3572
3 months ago
ConradJam 13248faa22
[FLINK-35592][cdc-connector][mysql] Fix MysqlDebeziumTimeConverter miss timezone when convert to timestamp
This closes #3332

Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
Shawn Huang d9ceee050b
[FLINK-36699][cdc-common] fix nullability when converting cdc data type to flink data type (#3713) 3 months ago
Kunni ae986ab3f6
[FLINK-36609][pipeline-connector][paimon] Add partition columns to primary keys
This closes  #3641.
3 months ago
yuxiqian b5ab385b8c
[FLINK-36461][transform] Fix schema evolution failure with un-transformed tables
This closes  #3632.
3 months ago
Runkang He ba74c7c45f
[FLINK-36681][mysql-cdc][docs] Fix the wrong chunks splitting query in incremental snapshot reading section
This closes  #3703.
3 months ago
Kunni f38341b02e
[FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
This closes #3652.
3 months ago
Timi 8b8330e245
[FLINK-36678][docs][deploy] Fix the typo in Flink CDC YARN deployment documentation
This closes #3706.
3 months ago
Junbo wang ff77a490bd
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
This closes  #3639
3 months ago
North Lin 8647fe4986
[FLINK-36375][cdc-runtime] Fix missed default value in AddColumnEvent/RenameColunEvent
This closes  #3622.
3 months ago
yuxiqian 57a1a7df93
[FLINK-36408][pipeline-connector][mysql] Fix MySQL pipeline connector failed to parse FLOAT type with precision (#3625) 3 months ago