486ee6f805
[FLINK-36956][transform] Append NOT NULL attribute for Primary Key columns
...
This closes #3815
3 weeks ago
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
3 weeks ago
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
3 weeks ago
fc71888d7a
[hotfix][cdc-common] Remove duplicated code to improve performance
...
This closes #3840 .
Co-authored-by: zhangchaoming.zcm <zhangchaoming.zcm@antgroup.com>
3 weeks ago
ddc645b7cb
[hotfix][k8s] Fix command-line option `from-savepoint` does not work in K8s deployment mode
...
This closes #3825 .
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
3 weeks ago
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
3 weeks ago
98f9f15132
[hotfix][docs] Add missed enumeration in MySQL Source
...
This closes #3832
3 weeks ago
baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
...
This closes #3434 .
4 weeks ago
6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
...
This closes #3360 .
4 weeks ago
dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
...
This closes #3760
Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
4 weeks ago
ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` ( #3831 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
4 weeks ago
702553736c
[build][hotfix] Allow pinning issues & PRs that never decay
...
This closes #3816
1 month ago
4f881f82d4
[FLINK-36952][source-connector/mongodb] Fix typos in MongoDB connector Chinese documentation ( #3811 )
1 month ago
9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case ( #3809 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
8424467239
[FLINK-36690][cdc-runtime] Fix schema operator hanging under extreme parallelized pressure
...
This closes #3680
1 month ago
2e03f9ad49
[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
...
This closes #3801
1 month ago
a2e433ebdd
[cdc-common] Extract column / schema type merging utility methods to `SchemaMergingUtils`
1 month ago
88d1d6fbd2
[tests][build] Update migration test matrix to 3.2.0 and later
1 month ago
dfa6de919f
[hotfix][docs] Fix ToC to include H1
...
This closes #3773 .
1 month ago
a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform ( #3758 )
...
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
1 month ago
5e3df7a0de
[hotfix] Fix building status badge in README as workflow files have been refactored ( #3807 )
...
* [hotfix] Fix building status badge in README as workflow files have been refactored
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: rename workflow files to `flink_cdc_ci` / `flink_cdc_ci_nightly`
As they're not strictly tied to specific JDK versions.
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform ( #3804 )
1 month ago
2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range ( #3785 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
6d21941661
[hotfix] Fix Java 11 target compatibility & add tests ( #3633 )
...
* [hotfix] Fix Java 11 target compatibility
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
# Conflicts:
# .github/workflows/flink_cdc_java_8.yml
# .github/workflows/flink_cdc_migration_test_base.yml
# pom.xml
* fix: clarify GiHub workflow names
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
b0a7d920b9
[FLINK-36866][transform] Fix unable to narrow casting on numeric values
...
This closes #3786 .
1 month ago
39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
...
This closes #3780 .
2 months ago
dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
...
This closes #3647 .
2 months ago
0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. ( #3797 )
2 months ago
12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously ( #3510 )
2 months ago
b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
...
This closes #3794 .
2 months ago
0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] ( #3755 )
2 months ago
2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
...
This closes #3792
2 months ago
9f8268c361
[hotfix][build] Add missed third-party OSS NOTICE
...
This closes #3756 .
2 months ago
fd82126c7d
[FLINK-36878][pipeline-connector][kafka] Shade org.apache.kafka with org.apache.flink.kafka.shaded.org.apache.kafka instead of cdc path
...
This closes #3790 .
2 months ago
c2e301222c
[docs] Update download links to up-to-date cdc version ( #3766 )
...
* [docs] Update download links to up-to-date cdc version
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: replace params to allow dead link checking to pass
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: just don't check any interpolating urls
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
ee9cd828c3
[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics ( #3619 )
...
Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
26f5880fbf
[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases ( #3712 )
2 months ago
23e8149e6a
[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit ( #3763 )
2 months ago
3fd4cb645d
[hotfix][Doc] fix spelling error in Al model docs. ( #3764 )
2 months ago
06154e9674
[FLINK-36525][transform] Support for AI Model Integration for Data Processing ( #3753 )
2 months ago
c969957f02
[hotfix][docs][pipeline-connector/es] Add missed supported flink versions and Elasticsearch versions
...
This closes #3752
2 months ago
1d4e366969
[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions
...
This closes #3754
2 months ago
d0b2fe38a2
[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 ( #3748 )
2 months ago
3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
...
This closes #3744 .
2 months ago
01a1e5fba5
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type ( #3683 )
2 months ago
dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 ( #3660 )
...
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
...
This closes #3691 .
3 months ago
4bd3a2347b
[FLINK-36565][transform] Route allows merging Decimals with various precisions
...
This closes #3651
3 months ago
51c679a914
[FLINK-36596][transform] Fix unable to schema evolve with project-less transform rules
...
This closes #3665 .
3 months ago
5db16ba30c
[FLINK-36093][transform] Fix preTransformoperator wrongly filters columns belong to different transforms
...
This closes #3572
3 months ago
yuxiqian
Kunni
moses
hiliuxg
Jason Zhang
Umesh Dangat
yuanoOo
stayrascal
Thorne
Robin Moffatt
Hang Ruan
ouyangwulin
Hongshun Wang
Sergei Morozov
Xin Gong
liuxiaodong
Leonard Xu
ConradJam
MOBIN