Shawn Huang
dd865bf440
[FLINK-36970][cdc-common] Merge result of data type BIGINT and DOUBLE should be DOUBLE instead of STRING
...
This closes #3821
3 weeks ago
Wink
49dc957ac6
[FLINK-36981][transform] Considering sharding tables with different schema in transform projection
...
This closes #3826 .
3 weeks ago
yuxiqian
486ee6f805
[FLINK-36956][transform] Append NOT NULL attribute for Primary Key columns
...
This closes #3815
3 weeks ago
Kunni
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
3 weeks ago
Kunni
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
3 weeks ago
moses
fc71888d7a
[hotfix][cdc-common] Remove duplicated code to improve performance
...
This closes #3840 .
Co-authored-by: zhangchaoming.zcm <zhangchaoming.zcm@antgroup.com>
3 weeks ago
hiliuxg
ddc645b7cb
[hotfix][k8s] Fix command-line option `from-savepoint` does not work in K8s deployment mode
...
This closes #3825 .
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
3 weeks ago
Jason Zhang
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
3 weeks ago
moses
98f9f15132
[hotfix][docs] Add missed enumeration in MySQL Source
...
This closes #3832
3 weeks ago
Umesh Dangat
baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
...
This closes #3434 .
4 weeks ago
yuanoOo
6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
...
This closes #3360 .
4 weeks ago
stayrascal
dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
...
This closes #3760
Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
4 weeks ago
yuxiqian
ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` ( #3831 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
4 weeks ago
yuxiqian
702553736c
[build][hotfix] Allow pinning issues & PRs that never decay
...
This closes #3816
1 month ago
Thorne
4f881f82d4
[FLINK-36952][source-connector/mongodb] Fix typos in MongoDB connector Chinese documentation ( #3811 )
1 month ago
yuxiqian
9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case ( #3809 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian
8424467239
[FLINK-36690][cdc-runtime] Fix schema operator hanging under extreme parallelized pressure
...
This closes #3680
1 month ago
yuxiqian
2e03f9ad49
[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
...
This closes #3801
1 month ago
yuxiqian
a2e433ebdd
[cdc-common] Extract column / schema type merging utility methods to `SchemaMergingUtils`
1 month ago
yuxiqian
88d1d6fbd2
[tests][build] Update migration test matrix to 3.2.0 and later
1 month ago
Robin Moffatt
dfa6de919f
[hotfix][docs] Fix ToC to include H1
...
This closes #3773 .
1 month ago
Hang Ruan
a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform ( #3758 )
...
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
1 month ago
yuxiqian
5e3df7a0de
[hotfix] Fix building status badge in README as workflow files have been refactored ( #3807 )
...
* [hotfix] Fix building status badge in README as workflow files have been refactored
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: rename workflow files to `flink_cdc_ci` / `flink_cdc_ci_nightly`
As they're not strictly tied to specific JDK versions.
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
Hang Ruan
c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform ( #3804 )
1 month ago
yuxiqian
2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range ( #3785 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian
6d21941661
[hotfix] Fix Java 11 target compatibility & add tests ( #3633 )
...
* [hotfix] Fix Java 11 target compatibility
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
# Conflicts:
# .github/workflows/flink_cdc_java_8.yml
# .github/workflows/flink_cdc_migration_test_base.yml
# pom.xml
* fix: clarify GiHub workflow names
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian
b0a7d920b9
[FLINK-36866][transform] Fix unable to narrow casting on numeric values
...
This closes #3786 .
2 months ago
yuxiqian
39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
...
This closes #3780 .
2 months ago
yuxiqian
dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
...
This closes #3647 .
2 months ago
ouyangwulin
0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. ( #3797 )
2 months ago
Hongshun Wang
12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously ( #3510 )
2 months ago
Sergei Morozov
b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
...
This closes #3794 .
2 months ago
Xin Gong
0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] ( #3755 )
2 months ago
yuxiqian
2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
...
This closes #3792
2 months ago
yuxiqian
9f8268c361
[hotfix][build] Add missed third-party OSS NOTICE
...
This closes #3756 .
2 months ago
Hang Ruan
fd82126c7d
[FLINK-36878][pipeline-connector][kafka] Shade org.apache.kafka with org.apache.flink.kafka.shaded.org.apache.kafka instead of cdc path
...
This closes #3790 .
2 months ago
yuxiqian
c2e301222c
[docs] Update download links to up-to-date cdc version ( #3766 )
...
* [docs] Update download links to up-to-date cdc version
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: replace params to allow dead link checking to pass
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: just don't check any interpolating urls
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
liuxiaodong
ee9cd828c3
[FLINK-36315][cdc-connector][base&pg&mongodb]The flink-cdc-base module supports source metric statistics ( #3619 )
...
Co-authored-by: molin.lxd <molin.lxd@alibaba-inc.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
yuxiqian
26f5880fbf
[hotfix][tests][oceanbase] Fix oceanbase test failure, possibly caused by some interactions among cases ( #3712 )
2 months ago
Hang Ruan
23e8149e6a
[FLINK-36803][cdc-connector][base & mysql] Use the same format `tableId:chunkId` for splitId in SnapshotSplit ( #3763 )
2 months ago
Kunni
3fd4cb645d
[hotfix][Doc] fix spelling error in Al model docs. ( #3764 )
2 months ago
Kunni
06154e9674
[FLINK-36525][transform] Support for AI Model Integration for Data Processing ( #3753 )
2 months ago
Leonard Xu
c969957f02
[hotfix][docs][pipeline-connector/es] Add missed supported flink versions and Elasticsearch versions
...
This closes #3752
2 months ago
Xin Gong
1d4e366969
[FLINK-36772][mysql][cdc-base] Fix error placeholder for errorMessageTemplate of Preconditions
...
This closes #3754
2 months ago
Leonard Xu
d0b2fe38a2
[hotfix][source-connector/mysql] Fix conflicts after flink version bumped to 1.19 ( #3748 )
2 months ago
Kunni
3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
...
This closes #3744 .
2 months ago
Leonard Xu
01a1e5fba5
[FLINK-36656][mysql] Fix type conversion failure for newly-added sharding table with mysql boolean type ( #3683 )
2 months ago
ConradJam
dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 ( #3660 )
...
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
2 months ago
yuxiqian
8e6c361f96
[FLINK-36285][doris] Fix unable to alter column type without default value specified
...
This closes #3691 .
3 months ago
yuxiqian
4bd3a2347b
[FLINK-36565][transform] Route allows merging Decimals with various precisions
...
This closes #3651
3 months ago