865e14bfd7
[FLINK-35634][build] Add CdcUp playground CLI scripts
...
This closes #3605
2 weeks ago
9992584365
[FLINK-37011][cdc-transform] Improve get source field value by column name in PreTransformProcessor
...
This closes #3836
2 weeks ago
0f675061e1
[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication
...
This closes #3728
2 weeks ago
56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
...
This closes #3673
2 weeks ago
4dc31d8c61
[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style
...
This closes #3852
2 weeks ago
32934393ce
[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon
...
This closes #3828 .
2 weeks ago
a130718c96
[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20
...
This closes #3784
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 weeks ago
75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
...
This closes #3818
Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
3 weeks ago
2fd03e683e
[FLINK-36865][cdc] Provide UNIX_TIMESTAMP series functions in YAML pipeline
...
This closes #3819 .
3 weeks ago
39fd00ce49
[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes ( #3668 )
...
Co-authored-by: MOBIN-F <18814118038@163.com>
3 weeks ago
f7f3901fa3
[FLINK-37012][transform] Fix argument type mismatch when metadata column used in function
...
This closes #3837
3 weeks ago
085684b773
[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished ( #3793 )
3 weeks ago
1fb68a8d62
[FLINK-35325][transform] Skip insufficient_quota error when running test case using ad model. ( #3849 )
3 weeks ago
7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
...
This closes #3846
3 weeks ago
630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
...
This closes #3802
Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
3 weeks ago
dd865bf440
[FLINK-36970][cdc-common] Merge result of data type BIGINT and DOUBLE should be DOUBLE instead of STRING
...
This closes #3821
3 weeks ago
49dc957ac6
[FLINK-36981][transform] Considering sharding tables with different schema in transform projection
...
This closes #3826 .
3 weeks ago
486ee6f805
[FLINK-36956][transform] Append NOT NULL attribute for Primary Key columns
...
This closes #3815
3 weeks ago
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
3 weeks ago
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
3 weeks ago
fc71888d7a
[hotfix][cdc-common] Remove duplicated code to improve performance
...
This closes #3840 .
Co-authored-by: zhangchaoming.zcm <zhangchaoming.zcm@antgroup.com>
3 weeks ago
ddc645b7cb
[hotfix][k8s] Fix command-line option `from-savepoint` does not work in K8s deployment mode
...
This closes #3825 .
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
3 weeks ago
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
3 weeks ago
98f9f15132
[hotfix][docs] Add missed enumeration in MySQL Source
...
This closes #3832
3 weeks ago
baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
...
This closes #3434 .
4 weeks ago
6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
...
This closes #3360 .
4 weeks ago
dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
...
This closes #3760
Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
4 weeks ago
ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` ( #3831 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
4 weeks ago
702553736c
[build][hotfix] Allow pinning issues & PRs that never decay
...
This closes #3816
1 month ago
4f881f82d4
[FLINK-36952][source-connector/mongodb] Fix typos in MongoDB connector Chinese documentation ( #3811 )
1 month ago
9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case ( #3809 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
8424467239
[FLINK-36690][cdc-runtime] Fix schema operator hanging under extreme parallelized pressure
...
This closes #3680
1 month ago
2e03f9ad49
[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
...
This closes #3801
1 month ago
a2e433ebdd
[cdc-common] Extract column / schema type merging utility methods to `SchemaMergingUtils`
1 month ago
88d1d6fbd2
[tests][build] Update migration test matrix to 3.2.0 and later
1 month ago
dfa6de919f
[hotfix][docs] Fix ToC to include H1
...
This closes #3773 .
1 month ago
a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform ( #3758 )
...
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
1 month ago
5e3df7a0de
[hotfix] Fix building status badge in README as workflow files have been refactored ( #3807 )
...
* [hotfix] Fix building status badge in README as workflow files have been refactored
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: rename workflow files to `flink_cdc_ci` / `flink_cdc_ci_nightly`
As they're not strictly tied to specific JDK versions.
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform ( #3804 )
1 month ago
2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range ( #3785 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
6d21941661
[hotfix] Fix Java 11 target compatibility & add tests ( #3633 )
...
* [hotfix] Fix Java 11 target compatibility
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
# Conflicts:
# .github/workflows/flink_cdc_java_8.yml
# .github/workflows/flink_cdc_migration_test_base.yml
# pom.xml
* fix: clarify GiHub workflow names
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
b0a7d920b9
[FLINK-36866][transform] Fix unable to narrow casting on numeric values
...
This closes #3786 .
1 month ago
39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
...
This closes #3780 .
2 months ago
dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
...
This closes #3647 .
2 months ago
0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. ( #3797 )
2 months ago
12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously ( #3510 )
2 months ago
b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
...
This closes #3794 .
2 months ago
0037c4379e
[FLINK-36771][cdc-connector][base&mysql] Fix UT trigger error: Invalid assigner status {} [NEWLY_ADDED_ASSIGNING_FINISHED] ( #3755 )
2 months ago
2e54caf9dd
[hotfix][mysql] Remove deprecated MySQL incremental sources used in tests
...
This closes #3792
2 months ago
9f8268c361
[hotfix][build] Add missed third-party OSS NOTICE
...
This closes #3756 .
2 months ago
yuxiqian
moses
Junbo wang
hiliuxg
MOBIN
Kunni
Wink
Shawn Huang
Jzjsnow
Jason Zhang
Umesh Dangat
yuanoOo
stayrascal
Thorne
Robin Moffatt
Hang Ruan
ouyangwulin
Hongshun Wang
Sergei Morozov
Xin Gong