551bdf395d
[FLINK-36636][transform] Supports timestamp comparison in cdc pipeline transform
...
This closes #3677
1 month ago
bcd70df85c
[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat
...
This closes #3667
1 month ago
6b65aed4c5
[FLINK-36974][cdc-cli] Support overwrite flink configuration via command line
...
This closes #3823
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
1 month ago
865e14bfd7
[FLINK-35634][build] Add CdcUp playground CLI scripts
...
This closes #3605
1 month ago
9992584365
[FLINK-37011][cdc-transform] Improve get source field value by column name in PreTransformProcessor
...
This closes #3836
1 month ago
0f675061e1
[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication
...
This closes #3728
1 month ago
56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
...
This closes #3673
1 month ago
4dc31d8c61
[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style
...
This closes #3852
1 month ago
32934393ce
[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon
...
This closes #3828 .
1 month ago
a130718c96
[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20
...
This closes #3784
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
...
This closes #3818
Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
1 month ago
2fd03e683e
[FLINK-36865][cdc] Provide UNIX_TIMESTAMP series functions in YAML pipeline
...
This closes #3819 .
1 month ago
39fd00ce49
[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes ( #3668 )
...
Co-authored-by: MOBIN-F <18814118038@163.com>
1 month ago
f7f3901fa3
[FLINK-37012][transform] Fix argument type mismatch when metadata column used in function
...
This closes #3837
1 month ago
085684b773
[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished ( #3793 )
1 month ago
1fb68a8d62
[FLINK-35325][transform] Skip insufficient_quota error when running test case using ad model. ( #3849 )
2 months ago
7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
...
This closes #3846
2 months ago
630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
...
This closes #3802
Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
2 months ago
dd865bf440
[FLINK-36970][cdc-common] Merge result of data type BIGINT and DOUBLE should be DOUBLE instead of STRING
...
This closes #3821
2 months ago
49dc957ac6
[FLINK-36981][transform] Considering sharding tables with different schema in transform projection
...
This closes #3826 .
2 months ago
486ee6f805
[FLINK-36956][transform] Append NOT NULL attribute for Primary Key columns
...
This closes #3815
2 months ago
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
2 months ago
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
2 months ago
fc71888d7a
[hotfix][cdc-common] Remove duplicated code to improve performance
...
This closes #3840 .
Co-authored-by: zhangchaoming.zcm <zhangchaoming.zcm@antgroup.com>
2 months ago
ddc645b7cb
[hotfix][k8s] Fix command-line option `from-savepoint` does not work in K8s deployment mode
...
This closes #3825 .
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
2 months ago
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
2 months ago
98f9f15132
[hotfix][docs] Add missed enumeration in MySQL Source
...
This closes #3832
2 months ago
baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
...
This closes #3434 .
2 months ago
6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
...
This closes #3360 .
2 months ago
dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
...
This closes #3760
Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
2 months ago
ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` ( #3831 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
702553736c
[build][hotfix] Allow pinning issues & PRs that never decay
...
This closes #3816
2 months ago
4f881f82d4
[FLINK-36952][source-connector/mongodb] Fix typos in MongoDB connector Chinese documentation ( #3811 )
2 months ago
9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case ( #3809 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
8424467239
[FLINK-36690][cdc-runtime] Fix schema operator hanging under extreme parallelized pressure
...
This closes #3680
2 months ago
2e03f9ad49
[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
...
This closes #3801
2 months ago
a2e433ebdd
[cdc-common] Extract column / schema type merging utility methods to `SchemaMergingUtils`
2 months ago
88d1d6fbd2
[tests][build] Update migration test matrix to 3.2.0 and later
2 months ago
dfa6de919f
[hotfix][docs] Fix ToC to include H1
...
This closes #3773 .
2 months ago
a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform ( #3758 )
...
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
2 months ago
5e3df7a0de
[hotfix] Fix building status badge in README as workflow files have been refactored ( #3807 )
...
* [hotfix] Fix building status badge in README as workflow files have been refactored
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: rename workflow files to `flink_cdc_ci` / `flink_cdc_ci_nightly`
As they're not strictly tied to specific JDK versions.
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform ( #3804 )
2 months ago
2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range ( #3785 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
6d21941661
[hotfix] Fix Java 11 target compatibility & add tests ( #3633 )
...
* [hotfix] Fix Java 11 target compatibility
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
# Conflicts:
# .github/workflows/flink_cdc_java_8.yml
# .github/workflows/flink_cdc_migration_test_base.yml
# pom.xml
* fix: clarify GiHub workflow names
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
b0a7d920b9
[FLINK-36866][transform] Fix unable to narrow casting on numeric values
...
This closes #3786 .
2 months ago
39b560e377
[FLINK-36854][transform] Add missed comment and default value after transform
...
This closes #3780 .
2 months ago
dfbaf617e2
[FLINK-36558][source-connector/mysql] Fix column metadata parsing compatibility with MySQL 8.0.17&8.0.18
...
This closes #3647 .
2 months ago
0b0bb02023
[FLINK-36895][cdc-connector][base] The JdbcSourceChunkSplitter#queryMin method passed a parameter with tableName/coiumnName reversed. ( #3797 )
2 months ago
12cf22f7b4
[FLINK-34688][cdc-connector][base] CDC framework split snapshot chunks asynchronously ( #3510 )
2 months ago
b50d1728e0
[FLINK-36891[[source-connector][mysql] Fix corrupted state in case of serialization failure in MySQL CDC Source
...
This closes #3794 .
2 months ago
Wink
Hongshun Wang
hiliuxg
yuxiqian
moses
Junbo wang
MOBIN
Kunni
Shawn Huang
Jzjsnow
Jason Zhang
Umesh Dangat
yuanoOo
stayrascal
Thorne
Robin Moffatt
Hang Ruan
ouyangwulin
Sergei Morozov