e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
...
This closes #3860
2 weeks ago
b5d9673258
[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment
...
This closes #3482
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 weeks ago
50e6c82870
[build][minor] Upgrade the max file length from 3k to 4k
2 weeks ago
d77cf7fa75
[FLINK-36647][transform] Support Timestampdiff and Timestampadd function in cdc pipeline transform
...
This closes #3698
2 weeks ago
79e868b864
[FLINK-36741][transform] Fix the decimal precision and length lost during transform
...
This closes #3740
2 weeks ago
8b554458d3
[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent
...
This closes #3824 .
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 weeks ago
551bdf395d
[FLINK-36636][transform] Supports timestamp comparison in cdc pipeline transform
...
This closes #3677
2 weeks ago
bcd70df85c
[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat
...
This closes #3667
2 weeks ago
6b65aed4c5
[FLINK-36974][cdc-cli] Support overwrite flink configuration via command line
...
This closes #3823
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
2 weeks ago
865e14bfd7
[FLINK-35634][build] Add CdcUp playground CLI scripts
...
This closes #3605
2 weeks ago
9992584365
[FLINK-37011][cdc-transform] Improve get source field value by column name in PreTransformProcessor
...
This closes #3836
2 weeks ago
0f675061e1
[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication
...
This closes #3728
2 weeks ago
56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
...
This closes #3673
2 weeks ago
4dc31d8c61
[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style
...
This closes #3852
2 weeks ago
32934393ce
[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon
...
This closes #3828 .
2 weeks ago
a130718c96
[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20
...
This closes #3784
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 weeks ago
75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
...
This closes #3818
Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
3 weeks ago
2fd03e683e
[FLINK-36865][cdc] Provide UNIX_TIMESTAMP series functions in YAML pipeline
...
This closes #3819 .
3 weeks ago
39fd00ce49
[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes ( #3668 )
...
Co-authored-by: MOBIN-F <18814118038@163.com>
3 weeks ago
f7f3901fa3
[FLINK-37012][transform] Fix argument type mismatch when metadata column used in function
...
This closes #3837
3 weeks ago
085684b773
[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished ( #3793 )
3 weeks ago
1fb68a8d62
[FLINK-35325][transform] Skip insufficient_quota error when running test case using ad model. ( #3849 )
3 weeks ago
7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
...
This closes #3846
3 weeks ago
630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
...
This closes #3802
Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
3 weeks ago
dd865bf440
[FLINK-36970][cdc-common] Merge result of data type BIGINT and DOUBLE should be DOUBLE instead of STRING
...
This closes #3821
3 weeks ago
49dc957ac6
[FLINK-36981][transform] Considering sharding tables with different schema in transform projection
...
This closes #3826 .
3 weeks ago
486ee6f805
[FLINK-36956][transform] Append NOT NULL attribute for Primary Key columns
...
This closes #3815
3 weeks ago
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
3 weeks ago
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
3 weeks ago
fc71888d7a
[hotfix][cdc-common] Remove duplicated code to improve performance
...
This closes #3840 .
Co-authored-by: zhangchaoming.zcm <zhangchaoming.zcm@antgroup.com>
3 weeks ago
ddc645b7cb
[hotfix][k8s] Fix command-line option `from-savepoint` does not work in K8s deployment mode
...
This closes #3825 .
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
3 weeks ago
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
3 weeks ago
98f9f15132
[hotfix][docs] Add missed enumeration in MySQL Source
...
This closes #3832
3 weeks ago
baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
...
This closes #3434 .
4 weeks ago
6a345aaa80
[FLINK-34545][pipeline-connector/ob]Add OceanBase pipeline connector to Flink CDC
...
This closes #3360 .
4 weeks ago
dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
...
This closes #3760
Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
4 weeks ago
ddb5f00df5
[hotfix][tests] Fix unstable `OceanBaseMySQLModelITCase` ( #3831 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
4 weeks ago
702553736c
[build][hotfix] Allow pinning issues & PRs that never decay
...
This closes #3816
1 month ago
4f881f82d4
[FLINK-36952][source-connector/mongodb] Fix typos in MongoDB connector Chinese documentation ( #3811 )
1 month ago
9f44c523e4
[hotfix][tests] Fix unstable `testInitialStartupModeWithOpTs` case ( #3809 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
8424467239
[FLINK-36690][cdc-runtime] Fix schema operator hanging under extreme parallelized pressure
...
This closes #3680
1 month ago
2e03f9ad49
[FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
...
This closes #3801
1 month ago
a2e433ebdd
[cdc-common] Extract column / schema type merging utility methods to `SchemaMergingUtils`
1 month ago
88d1d6fbd2
[tests][build] Update migration test matrix to 3.2.0 and later
1 month ago
dfa6de919f
[hotfix][docs] Fix ToC to include H1
...
This closes #3773 .
1 month ago
a0ae3320fa
[FLINK-36784][common] Support to add metadata columns for data in the meta fields of DataChangeEvent at transform ( #3758 )
...
Co-authored-by: Kunni <lvyanquan.lyq@alibaba-inc.com>
1 month ago
5e3df7a0de
[hotfix] Fix building status badge in README as workflow files have been refactored ( #3807 )
...
* [hotfix] Fix building status badge in README as workflow files have been refactored
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
* fix: rename workflow files to `flink_cdc_ci` / `flink_cdc_ci_nightly`
As they're not strictly tied to specific JDK versions.
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
c6cf46b75c
[FLINK-36879][runtime] Support to convert delete as insert in transform ( #3804 )
1 month ago
2ad80066bc
[FLINK-36864][cdc-runtime] Fix unable to use numeric literals that goes beyond Int32 range ( #3785 )
...
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
6d21941661
[hotfix] Fix Java 11 target compatibility & add tests ( #3633 )
...
* [hotfix] Fix Java 11 target compatibility
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
# Conflicts:
# .github/workflows/flink_cdc_java_8.yml
# .github/workflows/flink_cdc_migration_test_base.yml
# pom.xml
* fix: clarify GiHub workflow names
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
---------
Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
1 month ago
yuxiqian
North Lin
Leonard Xu
wenmo
Wink
hiliuxg
Hongshun Wang
moses
Junbo wang
MOBIN
Kunni
Shawn Huang
Jzjsnow
Jason Zhang
Umesh Dangat
yuanoOo
stayrascal
Thorne
Robin Moffatt
Hang Ruan