Commit Graph

31 Commits (0211a136cf63a65c0b9a9c3aab322736ceed0faf)

Author SHA1 Message Date
Sergei Morozov 5691b7bf97
[FLINK-36406][cdc-runtime] Close MetadataApplier when the job stops
This closes  #3623
1 month ago
yuxiqian e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
This closes  #3860
1 month ago
North Lin b5d9673258
[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment
This closes #3482

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
hiliuxg 8b554458d3
[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent
This closes #3824.

Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
1 month ago
yuxiqian 56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
This closes #3673
1 month ago
hiliuxg 32934393ce
[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon
This closes  #3828.
1 month ago
Kunni 75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
This closes #3818

Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
1 month ago
Kunni 7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
This closes #3846
2 months ago
Jzjsnow 630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
This closes #3802

Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
2 months ago
Kunni d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
This closes #3644
2 months ago
Umesh Dangat baba9c6ae6
[FLINK-37017][cdc-common] Supports map and array types for binary record data
This closes #3434.
2 months ago
stayrascal dca94bdd71
[FLINK-36790][cdc-connector][paimon] Set waitCompaction to true in PaimonWriter to avoid CME problem
This closes  #3760

Co-authored-by: wuzhiping <wuzhiping.007@bytedance.com>
2 months ago
yuxiqian 2e03f9ad49 [FLINK-36763][cdc-runtime] Introduce distributed schema evolution topology for sources with parallelized metadata
This closes #3801
2 months ago
yuxiqian 6d21941661
[hotfix] Fix Java 11 target compatibility & add tests (#3633)
* [hotfix] Fix Java 11 target compatibility

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

# Conflicts:
#	.github/workflows/flink_cdc_java_8.yml
#	.github/workflows/flink_cdc_migration_test_base.yml
#	pom.xml

* fix: clarify GiHub workflow names

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>

---------

Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com>
2 months ago
Kunni 3a2d799fd8
[FLINK-36750][pipeline-connector/paimon] Restore SinkWriter from state to keep the information of previous SinkWrite when schema evolution happen
This closes #3744.
3 months ago
ConradJam dd79a02f0f
[FLINK-36586][build] Update flink version to 1.19 (#3660)
Co-authored-by: ConradJam <czy006@apache.com>
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
3 months ago
Kunni ae986ab3f6
[FLINK-36609][pipeline-connector][paimon] Add partition columns to primary keys
This closes  #3641.
4 months ago
Kunni f38341b02e
[FLINK-36541][pipeline-connector][paimon] Pass checkpointId to StoreSinkWrite#prepareCommit correctly
This closes #3652.
4 months ago
Junbo wang ff77a490bd
[FLINK-36517][pipeline-connector][paimon] Use filterAndCommit API to avoid committing the same datafile twice
This closes  #3639
4 months ago
Kunni ecfee702dc
[FLINK-36560][pipeline-connector][paimon] Fix the issue that timestamp_ltz field is not correctly converted
This closes  #3648.
4 months ago
MOBIN aedccb698e
[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCommittableChannelComputer Topology name
This closes #3559
6 months ago
yuxiqian 78fda8b5ab
[FLINK-35243][cdc-common] Extends more schema change event types support
This close  #3521.
6 months ago
Kunni 7f08c6caba
[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOperator when job restoration
This closes #3553
6 months ago
Kunni 64f996b504
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in Paimon sink
This closes  #3499.
7 months ago
Kunni 3bb1f3ca45
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for retry Committable to avoid duplicate commit
This closes #3504.
7 months ago
yuxiqian 5ed9e05bdf
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT schema evolution behavior
This closes #3339.
7 months ago
Junbo wang b15a226ccd
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeline connector to 0.8.2
This closes #3335

Co-authored-by: wangjunbo <wangjunbo@qiyi.com>
7 months ago
yux 2bd2e4ce24
[FLINK-35121][common] Adds validation for pipeline definition options 9 months ago
joyCurry30 8a7fdd5ae3
[minor][cdc-connector][paimon] Remove duplicate interface implements 9 months ago
joyCurry30 0214166049
[FLINK-35325][cdc-connector][paimon] Support specify column order when adding new columns to a table
This closes #3323.
9 months ago
Kunni ef2eece256
[pipeline-connector][paimon] add paimon pipeline data sink connector. (#2916) 10 months ago