8815f2b879
[FLINK-34865][pipeline-connector/mysql] Support sync newly added table's comment
...
This closes #3869
2 weeks ago
bbef6213a6
[hotfix][pipeline-connector][mysql] Fix missed optional option in MySqlDataSourceFactory
...
This closes #3867
2 weeks ago
e81df946b9
[minor][ci] Set proper timeout for compile_and_test step of CI job
2 weeks ago
a1c9c19d7d
[FLINK-36578][pipeline-connector/mysql] Introduce option to unify json type output between snapshot phase and binlog phase
...
This closes #3658
2 weeks ago
947dffca31
[FLINK-37122][build] Try to be compatible with old flink version 1.18.x
...
This closes #3859
2 weeks ago
7997f51c55
[FLINK-35067][cdc-connector][postgres] Adding metadata 'row_kind' for Postgres CDC Connector.
...
This closes #3716 .
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 weeks ago
a16abd5d24
[FLINK-36913][pipeline-connector][kafka] Introduce option to define custom mapping from upstream table id to downstream topic name
...
This closes #3805
2 weeks ago
77785c1c08
[hotfix[cdc-runtime] Close MetadataApplier in SchemaRegistry when the job stops
...
This closes #3864
2 weeks ago
cf95dcab64
[hotfix][test] Make pipeline migration tests more robust
...
This closes #3866
2 weeks ago
2fa215e5c4
[FLINK-35600][pipeline-connector/mysql] Add timestamp for low and high watermark
...
This closes #3415
2 weeks ago
afd4a74c0a
[FLINK-35802][pipeline-connectors/mysql] Clean ChangeEventQueue to avoid deadlock when calling BinaryLogClient#disconnect method
...
This closes #3463
2 weeks ago
177da16fac
[FLINK-36351][pipeline-connector/doris] Support the conversion of Flink TIME type to Doris String type
...
This closes #3620
2 weeks ago
6b13868dd5
[FLINK-36620][cdc-cli] Add support for specifying the --flink-home parameter via an '=' character
...
This closes #3838
2 weeks ago
087195a3a6
[FLINK-36224][docs] Add the version mapping between pipeline connectors and flink
...
This closes #3598
2 weeks ago
5691b7bf97
[FLINK-36406][cdc-runtime] Close MetadataApplier when the job stops
...
This closes #3623
2 weeks ago
9ad071c1fa
[FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector ( #3608 )
...
* [FLINK-36282][pipeline-connector][cdc-connector][mysql]fix incorrect data type of TINYINT(1) in mysql pipeline connector
* reformat code
* Update MySqlPipelineITCase.java
* pass a boolean value instead of Properties
* uodate FAQ
* add a method to get tinyInt1isBit
* add new cdc config `treat-tinyint1-as-boolean`
* Update MySqlChunkSplitter.java
* change param name
2 weeks ago
47e5cd6d89
[hotfix][pipeline-connector][maxcompute] Fix MaxCompute Pipeline Connector tests by upgrading maxcompute-emulator
...
This closes #3862
2 weeks ago
d83ccbeeb4
[FLINK-36754][transform] Projection should treated as an asterisk when projection expression is empty or null
...
This closes #3749
2 weeks ago
e2b8f70e0d
[FLINK-37124][build] Simplify logs in test cases to avoid flooding GHA outputs
...
This closes #3860
2 weeks ago
b5d9673258
[FLINK-34865][pipeline-connector/mysql] Support sync table and column comment
...
This closes #3482
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 weeks ago
50e6c82870
[build][minor] Upgrade the max file length from 3k to 4k
2 weeks ago
d77cf7fa75
[FLINK-36647][transform] Support Timestampdiff and Timestampadd function in cdc pipeline transform
...
This closes #3698
2 weeks ago
79e868b864
[FLINK-36741][transform] Fix the decimal precision and length lost during transform
...
This closes #3740
2 weeks ago
8b554458d3
[FLINK-36977][pipeline-connector/paimon] Apply default value when process add_column schema change envent
...
This closes #3824 .
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
2 weeks ago
551bdf395d
[FLINK-36636][transform] Supports timestamp comparison in cdc pipeline transform
...
This closes #3677
2 weeks ago
bcd70df85c
[FLINK-35387][cdc-connector][postgres] PG CDC source support heart beat
...
This closes #3667
2 weeks ago
6b65aed4c5
[FLINK-36974][cdc-cli] Support overwrite flink configuration via command line
...
This closes #3823
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
2 weeks ago
865e14bfd7
[FLINK-35634][build] Add CdcUp playground CLI scripts
...
This closes #3605
2 weeks ago
9992584365
[FLINK-37011][cdc-transform] Improve get source field value by column name in PreTransformProcessor
...
This closes #3836
2 weeks ago
0f675061e1
[FLINK-36700][pipeline-connector][elasticsearch] Elasticsearch pipeline sink supports authentication
...
This closes #3728
2 weeks ago
56dbb1fd53
[FLINK-36193][pipeline-connectors][paimon/doris/starrocks] Supports applying TRUNCATE & DROP Table Event to Paimon, StarRocks and Doris
...
This closes #3673
2 weeks ago
4dc31d8c61
[FLINK-37042][pipeline-connector/maxcompute] Rename maxcompute pipieline connector options to follow flink style
...
This closes #3852
2 weeks ago
32934393ce
[FLINK-36985][pipeline-connector/paimon] Tolerante ColumnAlreadyExistException when apply AddColumnEvent in paimon
...
This closes #3828 .
2 weeks ago
a130718c96
[FLINK-36858][pipeline-connector][kafka] Fix JsonRowDataSerializationSchema compatibility issue with Flink 1.20
...
This closes #3784
Co-authored-by: Leonard Xu <xbjtdcq@gmail.com>
3 weeks ago
75b8a0cdf3
[FLINK-36964][pipeline-connector/paimon] Fix potential exception when SchemaChange in parallel with Paimon Sink
...
This closes #3818
Co-authored-by: yuxiqian.yxq <yuxiqian.yxq@alibaba-inc.com>
3 weeks ago
2fd03e683e
[FLINK-36865][cdc] Provide UNIX_TIMESTAMP series functions in YAML pipeline
...
This closes #3819 .
3 weeks ago
39fd00ce49
[FLINK-36610] MySQL CDC supports parsing gh-ost / pt-osc generated schema changes ( #3668 )
...
Co-authored-by: MOBIN-F <18814118038@163.com>
3 weeks ago
f7f3901fa3
[FLINK-37012][transform] Fix argument type mismatch when metadata column used in function
...
This closes #3837
3 weeks ago
085684b773
[FLINK-36811][mysql] MySQL cdc setIsProcessingBacklog in snapshot phase and exit when snapshot phase finished ( #3793 )
3 weeks ago
1fb68a8d62
[FLINK-35325][transform] Skip insufficient_quota error when running test case using ad model. ( #3849 )
3 weeks ago
7b01d9ca40
[hotfix][ci] Fix CI failure due to implicit conflicts
...
This closes #3846
3 weeks ago
630e0d70c2
[FLINK-36701][cdc-runtime] Obtain latest evolvedSchema when SinkDataWriterOperator handles FlushEvent from failover
...
This closes #3802
Co-authored-by: jzjsnow <snow.jiangzj@gmail.com>
3 weeks ago
dd865bf440
[FLINK-36970][cdc-common] Merge result of data type BIGINT and DOUBLE should be DOUBLE instead of STRING
...
This closes #3821
3 weeks ago
49dc957ac6
[FLINK-36981][transform] Considering sharding tables with different schema in transform projection
...
This closes #3826 .
3 weeks ago
486ee6f805
[FLINK-36956][transform] Append NOT NULL attribute for Primary Key columns
...
This closes #3815
3 weeks ago
28985db062
[FLINK-36877][pipeline-connector/kafka] Correct canal-json output for delete record
...
This closes #3788
3 weeks ago
d3c049d8a7
[FLINK-36524][pipeline-connector][paimon] Bump Paimon version to 0.9.0
...
This closes #3644
3 weeks ago
fc71888d7a
[hotfix][cdc-common] Remove duplicated code to improve performance
...
This closes #3840 .
Co-authored-by: zhangchaoming.zcm <zhangchaoming.zcm@antgroup.com>
3 weeks ago
ddc645b7cb
[hotfix][k8s] Fix command-line option `from-savepoint` does not work in K8s deployment mode
...
This closes #3825 .
Co-authored-by: helloliuxg@gmail.com <xiaogenliu@kugou.net>
3 weeks ago
92081dfe58
[FLINK-35167][pipeline-connector/maxcompute] Introduce MaxCompute pipeline DataSink
...
This closes #3254 .
3 weeks ago
North Lin
Leonard Xu
Seung-Min Lee
moses
Olivier
Kunni
yuxiqian
wudi
Petrichor
Jzjsnow
Thorne
Sergei Morozov
Jason Zhang
MOBIN
wenmo
Wink
hiliuxg
Hongshun Wang
Junbo wang
Shawn Huang