Qingsheng Ren
daceb42168
[build] Use ${project.version} instead of ${revision} for dependency version
...
This is documented in https://maven.apache.org/maven-ci-friendly.html#dependencies
1 year ago
Qingsheng Ren
c0ee1c188e
[build] Skip maven-deploy-plugin for test modules and flink-cdc-dist
1 year ago
Jiabao Sun
8a08ded410
[cdc-pipeline-connector][mysql] Fix precision problem of BIT type conversion ( #2820 )
...
This closes #2820 .
1 year ago
Dian Qi
f970444efa
[cdc-source-connector][mysql] fix deserialization issue on table metadata binlog event ( #2682 )
...
Co-authored-by: EchoLee5 <39044001+EchoLee5@users.noreply.github.com>
1 year ago
Jiabao Sun
7d7c1af553
[pipeline-connector][mysql] Remove unnecessary serverTimeZone in DebeziumEventDeserializationSchema ( #2816 )
1 year ago
Leonard Xu
18fb0d8b7f
[build][hotfix] Remove useless suppressions. ( #2817 )
1 year ago
Josh Mahonin
63b39ba22c
[cdc-source-connector][mysql] Fix attempted load of isSuspended in MySqlSplitSerializer::deserializeSplit when cdc version <= 2.2.0 ( #2550 )
...
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun
8c75db145d
[cdc-pipeline-connector][mysql] Ensure the inference of MEDIUMINT_UNSIGNED type matches INT type in table schema ( #2811 )
1 year ago
He Wang
a10e07fd36
[cdc-connector][oceanbase] Add option for obcdc extra configs ( #2543 )
...
This closes #2543 .
1 year ago
Leonard Xu
0eae214183
[pipeline-connector][mysql] Enable send schema change by default ( #2815 )
...
This closes #2815 .
1 year ago
Hang Ruan
30c8254af3
[3.0][cdc-runtime] Remove waitForFlushSuccess field in request handler ( #2812 )
1 year ago
PengFei Li
33b7c85093
[pipeline-connector][starrocks] Add starrocks pipeline connector ( #2765 )
...
This closes #2645 .
1 year ago
Kunni
4abd86a500
[pipeline-connector][doris] add doris pipeline connector. ( #2810 )
...
Co-authored-by: wudi <676366545@qq.com>
1 year ago
Jiabao Sun
8ca3091805
[cdc-pipeline-connector][mysql] Ensure the precision inference of DECIMAL type matches table schema
1 year ago
Hang Ruan
1766e82d7c
[3.0][cdc-common & runtime] Remove useless flink imports
1 year ago
Jiabao Sun
08c5dfed83
[cdc-pipeline-connector][mysql] Add tests for mysql pipeline connector
...
Co-authored-by: Hang Ruan <ruanhang1993@hotmail.com>
1 year ago
Jiabao Sun
174282d3ef
[cdc-pipeline-connector][mysql] Support more mysql types
1 year ago
Hang Ruan
ec3d558485
[cdc-pipeleine-connecotr][mysql] Send CreateTableEvent in the mysql pipeline connector
1 year ago
Hang Ruan
10ccbde023
[cdc-pipeline-connector][mysql] Parse the alter statement to generate SchemaChangeEvent
1 year ago
Jiabao Sun
d0cce26b76
[cdc-pipeline-connector][mysql] Introduce mysql cdc pipeline DataSource
1 year ago
Qingsheng Ren
a328f9895a
[cdc-cli][cdc-composer][cdc-dist] Support submitting job to general Flink environments ( #2807 )
...
This closes #2807 .
1 year ago
Qingsheng Ren
9ce8450cf2
[cdc-runtime][hotfix] Setup waitFlushSuccess before responding operator to flush. ( #2805 )
...
This closes #2805 .
There might be a case that sink flushes faster than schema operator requesting release upstream. In that case waitFlushSuccess has not been set when sink has flushed successfully, which will lead to a NullPointerException.
1 year ago
Leonard Xu
95921d5620
[cdc-common] Introduce "pipeline.local-time-zone" config option which help handle time zone well ( #2797 )
...
This closes #2797 .
1 year ago
Hang Ruan
e435004eda
[cdc-common][hotfix] Remove useless flink imports ( #2803 )
...
This closes #2803 .
1 year ago
Qingsheng Ren
cfb3fd206e
[build] Let surefire plugin to keep the full stacktrace on test failure ( #2804 )
...
This closes #2804 .
1 year ago
Kunni
b60322bef7
[pipeline-common] Use column name to check whether the schema contains specific column or not. ( #2801 )
...
This closes #2801 .
1 year ago
Qingsheng Ren
3bf1428233
[cdc-composer][route][sink] Add name for route and improve name for sink
1 year ago
Leonard Xu
a8f4ba8cc6
[cdc-composer][hotfix] Always chain operator by default
1 year ago
Leonard Xu
f0c630d6f6
[cdc-composer][sink] Use correct name for sink operator
1 year ago
Qingsheng Ren
4843ab2432
[cdc-runtime] SchemaRegistry should complete the future after making the checkpoint ( #2800 )
...
This closes #2800 .
1 year ago
Xin Gong
2d9dc018c5
[cdc-connector][sqlserver][tests] Fix UT errors by increasing the wait time after committing SQL ( #2799 )
...
This closes #2799 .
1 year ago
Qingsheng Ren
173deb5248
[cdc-composer] Add common and runtime JAR when submit ( #2795 )
...
This closes #2795 .
1 year ago
Xin Gong
5f318346ff
[cdc-connector][debezium] Supports conversion from binary bytes to base64 encoded string ( #2435 )
...
This closes #2435 .
1 year ago
Hang Ruan
d1c3f8500b
[cdc-connector][mysql] MysqlTableSource return metadata in a fixed order ( #2578 )
1 year ago
gongzhongqiang
72d33c8965
[cdc-connector][mysql] Fix snapshot fetch size conf does not take effect ( #2766 )
1 year ago
Hongshun Wang
5c00f76d0f
[cdc-connector][oracle] Expose ability to skip backfill in snapshot period for Oracle CDC ( #2793 )
...
This closes #2793 .
1 year ago
yunqingmo
ef1c095763
[cdc-connector][oracle] Fix wrong table path during backfill phase which leads to potential data loss ( #2707 )
...
This closes #2707 .
1 year ago
Qingsheng Ren
cc9d368b63
[cdc-composer][tests] Add integration tests for FlinkPipelineComposer ( #2776 )
...
This closes #2766 .
1 year ago
Qingsheng Ren
100fb4a59e
[cdc-dist] Introduce flink-cdc.sh as the entrypoint of the Flink CDC ( #2791 )
1 year ago
gongzhongqiang
1a5065e774
[3.0] [flink-cdc-dist] Collect all distro resources into a TAR ( #2636 )
...
This closes #2621 #2622
Co-authored-by: Qingsheng Ren <renqschn@gmail.com>
1 year ago
Hongshun Wang
f57d6f6e67
[cdc-connector][sqlserver] Expose ability to skip backfill in snapshot period for SqlServer CDC.( #2783 )
...
This closes #2783 .
1 year ago
Hongshun Wang
a6379358e4
[cdc-connector][mysql] Expose ability to skip backfill in snapshot period for MySQL CDC.
1 year ago
Hongshun Wang
e7c713eca6
[cdc-connector][mongodb] Expose ability to skip backfill in snapshot period for Mongodb CDC.
1 year ago
Hongshun Wang
c6cb3b2371
[cdc-connector][postgres] Expose ability to skip backfill in snapshot period for Postgres CDC.
1 year ago
Hongshun Wang
4e248fad33
[cdc-connector][base] Support skip snapshot backfill for incremental snapshot connector
1 year ago
Hongshun Wang
13be14fe3f
[cdc-connector][base][tests] Introduce snapshot phase hooks for better snapshot test
1 year ago
Qingsheng Ren
a771abef90
[cdc-composer] Add routing logic into the Flink composer
1 year ago
Qingsheng Ren
f22ac3e788
[cdc-cli][cdc-composer] Use sourceTable and sinkTable as keyword in route definition
1 year ago
Qingsheng Ren
416562c9ba
[cdc-runtime] Add RouteFunction for routing change events
1 year ago
Qingsheng Ren
2bde0beaec
[cdc-common] Introduce AssertJ-style assertion system for Flink CDC data structures
1 year ago