You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

History

Hang Ruan 606c9d20c6 [build] Update version to 3.4-SNAPSHOT and add release-3.3 docs This closes #3870		1 week ago
..
conf	[hotfix][test] Make pipeline migration tests more robust	2 weeks ago
datastream	[build] Update version to 3.4-SNAPSHOT and add release-3.3 docs	1 week ago
misc	[hotfix][test] Reorganize test cases	4 months ago
.gitignore	[FLINK-35736][test] Add migration test scripts & CI workflows	6 months ago
README.md	[FLINK-35736][test] Add migration test scripts & CI workflows	6 months ago
prepare_libs.rb	[build] Update version to 3.4-SNAPSHOT and add release-3.3 docs	1 week ago
run_migration_test.rb	[build] Update version to 3.4-SNAPSHOT and add release-3.3 docs	1 week ago

README.md

Flink CDC Migration Test Utilities

Pipeline Jobs

Preparation

Install Ruby (macOS has embedded it by default)
(Optional) Run gem install terminal-table for better display

Compile snapshot CDC versions

Set CDC_SOURCE_HOME to the root directory of the Flink CDC git repository
Go to tools/mig-test and run ruby prepare_libs.rb to download released / compile snapshot CDC versions

Run migration tests

Enter conf/ and run docker compose up -d to start up test containers
Set FLINK_HOME to the home directory of Flink
Go back to tools/mig-test and run ruby run_migration_test.rb to start testing

Result

The migration result will be displayed in the console like this:

+--------------------------------------------------------------------+
|                       Migration Test Result                        |
+--------------+-------+-------+-------+--------------+--------------+
|              | 3.0.0 | 3.0.1 | 3.1.0 | 3.1-SNAPSHOT | 3.2-SNAPSHOT |
| 3.0.0        | ❓    | ❓    | ❌    | ✅           | ✅           |
| 3.0.1        |       | ❓    | ❌    | ✅           | ✅           |
| 3.1.0        |       |       | ✅    | ❌           | ❌           |
| 3.1-SNAPSHOT |       |       |       | ✅           | ✅           |
| 3.2-SNAPSHOT |       |       |       |              | ✅           |
+--------------+-------+-------+-------+--------------+--------------+

✅ - Compatible, ❌ - Not compatible, ❓ - Target version doesn't support --from-savepoint

DataStream Jobs

See datastream/README.md.