yuxiqian 82bf8a08ef
[tests][ci] Miscellaneous improvements on CI robustness
This closes 
..
datastream-3.2.0 [tests][ci] Miscellaneous improvements on CI robustness
datastream-3.2.1 [tests][ci] Miscellaneous improvements on CI robustness
datastream-3.3.0 [tests][ci] Miscellaneous improvements on CI robustness
datastream-3.4-SNAPSHOT [tests][ci] Miscellaneous improvements on CI robustness
README.md [FLINK-35736][test] Add migration test scripts & CI workflows
compile_jobs.rb [tests][ci] Miscellaneous improvements on CI robustness
run_migration_test.rb [tests][ci] Miscellaneous improvements on CI robustness

README.md

Flink CDC MigrationTestUtils

DataStream Jobs

Preparation

  1. Install Ruby (macOS has embedded it by default)
  2. (Optional) Run gem install terminal-table for better display

Compile DataStream Jobs

  1. Go to tools/mig-test/datastream and run ruby compile_jobs.rb to compile dummy DataStream jobs with specific version tags
  2. Then, run ruby run_migration_test.rb to start testing