From 1fa762dd632dfa8cf52bbe491e2e42ce44860e38 Mon Sep 17 00:00:00 2001 From: Kunni Date: Thu, 6 Feb 2025 10:38:05 +0800 Subject: [PATCH] [FLINK-37252][doc] Align Postgres CDC Connector Chinese docs with English version This closes #3903 --- .../connectors/flink-sources/postgres-cdc.md | 19 ++++++++++++++++++- 1 file changed, 18 insertions(+), 1 deletion(-) diff --git a/docs/content.zh/docs/connectors/flink-sources/postgres-cdc.md b/docs/content.zh/docs/connectors/flink-sources/postgres-cdc.md index 4bae5b694..d1a8a0a78 100644 --- a/docs/content.zh/docs/connectors/flink-sources/postgres-cdc.md +++ b/docs/content.zh/docs/connectors/flink-sources/postgres-cdc.md @@ -236,12 +236,29 @@ Connector Options so it does not need to be explicitly configured 'execution.checkpointing.checkpoints-after-tasks-finish.enabled' = 'true' + + scan.lsn-commit.checkpoints-num-delay + optional + 3 + Integer + The number of checkpoint delays before starting to commit the LSN offsets.
+ The checkpoint LSN offsets will be committed in rolling fashion, the earliest checkpoint identifier will be committed first from the delayed checkpoints. + +
-Note: `slot.name` is recommended to set for different tables to avoid the potential `PSQLException: ERROR: replication slot "flink" is active for PID 974` error. See more [here](https://debezium.io/documentation/reference/1.9/connectors/postgresql.html#postgresql-property-slot-name). +### Notes + +#### `slot.name` option + +The `slot.name` is recommended to set for different tables to avoid the potential `PSQLException: ERROR: replication slot "flink" is active for PID 974` error. See more [here](https://debezium.io/documentation/reference/1.9/connectors/postgresql.html#postgresql-property-slot-name). + +#### `scan.lsn-commit.checkpoints-num-delay` option + +When consuming PostgreSQL logs, the LSN offset must be committed to trigger the log data cleanup for the corresponding slot. However, once the LSN offset is committed, earlier offsets become invalid. To ensure access to earlier LSN offsets for job recovery, we delay the LSN commit by `scan.lsn-commit.checkpoints-num-delay` (default value is `3`) checkpoints. This feature is available when config option `scan.incremental.snapshot.enabled` is set to true. ### Incremental Snapshot Options