Message Cross-Cluster Replication

Recent Pages

Message Cross-Cluster Replication

Last updated: 2024-05-14 17:35:54

Overview
TDMQ RocketMQ supports customers in synchronizing messages between two clusters (whether in the same region or different regions). You can replicate the messages from a Topic in Cluster A to a Topic in Cluster B based on Topic dimension. When you are replicating messages for a specific Topic, RocketMQ allows filtering based on specific conditions (such as Tag or SQL expressions), supports arbitrary start and stop of the replication tasks, and enables monitoring of the progress and health status of the replicate tasks.
Billing Rules
The message cross-cluster replication feature is currently free; before the billing is started, Tencent Cloud notifies customers multiple times one month in advance through the message center, SMS, and Email.
Directions
Creating a Task
Enter the Cross-Cluster Replication page, click Create a Task at the top of the page, and fill in the following fields as required:
Task Name: Within 200 characters; it can only include Chinese characters, digits, letters,‘-’ and‘_’.
Source Topic: Select the region, cluster, namespace, and topic in sequence from the dropdown. If the required cluster or topic is not found, you can create one on the cluster list page.
Target Topic: Select the region, cluster, namespace, and topic in sequence from the dropdown. If the required cluster or topic is not found, you can create one on the cluster list page.
Filter Type: Supports two methods: TAG Filtering and SQL Filtering.
Replication Starting Position: Supports starting the replication from the latest location or specifying a time point to start.
Starting Task Immediately: If this option is enabled, replication will begin according to the current task configuration after the task creation is completed.
﻿
After Create a Task is clicked, you are redirected to the Task List Page, and the task is considered created after initialization.
The replication task you created is unidirectional, meaning if you create a replication task from Topic A to Topic B, messages from Topic A are automatically replicated to Topic B; if you need a bidirectional replication task, you have to create another task from Topic B to Topic A.
Viewing Task Details
After the task is created, you can see the newly added replication task on the task list page, and quickly view the task's status. Clicking the Start/Pause in the operation bar can quickly start or pause the task.
Ongoing tasks cannot have their configuration information modified. If you want to change the configuration of a replication task, please pause the task first, then click Edit in the operation bar or enter the task details page and click Edit in the top right corner of Basic Information to modify the task information.
You can click the task name to enter the task details page and view detailed configurations such as filtering rules and start time. In the monitoring section, you can view real-time monitoring of the current message replication task, such as the rate of successful replications (XX messages/second), failure rates, message replication delays, etc.
﻿
Exception Handling
Under normal circumstances, the status bar will display either Running or Paused; if the status is Failed to Start, you need to check if the task operation status and detailed configurations are correct, such as whether the SQL expression is accurate. Hovering over the failed status can display the specific reason for the failure.
﻿
If the task status displays failure, you can click Edit in the operation bar, or enter the task details page and click Edit in the top right corner of Basic Information to correct the task information.