tencent cloud

All product documents
TDMQ for RocketMQ
Message Cross-Cluster Replication
Last updated: 2025-01-25 11:59:07
Message Cross-Cluster Replication
Last updated: 2025-01-25 11:59:07

Overview

TDMQ RocketMQ supports customers in synchronizing messages between two clusters (whether in the same region or different regions). You can replicate the messages from a Topic in Cluster A to a Topic in Cluster B based on Topic dimension. When you are replicating messages for a specific Topic, RocketMQ allows filtering based on specific conditions (such as Tag or SQL expressions), supports arbitrary start and stop of the replication tasks, and enables monitoring of the progress and health status of the replicate tasks.

Billing Rules

The message cross-cluster replication feature is currently free; before the billing is started, Tencent Cloud notifies customers multiple times one month in advance through the message center, SMS, and Email.

Directions

Creating a Task

Enter the Cross-Cluster Replication page, click Create a Task at the top of the page, and fill in the following fields as required:
Task Name: Within 200 characters; it can only include Chinese characters, digits, letters,‘-’ and‘_’.
Source Topic: Select the region, cluster, namespace, and topic in sequence from the dropdown. If the required cluster or topic is not found, you can create one on the cluster list page.
Target Topic: Select the region, cluster, namespace, and topic in sequence from the dropdown. If the required cluster or topic is not found, you can create one on the cluster list page.
Filter Type: Supports two methods: TAG Filtering and SQL Filtering.
Replication Starting Position: Supports starting the replication from the latest location or specifying a time point to start.
Starting Task Immediately: If this option is enabled, replication will begin according to the current task configuration after the task creation is completed.

After Create a Task is clicked, you are redirected to the Task List Page, and the task is considered created after initialization.
The replication task you created is unidirectional, meaning if you create a replication task from Topic A to Topic B, messages from Topic A are automatically replicated to Topic B; if you need a bidirectional replication task, you have to create another task from Topic B to Topic A.

Replication Task

To facilitate the creation of message replication tasks, you can also quickly create new tasks by copying the configuration of existing tasks.
Go to the Cross-Cluster Replication page, select the created task, and click Copy Task in the Operation column. The task creation page will automatically populate the same parameters of the copied task. You can create a new task with simple modifications (currently, the console does not allow creating tasks with identical configurations).

Viewing Task Details

After the task is created, you can see the newly added replication task on the task list page, and quickly view the task's status. Clicking the Start/Pause in the operation bar can quickly start or pause the task.
Ongoing tasks cannot have their configuration information modified. If you want to change the configuration of a replication task, please pause the task first, then click Edit in the operation bar or enter the task details page and click Edit in the top right corner of Basic Information to modify the task information.
You can click the task name to enter the task details page and view detailed configurations such as filtering rules and start time. In the monitoring section, you can view real-time monitoring of the current message replication task, such as the rate of successful replications (XX messages/second), failure rates, message replication delays, etc.


Exception Handling

Under normal circumstances, the status bar will display either Running or Paused; if the status is Failed to Start, you need to check if the task operation status and detailed configurations are correct, such as whether the SQL expression is accurate. Hovering over the failed status can display the specific reason for the failure.

If the task status displays failure, you can click Edit in the operation bar, or enter the task details page and click Edit in the top right corner of Basic Information to correct the task information.
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon