tencent cloud

Log In Sign Up Free

Detect AI Fraud with Tencent eKYC！Intercept 99%+ Deepfake Attacks!

Data Transfer Service

Release Notes and Announcements

Announcements

Data Migration/Sync Tasks Will Start Billing

Product Introduction

Data Subscription (Kafka Edition)

Supported Regions

Specification Description

Data Migration Specification

Data Synchronization Specification

Purchase Guide

Billing Overview

Configuration Change Description

Payment Overdue

Getting Started

Data Migration Guide

Data Sync Guide

Data Subscription Guide (Kafka Edition)

Preparations

Business Evaluation

Network Preparation

Overview of Preparations Related to Network

Interworking Between local IDC and Tencent Cloud

Cloud Connect Network Access

Public Network Access

Interworking Between Other Cloud Vendors and Tencent Cloud

Interworking in Tencent Cloud

Adding DTS IP Addresses to the Allowlist of the Corresponding Databases

Granting DTS Access IP for a Single Task

Granting IP Range of DTS Access IP for Batch Tasks

DTS Service Permission Preparation

Create sub users and authorize the use of DTS

Authorize sub users with financial permissions

Authorizing DTS to Access Other Cloud Service Resources

Database and Permission Preparation

Configuring Binlog in Self-Built MySQL

Data Migration

Databases Supported by Data Migration

Cross-Account TencentDB Instance Migration

Migration to MySQL Series

Migrating to MySQL

Migration from MySQL to TencentDB for MySQL

Migration from MariaDB/Percona to TencentDB for MySQL

Migration to MySQL from TDSQL-C for MySQL

Migration from TDSQL for MySQL to TencentDB for MySQL

Migrating to MariaDB

Migration from MySQL to TencentDB for MariaDB (MySQL/MariaDB/Percona)

Migration from TDSQL for MySQL to TencentDB for MariaDB

Migrating to TDSQL-C for MySQL

Migration from MySQL/MariaDB/Percona to TDSQL-C for MySQL

Migration from TDSQL for MySQL to TDSQL-C for MySQL

Migrating to TDSQL MySQL

Migration from TDSQL for MySQL to TDSQL for MySQL

Migration from MySQL/MariaDB/Percona/TDSQL MySQL to TDSQL for MySQL

Migrating to TDSQL TDStore

Migration from MySQL/MariaDB/Percona/TDSQL for MySQL to TDSQL for MySQL (TDStore)

Advanced Operations for MySQL Series Migration

Migrating Advanced Object

Creating Data Consistency Check Task（MySQL）

Account Migration

Database/Table Renaming

Migrating Online DDL Temp Table

Processing for MySQL Series Pre-Check Failure

Database Connection Check

Peripheral Check

Source Instance Permission Check

Partial Database Parameter Check

Target Instance Permission Check

Target Database Content Conflict Check

Target Database Space Check

Binlog Parameter Check

Foreign Key Dependency Check

Advanced Object Check

Warning Item Check

TDSQL Proxy Check

TDSQL Kernel Check

DDL Ring Linkage Synchronization Detection for Same Database and Table Objects

DDL Synchronization Conflict Detection for the Same Target and Same Database and Table Object

Offline Migration of MySQL Data

Migrating to PostgreSQL

Migration from PostgreSQL to TencentDB for PostgreSQL

Migration from TDSQL-C PostgreSQL to TencentDB for PostgreSQL

PostgreSQL Physical Migration

Processing for PostgreSQL Series Pre-Check Failure

Database Connection Check

Object Dependency Check

Source or Target Instance Permission Check

Incremental Migration Pre Check

Structural Compatibility Check

Structural Conflict Check

Account Conflict Check

Parameter Configuration Conflict Check

Plugin Compatibility Check

Multi Task Conflict Detection

Long Transaction Check

Migrating to MongoDB

Migration from MongoDB to MongoDB

Supported Capabilities

Migration Operation Guide

Fix for Verification Failure

MongoDB Connection Check

Database/Table Content Conflict Check

Source Database Node Role Check

Source/Target Database Account Permission Check

Database Version Check

Database Capacity Check

Target Database Load Check

Source Database Balancer Check

Time Series Collection Verification

Compression Algorithm Verification

MongoDB Data Consistency Verification

Description of Consistency Verification Function

Creating Data Consistency Check Task

Common Consistency Verification Issues

Migrating to SQL Server

Migration from SQL Server to TencentDB for SQL Server

Migration Operation Guide

Pre-Validation Failure Handling

Migration Parameter Check

Migration Network Check

Source Database Connectivity Check

Target Database Connectivity Check

Disk Space Check

Character Set check

Database Version Check

User Permission Check

Source Database Existence Check

Target Database Existence Check

Migrating to TencentDB for Redis

Migration from Redis to Redis

Supported Capabilities

Migration Operation Guide

Check for Migration from Standard Architecture to Cluster Architecture

Key Prefix Filtering

Fix for Verification Failure

Network Connectivity

Source-Target Instance Version Compatibility

Source Instance Parameter Check

Target Instance Capacity Check

Target Instance Status Check

Source Instance Type (Master or Replica)

Handling of Common Errors

Migrating to KeeWiDB

Migration from Redis to KeeWiDB

Supported Capabilities

Operation Guide

Migration from Tendis to KeeWiDB

Task Management

Data Sync

Databases Supported by Data Sync

Cross-Account TencentDB Instance Sync

Sync to MySQL series

Sync to MySQL

Sync from MySQL/MariaDB/Percona to TencentDB for MySQL

Sync from TDSQL for MySQL to TencentDB for MySQL

Sync from TDSQL-C for MySQL to TencentDB for MySQL

Sync to MariaDB

Sync from MySQL/MariaDB/Percona/TDSQL-C MySQL to TencentDB for MariaDB

Sync from TDSQL for MySQL to TencentDB for MariaDB

Sync to TDSQL-C for MySQL

Sync from TDSQL-C for MySQL to TDSQL-C for MySQL

Sync from MariaDB to TDSQL-C for MySQL

Sync from TDSQL for MySQL to TDSQL-C for MySQL

Sync to TDSQL for MySQL

Sync from TDSQL for MySQL to TDSQL for MySQL

Supported Capabilities

Use Instructions

Sync Operation Guide

Sync from MySQL/MariaDB/Percona to TDSQL for MySQL

Sync from MySQL/MariaDB/Percona to TDSQL for TDStore

Sync to TDSQL TDStore

Sync from MySQL/MariaDB/Percona/TDSQL-C for MySQL to TDSQL TDStore

MySQL Series Advanced Sync Operations

Syncing Advanced Object

Creating Data Consistency Check Task

DDL and DML Filtering

WHERE Condition Filtering

Database/Table Renaming

Syncing Online DDL Temp Table

Column Filtering

MySQL series Pre Validation Failed Processing

Database Connection Check

Peripheral Check

Source Instance Permission Check

Partial Database Parameter Check

Target Database Content Conflict Check

Target Database Space Check

Binlog Parameter Check

Foreign Key Dependency Check

Advanced Object Check

Warning Item Check

TDSQL Proxy Check

TDSQL kernel check

DLL Ring Sync Check for Single Database/Table Object

DLL Sync Conflict Check for Single Database/Table Object in the Same Target

Synchronize to PostgreSQL

Synchronization from PostgreSQL to PostgreSQL

PostgreSQL Pre Validation does not Pass Processing

Database Connection Check

Object Dependency Check

Source or Target Instance Permission Check

Incremental Migration Pre Check

Structural Compatibility Check

Structural Conflict Check

Account Conflict Check

Parameter Configuration Conflict Check

Plugin Compatibility Check

Primary Key Dependency Check

Check the Key Parameters of the Instance

Multi Task Conflict Detection

Synchronize to Kafka

Difference Between Data Sync to Kafka and Data Subscription

Data Delivery to Kafka Policy Settings

MySQL/MariaDB/Percona/TDSQL-C MySQL Sync to Kafka

Supported Capabilities

Data Sync Guide

Data Consumption Guide

Demo Description

Avro Demo Description

JSON Demo Description

Canal Demo Description (Canal ProtoBuf/Canal JSON)

TDSQL MySQL Sync to Kafka

Supported Capabilities

Use Instructions

Data Sync Guide

Data Consumption Guide

Task Management

Data Subscription (Kafka Edition)

Databases Supported by Data Subscription

MySQL series Data Subscription

Creating MySQL or TDSQL for MySQL Data Subscription

Creating TDSQL for MySQL Data Subscription

Creating MariaDB/Percona Data Subscription

Consuming MySQL Data

Operation Guide for Consuming MySQL Series Subscribed Data

Demo Description

ProtoBuf Demo Description

Avro Demo Description

JSON Demo Description

Consuming Data with Flink

Consuming MySQL or TDSQL-C for MySQL Subscribed Data Using Flink

Consuming TDSQL for MySQL Data with Flink

Demo Description

Avro Demo Description (Flink)

ProtoBuf Demo Description (Flink)

Advanced Subscription Operations

Setting Partitioning Policy

Fix for Verification Failure

Database Connection Check

Peripheral Check

Source Instance Permission Check

Binlog Parameter Check

Data Subscription for TDSQL PostgreSQL

Creating Data Subscription for TDSQL PostgreSQL Edition

Consuming TDSQL for PostgreSQL Data

Fix for Verification Failure

Database Connection Check

Peripheral Check

Source Instance Permission Check

Constraint Check

MongoDB Data Subscription

Creating Data Subscription for MongoDB

Consuming MongoDB Data

Fix for Verification Failure

MongoDB Connection Check

Account Permissions Check

Pipeline Validity Check

Task Management

Task Status Description

Viewing Subscription Details

Modifying Subscribed Object

Pay-as-You-Go to Monthly Subscription

Resetting Subscription

Terminating/Returning an Instance

Consumption Management

Creating Consumer Group

Managing Consumer Group

Modify Consumption Site offset

Fix for Verification Failure

Check Item Overview

Cutover Description

Monitoring and Alarms

Supported Monitoring Indicators

Supported Events

Configuring Metric Alarms and Event Alarms via the Console

Configuring Alarm Policy for Data Migration

Configuring Alarm Policy for Data Sync

Configuring Alarm Policy for Data Subscription

Configure Event Alarm Push

Viewing Alarm Records

View Monitoring Metrics

Configuring Indicator Monitoring and Event Alarm by APIs

Ops Management

Configuring Maintenance Time

Task Status Change Description

Practical Tutorial

Synchronizing Local Database to the Cloud

Creating Two-Way Sync Data Structure

Creating Many-to-One Sync Data Structure

Creating Multi-Site Active-Active IDC Architecture

Selecting Data Sync Conflict Resolution Policy

Using CLB as Proxy for Cross-Account Database Migration

Migrating Self-Built Databases to Tencent Cloud Databases via CCN

Best Practices for DTS Performance Tuning

FAQs

FAQs for Data Subscription Kafka Edition

Regular Expressions for Subscription

Error Handling

Failed Connectivity Test

Failed or Alarmed Check Item

Inability to Select Subnet During CCN Access

Slow or Stuck Migration

Data Sync Delay

High Data Subscription Delay

Data Consumption Exception

API Documentation

Making API Requests

Request Structure

(NewDTS) Data Migration APIs

Data Sync APIs

Data Consistency Check APIs

DescribeCompareReport

DeleteCompareTask

ModifyCompareTask

ModifyCompareTaskName

CreateCompareTask

DescribeCompareTasks

(NewDTS) Data Subscription APIs

DTS API 2018-03-30

Service Agreement

Service Level Agreements

DocumentationData Transfer ServiceData SyncSync to MySQL seriesMySQL Series Advanced Sync OperationsDDL and DML Filtering

DDL and DML Filtering

Last updated: 2024-12-25 15:00:38

DDL and DML Filtering

Last updated: 2024-12-25 15:00:38

Overview
When configuring synchronization tasks, you can select DDL and DML synchronization policies. Once the policies are set, only the SQL data that is checked will be synchronized to the target database. This allows users to flexibly set up synchronization schemes among multiple databases or split data tables based on the scenario.
Application Scope
The DDL and DML filtering feature currently supports synchronization linkages between MySQL/MariaDB/Percona/TDSQL-C MySQL/TDSQL TDStore/TDSQL MySQL/Kafka.
Directions
1. In the Sync Task settings, select different SQL policies on the Set sync options and objects page.
DML: Supports types such as Insert, Update, and Delete.
DDL:
Check DDL without enabling the Custom DDL switch to synchronize all DDLs from the source database to the target database.
Check DDL and enable the Custom DDL switch to customize and choose specific DDL policies. Only the selected policies will be synchronized to the target database.
If DDL is not checked, no DDLs will be synchronized to the target database.
﻿
2. Once the settings are completed, click Save and Next to proceed with the next steps in the synchronization task process.

Was this page helpful?

You can also Contact Sales or Submit a Ticket for help.

Yes

No

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

7x24 Phone Support

Hong Kong, China

+852 800 906 020 (Toll Free)

United States

+1 844 606 0804 (Toll Free)

United Kingdom

+44 808 196 4551 (Toll Free)

Canada

+1 888 605 7930 (Toll Free)

Australia

+61 1300 986 386 (Toll Free)

EdgeOne hotline

+852 300 80699

More local hotlines coming soon