Tencent Cloud

Recent Pages

TiDB Data Source

Last updated: 2024-11-01 17:00:28

TiDB real-time single-table read node configuration
1. On the Data Integration page, in the left sidebar, click Real-time Sync.
2. At the top of the Real-time Sync page, select Single Table Sync to create a new one (you can choose between form and canvas modes) and enter the configuration page.
3. click the left side to read, click to select TiDB  node and configure node information.
﻿
﻿
﻿
4. You can refer to the table below for parameter configuration:
Parameters
Description
Type
TiDB
Data Source
Select the TiDB data source where the table to be synchronized is located
TiDB Database
Select TiDB database
TiDB Table
Select TiDB table
Read Mode
Supports full and incremental read modes
Data Source
Select the Kafka data source where the table to be synchronized is located
topic
Topic in Kafka data source
Serialization Format
Kafka message serialization format type
Message Types
append messages: Messages in Kafka come from append message stream, usually without a unique key. It is recommended to use the append write mode for the write node
upsert messages: Messages in Kafka come from the upsert message stream, usually with a unique key. Once set, messages can ensure Exactly-Once delivery. It is recommended to use the upsert write mode for the write node
Unique Key
In Upsert Write Mode, you need to set a unique key to ensure data order
Consumer Group ID
Please avoid this parameter conflicting with other consumer processes to ensure the correctness of the consumption offsets. If this parameter is not specified, the default is set to group.id=WeData_group_＄{task_id}
Advanced Settings
You can configure parameters according to business needs.
5. Preview Data Fields, click Save.

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

7x24 Phone Support

tencent cloud

Recent Pages

TiDB Data Source

TiDB real-time single-table read node configuration

Was this page helpful?

Was this page helpful?

Parameters	Description
Type	TiDB
Data Source	Select the TiDB data source where the table to be synchronized is located
TiDB Database	Select TiDB database
TiDB Table	Select TiDB table
Read Mode	Supports full and incremental read modes
Data Source	Select the Kafka data source where the table to be synchronized is located
topic	Topic in Kafka data source
Serialization Format	Kafka message serialization format type
Message Types	append messages: Messages in Kafka come from append message stream, usually without a unique key. It is recommended to use the append write mode for the write node upsert messages: Messages in Kafka come from the upsert message stream, usually with a unique key. Once set, messages can ensure Exactly-Once delivery. It is recommended to use the upsert write mode for the write node
Unique Key	In Upsert Write Mode, you need to set a unique key to ensure data order
Consumer Group ID	Please avoid this parameter conflicting with other consumer processes to ensure the correctness of the consumption offsets. If this parameter is not specified, the default is set to group.id=WeData_group_＄{task_id}
Advanced Settings	You can configure parameters according to business needs.

tencent cloud

Sign Up

Log in

Recent Pages

TiDB Data Source

TiDB real-time single-table read node configuration

Was this page helpful?

Was this page helpful?