Tencent Cloud

TCHouse-P Data Source

Last updated: 2024-11-01 17:50:37

Supported Editions
Currently supports TCHouse-P version 3.16.x
TCHouse-P Offline Single Table Read Node Configuration
﻿
﻿
﻿
Parameters
Description
Data Source
Select the configured TCHouse-P data source from the source side
Database
Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema
Supports selection or manual input of the Schema name to be read
Table
Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Split Key
Specify the field for data sharding. After specifying, concurrent tasks will be launched for data synchronization. You can use a column in the source data table as the partition key. It is recommended to use the primary key or indexed column as the partition key.
Filter Conditions (Optional)
Fill in the corresponding filter statement based on the data type. This statement will serve as the filter condition for the data to be synchronized.
TCHouse-P Offline Single Table Write Node Configuration
﻿
﻿
﻿
Parameters
Description
Data Destination
Select the configured TCHouse-P data source from the target side.
Database
Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema
Supports selection or manual input of the Schema name to be read.
Table
Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Whether to Clear Table
Before writing to this data table, you can manually choose whether to empty the data table.
Write Mode
append: If a primary key/unique index conflict occurs, the conflicting row cannot be written.
upsert: If there is no primary key/unique index conflict, a new row can be inserted; if there is a conflict, an update will be performed.
Batch Submission Size
The size of records for one-time batch submission can greatly reduce the number of network interactions between the data synchronization system and TCHouse-P, improving overall throughput. If this value is set too high, it may cause OOM exceptions in the data synchronization runtime process.
Pre-Executed SQL
SQL statements executed before the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.
Post-Executed SQL
SQL statements executed after the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.
Data type conversion support
The supported data types and corresponding conversion relationships for TCHouse-P reads are as follows (when handling TCHouse-P, the data types of the TCHouse-P data source and the data processing engine will be mapped first):
Read
TCHouse-P Data Source
Internal Types
smallint,integer,bigint,serial,bigserial
Long
double precision, money, numeric, real
Double
varchar(character varying), char(character)
String
date, time, timestamp
Date
bool(boolean)
Boolean
bytea
Bytes
Write
Internal Types
TCHouse-P Data Source
Long
smallint,integer,bigint
Double
double precision,numeric, real
String
varchar(character varying), char(character),bit,money
Date
date, time, timestamp
Boolean
bool
Bytes
bytea
﻿

tencent cloud

Recent Pages

TCHouse-P Data Source

Supported Editions

TCHouse-P Offline Single Table Read Node Configuration

TCHouse-P Offline Single Table Write Node Configuration

Data type conversion support

Read

Write

Was this page helpful?

Was this page helpful?

Parameters	Description
Data Source	Select the configured TCHouse-P data source from the source side
Database	Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema	Supports selection or manual input of the Schema name to be read
Table	Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Split Key	Specify the field for data sharding. After specifying, concurrent tasks will be launched for data synchronization. You can use a column in the source data table as the partition key. It is recommended to use the primary key or indexed column as the partition key.
Filter Conditions (Optional)	Fill in the corresponding filter statement based on the data type. This statement will serve as the filter condition for the data to be synchronized.

Parameters	Description
Data Destination	Select the configured TCHouse-P data source from the target side.
Database	Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema	Supports selection or manual input of the Schema name to be read.
Table	Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Whether to Clear Table	Before writing to this data table, you can manually choose whether to empty the data table.
Write Mode	append: If a primary key/unique index conflict occurs, the conflicting row cannot be written. upsert: If there is no primary key/unique index conflict, a new row can be inserted; if there is a conflict, an update will be performed.
Batch Submission Size	The size of records for one-time batch submission can greatly reduce the number of network interactions between the data synchronization system and TCHouse-P, improving overall throughput. If this value is set too high, it may cause OOM exceptions in the data synchronization runtime process.
Pre-Executed SQL	SQL statements executed before the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.
Post-Executed SQL	SQL statements executed after the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.

TCHouse-P Data Source	Internal Types
smallint,integer,bigint,serial,bigserial	Long
double precision, money, numeric, real	Double
varchar(character varying), char(character)	String
date, time, timestamp	Date
bool(boolean)	Boolean
bytea	Bytes

tencent cloud

Sign Up

Log in

Recent Pages

TCHouse-P Data Source

Supported Editions

TCHouse-P Offline Single Table Read Node Configuration

TCHouse-P Offline Single Table Write Node Configuration

Data type conversion support

Read

Write

Was this page helpful?

Was this page helpful?