TDSQL for PostgreSQL Data Source

TDSQL for PostgreSQL Offline Single Table Read Node Configuration
﻿
﻿
﻿
Parameters
Description
Data Source
Select the configured TDSQL for PostgreSQL data source for the source end.
Database
Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema
Supports selection or manual input of the Schema name to be read.
Table
Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Split Key
Specify the field for data sharding. After specifying, concurrent tasks will be launched for data synchronization. You can use a column in the source data table as the partition key. It is recommended to use the primary key or indexed column as the partition key.
Filter Conditions (Optional)
Fill in the corresponding filter statement based on the data type. This statement will serve as the filter condition for the data to be synchronized.
TDSQL for PostgreSQL Offline Single Table Write Node Configuration
﻿
﻿
﻿
Parameters
Description
Data Destination
Select the configured TDSQL for PostgreSQL data source for the target end.
Database
Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema
Supports selection or manual input of the Schema name to be read
Table
Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Whether to Clear Table
You can manually choose whether to clear the data table before writing to the TDSQL for PostgreSQL data table.
Batch Submission Size
The size of the batch of records submitted at one time can greatly reduce the number of network interactions between the Data Synchronization System and TDSQL for PostgreSQL and improve overall throughput. If this value is set too large, it may cause the data synchronization running process to encounter OOM exceptions.
Pre-Executed SQL
SQL statements executed before the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.
Post-Executed SQL
SQL statements executed after the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.
Data type conversion support
The supported data types and corresponding transformations for TDSQL for PostgreSQL read are as follows (when processing TDSQL for PostgreSQL, the data types of the TDSQL for PostgreSQL data source and the data processing engine will be mapped first):
Read
TDSQL for PostgreSQL Data Type
Internal Types
smallint,integer,bigint,serial,bigserial
Long
double precision, money, numeric, real
Double
varchar(character varying), char(character)
String
date, time, timestamp
Date
bool(boolean)
Boolean
bytea
Bytes
Write
Internal Types
TDSQL for PostgreSQL Data Type
Long
smallint,integer,bigint
Double
double precision,numeric, real
String
varchar(character varying), char(character),bit,money
Date
date, time, timestamp
Boolean
bool
Bytes
bytea
﻿

Was this page helpful?

You can also Contact Sales or Submit a Ticket for help.

Yes

Parameters	Description
Data Source	Select the configured TDSQL for PostgreSQL data source for the source end.
Database	Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema	Supports selection or manual input of the Schema name to be read.
Table	Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Split Key	Specify the field for data sharding. After specifying, concurrent tasks will be launched for data synchronization. You can use a column in the source data table as the partition key. It is recommended to use the primary key or indexed column as the partition key.
Filter Conditions (Optional)	Fill in the corresponding filter statement based on the data type. This statement will serve as the filter condition for the data to be synchronized.

Parameters	Description
Data Destination	Select the configured TDSQL for PostgreSQL data source for the target end.
Database	Supports selecting or manually entering the library name to be read. By default, the database bound to the data source is used as the default library. For other databases, you need to manually enter the library name. If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the Data Integration network is connected.
Schema	Supports selection or manual input of the Schema name to be read
Table	Supports selecting or manually entering the table name to be read. If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Whether to Clear Table	You can manually choose whether to clear the data table before writing to the TDSQL for PostgreSQL data table.
Batch Submission Size	The size of the batch of records submitted at one time can greatly reduce the number of network interactions between the Data Synchronization System and TDSQL for PostgreSQL and improve overall throughput. If this value is set too large, it may cause the data synchronization running process to encounter OOM exceptions.
Pre-Executed SQL	SQL statements executed before the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.
Post-Executed SQL	SQL statements executed after the synchronization task. Fill in the SQL according to the correct SQL syntax corresponding to the data source type.

TDSQL for PostgreSQL Data Type	Internal Types
smallint,integer,bigint,serial,bigserial	Long
double precision, money, numeric, real	Double
varchar(character varying), char(character)	String
date, time, timestamp	Date
bool(boolean)	Boolean
bytea	Bytes

tencent cloud

New User Offers

Next-Generation CDN：EdgeOne

Elasticsearch Service free trial

Free Tier

Tencent Cloud Startup Program

Special Offers

Lighthouse Special Offers

Cloud Object Storage Special Offers

Featured Products

New Products

Education

Tencent Cloud Online Education Solutions

Gaming

Gaming Solution

Game Media Solutions

E-commerce

E-commerce retail solutions

Audio & Video

Audio/Video Solution

LVB Recording Solution

Interactive Classroom Solution

Interactive Live Streaming Solution

Audio Chat Social Networking Solution

Financial Services

Financial Services Solution

Compute

Cloud Virtual Machine

Auto Scaling

Batch Compute

CVM Dedicated Host

Database

TencentDB for MySQL

TencentDB for Redis®

TencentDB for CTSDB

TDSQL for MySQL

Data Transfer Service

TencentDB for MongoDB

TencentDB for PostgreSQL

TencentDB for SQL Server

Video Service

Cloud Streaming Services

Video on Demand

Media Processing Service

Cloud Application Rendering

Cloud Contact Center

Game Multimedia Engine

Chat

Real-time Communication

Tencent Effect SDK

AI and Machine Learning

Image Creation Large Model

Face Fusion

eKYC

Optical Character Recognition

Video Creation Large Model

Industry Applications

Tencent HealthCare Omics Platform

Container and Middleware

TDMQ for CKafka

Serverless Cloud Function

Tencent Kubernetes Engine

Tencent Kubernetes Engine for Serverless

Networking

Cloud Load Balancer

Virtual Private Cloud

Direct Connect

Cloud Connect Network

NAT Gateway

VPN Connection

Bandwidth Package

Anycast Internet Acceleration

Elastic Network Interface

Flow Logs

Global Application Acceleration Platform

Security

Captcha

Cloud Workload Protection Platform

Data Security Governance Center

Key Management Service