tencent cloud

All product documents
Tencent Cloud WeData
DocumentationTencent Cloud WeDataOperation GuideData IntegrationReal-time Synchronization Task Configuration and Operation and MaintenanceData Sources Supported by Real-time SynchronizationData Source ListMongodb Data Source
Mongodb Data Source
Download PDF
Last updated: 2024-11-01 17:00:28
Mongodb Data Source
Last updated: 2024-11-01 17:00:28
Download PDF

Mongodb Data Source Version Limitation

Supported Mongo Version Details:
Node
Edition
MongoDB-CDC
MongoDB>=3.6

Mongodb Single Table Reading Node Configuration

Mongodb Read Configuration Parameters Description

1. On the DataInLong page, in the left sidebar, click Real-time Sync.
2. At the top of the Real-time Sync page, select Single Table Sync to create a new one (you can choose between form and canvas modes) and enter the configuration page.
3. Click the left Read, click Select Mongo Node and configure node information.



4. Parameter description:
Parameters
Description
Type
Select Mongodb
Data Source
Select the available Mongo Data Source for the project
Database
Supports selecting or manually entering the database name to be read
By default, the database bound to the data source is used as the default database. Other databases need to be manually entered.
If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the DataInLong network is connected.
Collection
Supports selecting or manually entering the collection name to be read
Read Mode
Full + Increment: Data synchronization is divided into full and increment phases. After the full phase is completed, the task enters the increment phase. The full phase will synchronize historical data in the database, and the incremental phase starts synchronizing from the binlog cdc location after the task starts.
Incremental: Synchronize data only from the binlog CDC checkpoint after the task starts.
Time Zone
Set the time zone for log timestamps, with Shanghai as the default.
Advanced Settings (optional)
You can configure parameters according to business needs.
5. Preview Data Fields, click Save.

Mongodb Whole Database Source Configuration

Mongodb Read Configuration Parameters Description




Parameters
Description
Data Source
Select the Mongo Data Source to be synchronized.
Source Table
According to business needs, select "All Databases, Collections", "Specified Table", "Specified Database":
All Databases, collections: Monitor all databases under the data source. Any new databases or tables added during the task run will be synchronized to the target end by default.
Specified Collection: Only synchronize the specified collection.
Specified Database: Monitor the specified database, synchronize all tables or tables that meet the criteria under the database.
Read Mode
Full + Incremental, Incremental.
Filter Operations
Provide various filtering operations, including Insert, Update, Delete, Delete collection, Delete database, Rename collection. After setting, data of the specified operation type will not be synchronized.

Data type conversion support

Read

The supported data types and their conversion relationships for MongoDB Reads are as follows:
BSON Types
Internal Types
-
TINYINT
-
SMALLINT
Int
INT
Long
BIGINT
-
FLOAT
Double
DOUBLE
Decimal128
DECIMAL(p, s)
Boolean
BOOLEAN
Date Timestamp
DATE
Date Timestamp
TIME
Date
TIMESTAMP(3) TIMESTAMP_LTZ(3)
Timestamp
TIMESTAMP(0) TIMESTAMP_LTZ(0)
String,ObjectId,UUID ,Symbol ,MD5 ,JavaScript,Regex
STRING
BinData
BYTES
Object
ROW
Array
ARRAY
DBPointer
ROW&ltSTRING, STRING>

Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Contact Us
Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

Submit a Ticket
7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon