tencent cloud

PrevNext

Feedback

search by keyword

Recent Pages

Documentation
Tencent Cloud WeData
    Documentation
    Download PDF

    Mongodb Data Source

    Last updated: 2024-11-01 17:00:28
    Download PDF

      Mongodb Data Source Version Limitation

      Supported Mongo Version Details:
      Node
      Edition
      MongoDB-CDC
      MongoDB>=3.6

      Mongodb Single Table Reading Node Configuration

      Mongodb Read Configuration Parameters Description

      1. On the DataInLong page, in the left sidebar, click Real-time Sync.
      2. At the top of the Real-time Sync page, select Single Table Sync to create a new one (you can choose between form and canvas modes) and enter the configuration page.
      3. Click the left Read, click Select Mongo Node and configure node information.
      
      
      
      4. Parameter description:
      Parameters
      Description
      Type
      Select Mongodb
      Data Source
      Select the available Mongo Data Source for the project
      Database
      Supports selecting or manually entering the database name to be read
      By default, the database bound to the data source is used as the default database. Other databases need to be manually entered.
      If the data source network is not connected and the database information cannot be fetched directly, you can manually enter the database name. Data synchronization can still be performed when the DataInLong network is connected.
      Collection
      Supports selecting or manually entering the collection name to be read
      Read Mode
      Full + Increment: Data synchronization is divided into full and increment phases. After the full phase is completed, the task enters the increment phase. The full phase will synchronize historical data in the database, and the incremental phase starts synchronizing from the binlog cdc location after the task starts.
      Incremental: Synchronize data only from the binlog CDC checkpoint after the task starts.
      Time Zone
      Set the time zone for log timestamps, with Shanghai as the default.
      Advanced Settings (optional)
      You can configure parameters according to business needs.
      5. Preview Data Fields, click Save.

      Mongodb Whole Database Source Configuration

      Mongodb Read Configuration Parameters Description

      
      
      
      Parameters
      Description
      Data Source
      Select the Mongo Data Source to be synchronized.
      Source Table
      According to business needs, select "All Databases, Collections", "Specified Table", "Specified Database":
      All Databases, collections: Monitor all databases under the data source. Any new databases or tables added during the task run will be synchronized to the target end by default.
      Specified Collection: Only synchronize the specified collection.
      Specified Database: Monitor the specified database, synchronize all tables or tables that meet the criteria under the database.
      Read Mode
      Full + Incremental, Incremental.
      Filter Operations
      Provide various filtering operations, including Insert, Update, Delete, Delete collection, Delete database, Rename collection. After setting, data of the specified operation type will not be synchronized.

      Data type conversion support

      Read

      The supported data types and their conversion relationships for MongoDB Reads are as follows:
      BSON Types
      Internal Types
      -
      TINYINT
      -
      SMALLINT
      Int
      INT
      Long
      BIGINT
      -
      FLOAT
      Double
      DOUBLE
      Decimal128
      DECIMAL(p, s)
      Boolean
      BOOLEAN
      Date Timestamp
      DATE
      Date Timestamp
      TIME
      Date
      TIMESTAMP(3) TIMESTAMP_LTZ(3)
      Timestamp
      TIMESTAMP(0) TIMESTAMP_LTZ(0)
      String,ObjectId,UUID ,Symbol ,MD5 ,JavaScript,Regex
      STRING
      BinData
      BYTES
      Object
      ROW
      Array
      ARRAY
      DBPointer
      ROW&ltSTRING, STRING>
      
      Contact Us

      Contact our sales team or business advisors to help your business.

      Contact Us
      Technical Support

      Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

      Submit a Ticket
      7x24 Phone Support
      Copyright © 2013-2024 Tencent Cloud. All Rights Reserved.
      Privacy PolicyLegalCookie Policy