- Product Introduction
- Purchase Guide
- Preparations
- Operation Guide
- Console Operation
- Project Management
- Data Integration
- Data Integration Overview
- Supported Data Sources and Read-Write Capability
- Integration resource configuration and management
- Real-time Synchronization Task Configuration and Operation and Maintenance
- Data Sources Supported by Real-time Synchronization
- Data Sources Overview
- Data Source List
- MySQL Data Source
- TDSQL-C MySQL Data Source
- Oracle Data Source
- PostgreSQL Data Source
- SQL Server Data Source
- Kafka Data Source
- DTS-Kafka Data Source
- Mongodb Data Source
- TDSQL MySQL Data Source
- OceanBase Data Source
- Dameng DM Data Source
- TiDB Data Source
- Doris Data Source
- StarRocks Data Source
- DLC Data Source
- Iceberg Data Source
- TCHouse-P Data Source
- ElasticSearch Data Source
- ClickHouse Data Source
- Greenplum Data Source
- Hive Data Source
- HBase Data Source
- TBase Data Source
- HDFS Data Source
- Whole Database Synchronization Task Configuration
- Single Table Synchronization Task Configuration
- Real-time synchronization operation and maintenance
- Data Sources Supported by Real-time Synchronization
- Offline Synchronization Task Configuration and Operation and Maintenance
- Data Sources Supported by Offline Synchronization
- Data Sources Overview
- Data Source List
- MySQL Data Source
- TDSQL-C MySQL Data Source
- Oracle Data Source
- SQL Server Data Source
- PostgreSQL Data Source
- TDSQL for PostgreSQL Data Source
- TDSQL MySQL Data Source
- DB2 Data Source
- DaMeng DM Data Source
- OceanBase Data Source
- SAP HANA Data Source
- SAP IQ(Sybase) Data Source
- Doris/TCHouse-D Data Source
- StarRocks Data Source
- DLC Data Source
- Iceberg Data Source
- TCHouse-P Data Source
- ClickHouse Data Source
- Greenplum Data Source
- Hive Data Source
- HDFS Data Source
- HBase Data Source
- TBase Data Source
- GBase Data Source
- GaussDB Data Source
- Impala Data Source
- Kudu Data Source
- FTP Data Source
- COS Data Source
- SFTP Data Source
- REST API Data Source
- Elasticsearch/Tencent Cloud Elasticsearch Data Source
- Mongo/TencentDB Mongo Data Source
- Redis Data Source
- Kafka/CKafka Data Source
- CTSDB InfluxDB Data Source
- TDMQ Pulsar Data Source
- DataInLong Offline Synchronization Configuration and Operation and Maintenance
- Data Development：Offline Synchronization, Configuration and Ops
- Conversion Node Configuration
- Time Parameter Description
- Advanced Parameters for Offline Node
- Data Sources Supported by Offline Synchronization
- Automatic Table Creation Capability of Synchronization Tasks
- FAQs
- Data Development
- Data Development Overview
- Engine User Guide
- Data Management
- Data Exploration
- Task Development
- Task Operation and Maintenance
- Appendix
- Data Assets
- Data Quality
- Data Security
- API Documentation
- History
- Introduction
- API Category
- Making API Requests
- Smart Ops Related Interfaces
- Data Development APIs
- DeleteProjectParamDs
- CreateWorkflowDs
- CreateTaskVersionDs
- RemoveWorkflowDs
- TriggerDsEvent
- DeleteTaskDs
- DescribeBatchOperateTask
- DeleteFilePath
- GetFileInfo
- FindAllFolder
- CreateTaskFolder
- MoveTasksToFolder
- DescribeDsFolderTree
- DeleteFile
- UploadContent
- SubmitSqlTask
- SubmitTaskTestRun
- DeleteResource
- DescribeResourceManagePathTrees
- CreateCustomFunction
- DeleteCustomFunction
- DescribeFunctionKinds
- DescribeFunctionTypes
- DescribeOrganizationalFunctions
- SaveCustomFunction
- SubmitCustomFunction
- CreateDsFolder
- DeleteDsFolder
- DescribeDsParentFolderTree
- ModifyDsFolder
- DeleteResourceFile
- DeleteResourceFiles
- Data Operations Related Interfaces
- Metadata Related Interfaces
- Task Operation and Maintenance APIs
- FreezeTasksByWorkflowIds
- DeleteWorkflowById
- DescribeDependTaskLists
- DescribeWorkflowExecuteById
- DescribeWorkflowTaskCount
- DescribeWorkflowListByProjectId
- DescribeWorkflowInfoById
- UpdateWorkflowOwner
- RunRerunScheduleInstances
- DescribeWorkflowCanvasInfo
- DescribeAllByFolderNew
- DescribeTaskRunHistory
- RunForceSucScheduleInstances
- KillScheduleInstances
- RunTasksByMultiWorkflow
- DescribeTaskByStatusReport
- DescribeStatisticInstanceStatusTrendOps
- DescribeOpsWorkflows
- DescribeSchedulerTaskTypeCnt
- BatchStopWorkflowsByIds
- DescribeInstanceByCycle
- DescribeTaskByCycleReport
- DescribeSchedulerInstanceStatus
- DescribeScheduleInstances
- CreateOpsMakePlan
- DescribeSchedulerTaskCntByStatus
- DescribeSchedulerRunTimeInstanceCntByStatus
- DescribeOpsMakePlanInstances
- DescribeOpsMakePlanTasks
- DescribeOpsMakePlans
- KillOpsMakePlanInstances
- BatchDeleteOpsTasks
- DescribeFolderWorkflowList
- DescribeTaskScript
- ModifyTaskInfo
- ModifyTaskLinks
- ModifyTaskScript
- ModifyWorkflowSchedule
- RegisterEvent
- RegisterEventListener
- SetTaskAlarmNew
- SubmitTask
- SubmitWorkflow
- TriggerEvent
- BatchModifyOpsOwners
- BatchStopOpsTasks
- CountOpsInstanceState
- DescribeDependOpsTasks
- DescribeOperateOpsTasks
- DescribeSuccessorOpsTaskInfos
- FreezeOpsTasks
- CreateTask
- ModifyWorkflowInfo
- Instance Operation and Maintenance Related Interfaces
- Data Map and Data Dictionary APIs
- Data Quality Related Interfaces
- CommitRuleGroupTask
- CreateRule
- CreateRuleTemplate
- DeleteRule
- DeleteRuleTemplate
- DescribeDataCheckStat
- DescribeDimensionScore
- DescribeExecStrategy
- DescribeQualityScore
- DescribeQualityScoreTrend
- DescribeRule
- DescribeRuleDimStat
- DescribeRuleExecDetail
- DescribeRuleExecLog
- DescribeRuleExecResults
- DescribeRuleExecStat
- DescribeRuleGroup
- DescribeRuleGroupExecResultsByPage
- DescribeRuleGroupSubscription
- DescribeRuleGroupTable
- DescribeRuleGroupsByPage
- DescribeRuleTemplate
- DescribeRuleTemplates
- DescribeRules
- DescribeRulesByPage
- DescribeTableQualityDetails
- DescribeTableScoreTrend
- DescribeTemplateDimCount
- DescribeTopTableStat
- DescribeTrendStat
- ModifyDimensionWeight
- ModifyExecStrategy
- ModifyMonitorStatus
- ModifyRule
- ModifyRuleGroupSubscription
- ModifyRuleTemplate
- DataInLong APIs
- BatchCreateIntegrationTaskAlarms
- BatchDeleteIntegrationTasks
- BatchForceSuccessIntegrationTaskInstances
- BatchKillIntegrationTaskInstances
- BatchMakeUpIntegrationTasks
- BatchRerunIntegrationTaskInstances
- BatchResumeIntegrationTasks
- BatchStartIntegrationTasks
- BatchStopIntegrationTasks
- BatchSuspendIntegrationTasks
- BatchUpdateIntegrationTasks
- CheckAlarmRegularNameExist
- CheckIntegrationNodeNameExists
- CheckIntegrationTaskNameExists
- CheckTaskNameExist
- CommitIntegrationTask
- CreateHiveTable
- CreateHiveTableByDDL
- CreateIntegrationNode
- CreateIntegrationTask
- CreateTaskAlarmRegular
- DeleteIntegrationNode
- DeleteIntegrationTask
- DeleteOfflineTask
- DeleteTaskAlarmRegular
- DescribeAlarmEvents
- DescribeAlarmReceiver
- DescribeInstanceLastLog
- DescribeInstanceList
- DescribeInstanceLog
- DescribeInstanceLogList
- DescribeIntegrationNode
- DescribeIntegrationStatistics
- DescribeIntegrationStatisticsInstanceTrend
- DescribeIntegrationStatisticsRecordsTrend
- DescribeIntegrationStatisticsTaskStatus
- DescribeIntegrationStatisticsTaskStatusTrend
- DescribeIntegrationTask
- DescribeIntegrationTasks
- DescribeIntegrationVersionNodesInfo
- DescribeOfflineTaskToken
- DescribeRealTimeTaskInstanceNodeInfo
- DescribeRealTimeTaskSpeed
- DescribeRuleTemplatesByPage
- DescribeStreamTaskLogList
- DescribeTaskAlarmRegulations
- DescribeTaskLockStatus
- DryRunDIOfflineTask
- GenHiveTableDDLSql
- GetIntegrationNodeColumnSchema
- GetOfflineDIInstanceList
- GetOfflineInstanceList
- LockIntegrationTask
- ModifyIntegrationNode
- ModifyIntegrationTask
- ModifyTaskAlarmRegular
- ModifyTaskName
- ResumeIntegrationTask
- RobAndLockIntegrationTask
- StartIntegrationTask
- StopIntegrationTask
- SuspendIntegrationTask
- TaskLog
- UnlockIntegrationTask
- CreateOfflineTask
- DescribeRealTimeTaskMetricOverview
- Platform management related APIs
- Data Source Management APIs
- Data Types
- Error Codes
- Service Level Agreements
- Related Agreement
- Contact Us
- Glossary
- Product Introduction
- Purchase Guide
- Preparations
- Operation Guide
- Console Operation
- Project Management
- Data Integration
- Data Integration Overview
- Supported Data Sources and Read-Write Capability
- Integration resource configuration and management
- Real-time Synchronization Task Configuration and Operation and Maintenance
- Data Sources Supported by Real-time Synchronization
- Data Sources Overview
- Data Source List
- MySQL Data Source
- TDSQL-C MySQL Data Source
- Oracle Data Source
- PostgreSQL Data Source
- SQL Server Data Source
- Kafka Data Source
- DTS-Kafka Data Source
- Mongodb Data Source
- TDSQL MySQL Data Source
- OceanBase Data Source
- Dameng DM Data Source
- TiDB Data Source
- Doris Data Source
- StarRocks Data Source
- DLC Data Source
- Iceberg Data Source
- TCHouse-P Data Source
- ElasticSearch Data Source
- ClickHouse Data Source
- Greenplum Data Source
- Hive Data Source
- HBase Data Source
- TBase Data Source
- HDFS Data Source
- Whole Database Synchronization Task Configuration
- Single Table Synchronization Task Configuration
- Real-time synchronization operation and maintenance
- Data Sources Supported by Real-time Synchronization
- Offline Synchronization Task Configuration and Operation and Maintenance
- Data Sources Supported by Offline Synchronization
- Data Sources Overview
- Data Source List
- MySQL Data Source
- TDSQL-C MySQL Data Source
- Oracle Data Source
- SQL Server Data Source
- PostgreSQL Data Source
- TDSQL for PostgreSQL Data Source
- TDSQL MySQL Data Source
- DB2 Data Source
- DaMeng DM Data Source
- OceanBase Data Source
- SAP HANA Data Source
- SAP IQ(Sybase) Data Source
- Doris/TCHouse-D Data Source
- StarRocks Data Source
- DLC Data Source
- Iceberg Data Source
- TCHouse-P Data Source
- ClickHouse Data Source
- Greenplum Data Source
- Hive Data Source
- HDFS Data Source
- HBase Data Source
- TBase Data Source
- GBase Data Source
- GaussDB Data Source
- Impala Data Source
- Kudu Data Source
- FTP Data Source
- COS Data Source
- SFTP Data Source
- REST API Data Source
- Elasticsearch/Tencent Cloud Elasticsearch Data Source
- Mongo/TencentDB Mongo Data Source
- Redis Data Source
- Kafka/CKafka Data Source
- CTSDB InfluxDB Data Source
- TDMQ Pulsar Data Source
- DataInLong Offline Synchronization Configuration and Operation and Maintenance
- Data Development：Offline Synchronization, Configuration and Ops
- Conversion Node Configuration
- Time Parameter Description
- Advanced Parameters for Offline Node
- Data Sources Supported by Offline Synchronization
- Automatic Table Creation Capability of Synchronization Tasks
- FAQs
- Data Development
- Data Development Overview
- Engine User Guide
- Data Management
- Data Exploration
- Task Development
- Task Operation and Maintenance
- Appendix
- Data Assets
- Data Quality
- Data Security
- API Documentation
- History
- Introduction
- API Category
- Making API Requests
- Smart Ops Related Interfaces
- Data Development APIs
- DeleteProjectParamDs
- CreateWorkflowDs
- CreateTaskVersionDs
- RemoveWorkflowDs
- TriggerDsEvent
- DeleteTaskDs
- DescribeBatchOperateTask
- DeleteFilePath
- GetFileInfo
- FindAllFolder
- CreateTaskFolder
- MoveTasksToFolder
- DescribeDsFolderTree
- DeleteFile
- UploadContent
- SubmitSqlTask
- SubmitTaskTestRun
- DeleteResource
- DescribeResourceManagePathTrees
- CreateCustomFunction
- DeleteCustomFunction
- DescribeFunctionKinds
- DescribeFunctionTypes
- DescribeOrganizationalFunctions
- SaveCustomFunction
- SubmitCustomFunction
- CreateDsFolder
- DeleteDsFolder
- DescribeDsParentFolderTree
- ModifyDsFolder
- DeleteResourceFile
- DeleteResourceFiles
- Data Operations Related Interfaces
- Metadata Related Interfaces
- Task Operation and Maintenance APIs
- FreezeTasksByWorkflowIds
- DeleteWorkflowById
- DescribeDependTaskLists
- DescribeWorkflowExecuteById
- DescribeWorkflowTaskCount
- DescribeWorkflowListByProjectId
- DescribeWorkflowInfoById
- UpdateWorkflowOwner
- RunRerunScheduleInstances
- DescribeWorkflowCanvasInfo
- DescribeAllByFolderNew
- DescribeTaskRunHistory
- RunForceSucScheduleInstances
- KillScheduleInstances
- RunTasksByMultiWorkflow
- DescribeTaskByStatusReport
- DescribeStatisticInstanceStatusTrendOps
- DescribeOpsWorkflows
- DescribeSchedulerTaskTypeCnt
- BatchStopWorkflowsByIds
- DescribeInstanceByCycle
- DescribeTaskByCycleReport
- DescribeSchedulerInstanceStatus
- DescribeScheduleInstances
- CreateOpsMakePlan
- DescribeSchedulerTaskCntByStatus
- DescribeSchedulerRunTimeInstanceCntByStatus
- DescribeOpsMakePlanInstances
- DescribeOpsMakePlanTasks
- DescribeOpsMakePlans
- KillOpsMakePlanInstances
- BatchDeleteOpsTasks
- DescribeFolderWorkflowList
- DescribeTaskScript
- ModifyTaskInfo
- ModifyTaskLinks
- ModifyTaskScript
- ModifyWorkflowSchedule
- RegisterEvent
- RegisterEventListener
- SetTaskAlarmNew
- SubmitTask
- SubmitWorkflow
- TriggerEvent
- BatchModifyOpsOwners
- BatchStopOpsTasks
- CountOpsInstanceState
- DescribeDependOpsTasks
- DescribeOperateOpsTasks
- DescribeSuccessorOpsTaskInfos
- FreezeOpsTasks
- CreateTask
- ModifyWorkflowInfo
- Instance Operation and Maintenance Related Interfaces
- Data Map and Data Dictionary APIs
- Data Quality Related Interfaces
- CommitRuleGroupTask
- CreateRule
- CreateRuleTemplate
- DeleteRule
- DeleteRuleTemplate
- DescribeDataCheckStat
- DescribeDimensionScore
- DescribeExecStrategy
- DescribeQualityScore
- DescribeQualityScoreTrend
- DescribeRule
- DescribeRuleDimStat
- DescribeRuleExecDetail
- DescribeRuleExecLog
- DescribeRuleExecResults
- DescribeRuleExecStat
- DescribeRuleGroup
- DescribeRuleGroupExecResultsByPage
- DescribeRuleGroupSubscription
- DescribeRuleGroupTable
- DescribeRuleGroupsByPage
- DescribeRuleTemplate
- DescribeRuleTemplates
- DescribeRules
- DescribeRulesByPage
- DescribeTableQualityDetails
- DescribeTableScoreTrend
- DescribeTemplateDimCount
- DescribeTopTableStat
- DescribeTrendStat
- ModifyDimensionWeight
- ModifyExecStrategy
- ModifyMonitorStatus
- ModifyRule
- ModifyRuleGroupSubscription
- ModifyRuleTemplate
- DataInLong APIs
- BatchCreateIntegrationTaskAlarms
- BatchDeleteIntegrationTasks
- BatchForceSuccessIntegrationTaskInstances
- BatchKillIntegrationTaskInstances
- BatchMakeUpIntegrationTasks
- BatchRerunIntegrationTaskInstances
- BatchResumeIntegrationTasks
- BatchStartIntegrationTasks
- BatchStopIntegrationTasks
- BatchSuspendIntegrationTasks
- BatchUpdateIntegrationTasks
- CheckAlarmRegularNameExist
- CheckIntegrationNodeNameExists
- CheckIntegrationTaskNameExists
- CheckTaskNameExist
- CommitIntegrationTask
- CreateHiveTable
- CreateHiveTableByDDL
- CreateIntegrationNode
- CreateIntegrationTask
- CreateTaskAlarmRegular
- DeleteIntegrationNode
- DeleteIntegrationTask
- DeleteOfflineTask
- DeleteTaskAlarmRegular
- DescribeAlarmEvents
- DescribeAlarmReceiver
- DescribeInstanceLastLog
- DescribeInstanceList
- DescribeInstanceLog
- DescribeInstanceLogList
- DescribeIntegrationNode
- DescribeIntegrationStatistics
- DescribeIntegrationStatisticsInstanceTrend
- DescribeIntegrationStatisticsRecordsTrend
- DescribeIntegrationStatisticsTaskStatus
- DescribeIntegrationStatisticsTaskStatusTrend
- DescribeIntegrationTask
- DescribeIntegrationTasks
- DescribeIntegrationVersionNodesInfo
- DescribeOfflineTaskToken
- DescribeRealTimeTaskInstanceNodeInfo
- DescribeRealTimeTaskSpeed
- DescribeRuleTemplatesByPage
- DescribeStreamTaskLogList
- DescribeTaskAlarmRegulations
- DescribeTaskLockStatus
- DryRunDIOfflineTask
- GenHiveTableDDLSql
- GetIntegrationNodeColumnSchema
- GetOfflineDIInstanceList
- GetOfflineInstanceList
- LockIntegrationTask
- ModifyIntegrationNode
- ModifyIntegrationTask
- ModifyTaskAlarmRegular
- ModifyTaskName
- ResumeIntegrationTask
- RobAndLockIntegrationTask
- StartIntegrationTask
- StopIntegrationTask
- SuspendIntegrationTask
- TaskLog
- UnlockIntegrationTask
- CreateOfflineTask
- DescribeRealTimeTaskMetricOverview
- Platform management related APIs
- Data Source Management APIs
- Data Types
- Error Codes
- Service Level Agreements
- Related Agreement
- Contact Us
- Glossary
Supported Data Sources and Read-Write Capability
Last updated: 2024-12-19 10:13:41
Data Integration includes offline and real-time data links. It currently supports various data sources such as relational databases, big data storage, semi-structured data, NoSQL, and message queues. You can select the corresponding feature module for synchronization task configuration based on the support availability of each module.
Data Source | | Offline Synchronization | | Real-time Synchronization | | | | | Version |
| | Offline Reading | Offline Writing | Single Table Reading | Single Table Writing | Whole Database Reading | Whole Database Writing | Log Collection | |
Relational Database | MySQL | ✓ | ✓ | ✓ | ✓ | ✓ | - | ✓ | 5.6，5.7，8.0.x |
| TDSQL-C MySQL | ✓ | ✓ | ✓ | ✓ | ✓ | - | ✓ | - |
| TDSQL MySQL | ✓ | ✓ | ✓ | ✓ | ✓ | - | ✓ | InnoDB Type |
| PostgreSQL | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | 9.6，10，11，12 |
| TDSQL PostgreSQL | ✓ | ✓ | - | - | - | - | - | 5.21.6 Row and Column Storage Fusion Edition |
| SQL Server | ✓ | ✓ | ✓ | ✓ | ✓ | - | ✓ | 2008，2008R2，2012，2014，2016，2017，2019 |
| Oracle | ✓ | ✓ | ✓ | ✓ | ✓ | - | ✓ | 11，12，19 |
| DB2 | ✓ | ✓ | - | - | - | - | - | - |
| SAP HANA | ✓ | ✓ | - | - | - | - | - | - |
| SAP IQ(Sybase) | ✓ | - | - | - | - | - | - | - |
| DM | ✓ | ✓ | ✓ | ✓ | - | - | - | 7,8 |
| OceanBase (Public Beta) | ✓ | ✓ | ✓ | - | ✓ | - | - | 3.1.4，4.2.1.3 |
| TCHouse-P | ✓ | ✓ | - | ✓ | - | ✓ | ✓ | - |
| Hive | ✓ | ✓ | - | ✓ | - | ✓ | ✓ | 1.x，2.x，3.x |
| DLC | ✓ | ✓ | - | ✓ | - | ✓ | ✓ | - |
| Doris | ✓ | ✓ | - | ✓ | - | ✓ | ✓ | 0.15、1.x |
| StarRocks | ✓ | ✓ | - | - | - | ✓ | - | - |
| ClickHouse | ✓ | ✓ | - | ✓ | - | - | ✓ | 20.7+ |
| Iceberg | ✓ | ✓ | - | ✓ | - | ✓ | ✓ | 0.13.1+ |
| HBase | ✓ | ✓ | - | ✓ | - | - | ✓ | 2.2.x |
| HDFS | ✓ | ✓ | - | ✓ | - | - | ✓ | 2.x，3.x |
| Kudu | ✓ | ✓ | - | - | - | - | - | - |
| TBase | ✓ | ✓ | - | ✓ | - | - | ✓ | - |
| GaussDB | ✓ | ✓ | - | - | - | - | - | - |
| GBase | ✓ | ✓ | - | - | - | - | - | - |
| Impala | ✓ | ✓ | - | - | - | - | - | - |
| Greenplum | ✓ | ✓ | - | ✓ | - | - | ✓ | 4.x，5.x，6.x |
Semi-structured | COS | ✓ | ✓ | - | - | - | - | - | - |
| Rest API | ✓ | - | - | - | - | - | - | - |
| FTP | ✓ | ✓ | - | - | - | - | - | - |
| SFTP | ✓ | ✓ | - | - | - | - | - | - |
NoSQL | Redis | - | ✓ | - | - | - | - | - | - |
| Elasticsearch | ✓ | ✓ | - | ✓ | - | - | ✓ | 6.x，7.x |
| CTSDB influxDB | ✓ | ✓ | - | - | - | - | - | - |
| Mongo | ✓ | ✓ | ✓ | - | ✓ | - | - | 4.x |
| Alibaba Graph Database | ✓ | ✓ | - | - | - | - | - | Supported only in Script Mode |
Cloud Message Queue | Kafka | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | 2.4.1, 2.7.1, 2.8.1, 2.8.2 (including Kafka and Ckafka types of data sources) |
| TDMQ Pulsar | - | ✓ | - | - | - | - | - | Virtual Cluster Edition |
| TiDB-Kafka | - | - | ✓ | - | - | - | - | - |
| DTS-kafka | - | - | ✓ | - | - | - | - | - |
Data Reporting | SDK | - | - | - | - | - | - | ✓ | - |
| TKE | - | - | - | - | - | - | ✓ | - |
| CVM | - | - | - | - | - | - | ✓ | - |
Note:
Data Link Read/Write End, must meet the corresponding data source versions.
Yes
No
Was this page helpful?