DataHub supports accessing different types of data generated by various data sources for unified management and distribution to downstream offline/online processing systems, forming a clear data flow channel.
This document takes DTS data as an example to describe how to create an async data pull task and modify the task configuration in the CKafka console.
2. Click Data Access on the left sidebar, select the region, and click Create Task.
3. In the pop-up window, select Asynchronously pulled data > DTS for Data Source Type.
4. Click Next and enter the task details.
Task Name: It can only contain letters, digits, underscores, or symbols ("-" and ".").
Target CKafka Instance: Select a CKafka instance.
Target Topic: Select the target CKafka topic for data delivery.
DTS Instance: Select a DTS instance. The partition count of the topics that are subscribed to in DTS must be set to the same as that of the target Kafka topics.
DTS Consumer Group: Select a DTS consumer group.
Consumer Group Account: DTS consumer group account.
Consumer Group Password: DTS consumer group password.
2. Click Data Access on the left sidebar and click the ID of the target task to enter its basic information page.
3. Select the Monitoring tab to view the monitoring data of the target topic.
Pausing task
On the Data Access page, click Pause in the Operation column of the target task to pause the task.
Note:
If you find that the data access task affects the normal use of CKafka, you can pause it.
Resuming task
On the Data Access page, click Resume in the Operation column of the target task to resume the paused task.
Note:
A paused task can be resumed to continue dumping data.
Deleting task
On the Data Access page, click Delete in the Operation column of the target task and click OK in the pop-up window to delete the task.
Note:
Once the task is deleted, data dumping will be stopped and the task record will be deleted, but the previously dumped data and CKafka instance involved will not be affected.
A task cannot be recovered once deleted. Proceed with caution.
Yes
No
Was this page helpful?