Tencent Cloud

Recent Pages

CLS

Last updated: 2024-09-09 21:54:16

Overview
The CKafka Connector provides data distribution capabilities. You can distribute CKafka data to CLS for business troubleshooting, metric monitoring, security auditing, and other daily issues.
Prerequisites
Currently, this feature depends on the CLS service, and you should enable the relevant product features to use it.
Directions
1. Log in to the CKafka Console.
2. In the left sidebar, click  Connectors  >  Task List , select the right region, and then click  Create Task .
3. Fill in the task name, select  Data Distribution as the task type, select  Cloud Log Service(CLS) as the data target type, then Click  Next .
4. Configure data source information.
﻿
Topic Type: Select the data source Topic.
Elastic Topic: Select the pre-created elastic Topic. For details, see Topic Management.
CKafka Instance Topic: Select the instance and Topic created in CKafka. If the instance has ACL policies configured, ensure the selected topic has read and write permissions. For details, see Creating Topic.
Start Offset: Select how to handle historical messages during dump by setting the Topic offset.
5. After setting the above information, click Next , click  Preview Topic Message , and the first message from the  source topic will be obtained and parsed.
 Note
Currently, message parsing should meet the following requirements:
The message is a JSON string.
The source data should be in a single-layer JSON format. For nested JSON, you can useData Processing to perform simple message format conversion.
6. (Optional) Enable the  Process Source Data button for source data. For detailed configuration, please see Simple Data Processing.
7.  Click  Next to configure the data target information.
﻿
Source Data:  Click to Pull to fetch the source data. The data will be delivered after being parsed as JSON.
KEY: When the data in the source Topic is not in JSON format, you can specify a key to assemble it into JSON for delivery to CLS. The default is content.
Logset: Select a logset. A logset is a project management unit in CLS and is used to distinguish between logs from different projects.
Log Topic: Automatically create a log topic or select an existing one. A Log Set can contain multiple log topics, with each log topic corresponding to a type of application or service. It is recommended to collect similar logs from different machines into the same log topic.
Log Time: You can specify a field in the source data as the log time.
Role Authorization: To use CLS product features, you need to grant a third-party role the permissions to access the related products on your behalf.
8. Click  Submit . You can see the newly created task in the task list and view the task creation progress in the status bar.
﻿