tencent cloud

All product documents
Cloud Log Service
DocumentationCloud Log ServiceOperation GuideShipping and Consumption Shipping to ESDumping to ES Through SCF
Dumping to ES Through SCF
Download PDF
Last updated: 2024-01-20 17:44:35
Dumping to ES Through SCF
Last updated: 2024-01-20 17:44:35
Download PDF

Overview

This document describes how to use SCF to dump CLS logs to ES. CLS is mainly used for log collection, and SCF mainly provides node computing capabilities. For the data processing flowchart, please see Function Processing Overview.

Directions

Creating an SCF function

1. Log in to the SCF console and select Function Service on the left sidebar.
2. At the top of the Function Service page, select the Beijing region and click Create to go to the function creating page and configure the following parameters:
Function name: enter CLSdemo.
Runtime environment: select Python 2.7.
Creation Method: select Function Template.
Fuzzy search: enter CLSToElasticsearch and search.
3. Click Learn More in the template to view relevant information in the Template Details pop-up window, which can be downloaded.
4. After configuring the basic information, click Next to go to the function configuration page.
5. Keep the default configuration and click Complete to complete the function creation.
Note:
You should select the same VPC and subnet of CLS for the created function on the Function Configuration page as shown below:

Configuring CLS triggers

On the log topic details page, select Function Processing and click Create. Add the created function in the Function Processing pop-up window. See the figure below:
The main parameter information is as follows. Use the default values for the remaining configuration items.
Namespace: select the function namespace.
Function Name: select the function created in the Creating SCF function step.
Alias: select a function alias.
Maximum waiting time: configure the longest waiting time for a single event pull. Default value: 60s.

Testing the function

1. Download the log file in the test sample, extract demo-scf1.txt, and import it to the source CLS service.
2. Switch to the SCF console to view the execution result. Select the Log Query tab on the function details page to view the printed log information.
3. Log in to the ES console to view the data dumping and processing result.
Note:
You can write specific data processing methods as needed.
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Contact Us
Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 available.

Submit a Ticket
7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon