CLS Function Processing Overview

Serverless Cloud Function

Release Notes and Announcements

Release Notes

Announcements

Layer Supporting Tag Management and Resource Authorization Upgrade Announcement

SCF Log Service Change Notification

Product Introduction

Purchase Guide

Billable Items and Billing Modes

Billable Items

Subscription Packages

Pay-As-You-Go (Postpaid)

Free Tier

SCF Pricing

Pricing

Provisioned Concurrency Price

Billing Example

Payment Overdue

Getting Started

Creating Event Function in Console

Creating Function with Serverless Cloud Framework

User Guide

Quota Management

Quota Limits

Exceeded Quota Management

Managing Functions

Query a Function Execution Log

Deleting a Function

Deploying Functions

Web Function Management

Function Overview

Creating and Testing Function

Bootstrap File Description

Trigger Management

HTTP-Triggered Function Billing

Deploying Web Function on Command Line

WebSocket Protocol Support

HTTP-Triggered Function Request Concurrency Management

Log Management

Log Search Guide

Log Delivery Configuration

Log Delivery Configuration (Legacy)

Concurrence Management

Concurrency Overview

Concurrency Management System

Provisioned Concurrency

Scheduled Provisioned Concurrency

Dynamic Provisioned Concurrency Metric

Concurrency Overrun

Trigger Management

Creating a Trigger

Deleting Triggers

Enabling/Disabling Triggers

A Custom Domain Name

Configuring a Custom Domain Name

Version Management

Alias Management

Traffic Routing Configuration

Using Alias to Implement SCF Grayscale Release

Permission Management

Permission Management Overview

Role and Authorization

SCF Policy Syntax

Sub-users and Authorization

Users and Permissions

Creating a Sub-user and Granting It All Permissions of SCF

Creating a Sub-user and Granting It Permissions to Operate Certain Functions

Managing Monitors and Alarms

Descriptions of monitoring metrics

Configuring Alarms

Viewing Execution Logs

Network Configuration

Network Configuration Management

Fixed Public Outbound IP

VPC Communication

Granting a Function in VPC Access to Public Network

Layer Management

Overview

Creating Layer

Binding function to layer

Using layer

Execution Configuration

Async Execution

Status Trace

Async Event Management

Extended Storage Management

Mounting CFS File System

DNS Caching Configuration

Resource Managed Mode Management

Triggers

Trigger Overview

Trigger Event Message Structure Summary

API Gateway Trigger

Overview

Websocket

How It Works

Usage

COS Trigger

COS Trigger Description

Usage

CLS Trigger

CLS Trigger Description

Usage

Timer Trigger

Timer Trigger Description

Usage

CKafka Trigger

CKafka Trigger Description

Usage

Apache Kafka Trigger

Apache Kafka Trigger Description

Usage

Trigger Configuration Description

MPS Trigger

CLB Trigger Description

TencentCloud API Trigger

Development Guide

Basic Concepts

Testing a Function

Environment Variables

Dependency Installation

Using Container Image

Error Types and Retry Policies

Dead Letter Queue

Connecting SCF to Database

Automated Deployment

Cloud Function Status Code

Common Errors and Solutions

Developer Tools

Serverless Web IDE

Serverless Cloud Framework

Overview

Installation

Permission Management

Function Operations

Development Debugging

Project Application

List of Supported Commands

Account and Permission Configuration

Creating and Deploying Function

Calling SDK Across Functions

Node.js SDK

SDK for Python

Third-Party Tools

Malagu Framework

Accessing Database

Getting Started

Overview

Code Development

Web Framework Development

Deploying Framework on Command Line

Quickly Deploying Egg Framework

Quickly Deploying Express Framework

Quickly Deploying Flask Framework

Quickly Deploying Koa Framework

Quickly Deploying Laravel Framework

Quickly Deploying Nest.js Framework

Quickly Deploying Next.js Framework

Quickly Deploying Nuxt.js Framework

Quickly Deploying Django Framework

Practical Tutorial

Overview

Solutions with Tencent Cloud Services

Business Development

Function Concurrency Management Practice

Concurrent High-Performance Architecture

Using Custom Font in SCF

Implementing Todo Application with Spring Boot and SCF

ServerlessFramework Practices

Framework Migration

API Gateway

Using API Gateway to Provide API Service

Example

Step 1. Create blogArticle Function

Step 2. Create and Test API Service

Step 3. Publish API Service and Verify Online

Serverless Multi-File Upload Processing

Implementing Custom Invitation with SCF + API Gateway

TRTC Practices

Using SCF to Input Online Media Streams for SCF +TRTC

SCF + TRTC for Stream Single Recording

SCF + TRTC for Stream Mix Recording

COS Practices

Audio/Video Transcoding

Acquire Image on COS and Create a Thumbnail

Example illustration

Step 1. Prepare COS Bucket

Step 2. Create and Test Thumbnail Function

Forming Data Lake with SCF + COS

Implementing Custom Calculation of File Hash Value with SCF + COS

Implementing Custom Transcoding with SCF + COS

MapReduce Method that Uses WordCount as an Example

Example

Step 1: Prepare a COS Bucket

Step 2. Create Mapper and Reducer Functions

Step 3. Test Function

CKafka Practice

Dumping CKafka Data to ES

SCF + CKafka for Message Dump to TencentDB for MySQL

SCF + CKafka for Message Dump to CKafka

CLS

CLS Function Processing Overview

Log ETL

SCF +CLS Dump to CKafka

SCF +CLS Dump to COS

Dumping Logs to ES with SCF + CLS

CLB Practice

Using SCF and CLB to Quickly Deploy Web Service

MPS

MPS Function Processing Overview

Video Task Callback Backup to COS

Video Task Callback Notification Tool

CDN

SCF + CDN for Scheduled Prefetch/Purge

CDWPG

SCF + CDWPG for CKafka Data Import

VOD

SCF + VOD for Event Notification Receipt

SMS

SCF + SMS for SMS Verification Code

SCF + ES for Quick Search Service

Scheduled Task

Scheduled Task Overview

Performing Scheduled Task

Video Processing

Implementing Batch Automated Video Editing with SCF and FFmpeg

Success Stories

Tencent Online Education

Online Video Industry

Audio/Video Transcoding Best Practices

Tencent Online Education

Best Practice of Tencent IEG Going Global

API Documentation

Making API Requests

Trigger APIs

Function APIs

Namespace APIs

Layer Management APIs

Async Event Management APIs

Other APIs

Function and Layer Status Description

FAQs

API Gateway Trigger FAQs

Related Agreement

Service Level Agreement

Glossary

DocumentationServerless Cloud FunctionPractical TutorialCLSCLS Function Processing Overview

CLS Function Processing Overview

Download PDF

Last updated: 2024-12-02 16:35:34

CLS Function Processing Overview

Last updated: 2024-12-02 16:35:34

Download PDF

Through the function processing service, you can quickly complete complex log processing tasks such as execution log collection, ETL (extraction-transformation-loading), and message dumping for various Tencent Cloud services like CVM. Function processing is an async process. All data collected into CLS can be delivered to SCF for consumption and processing through configurations. You only need to complete simple configurations in the CLS console to connect CLS to SCF.
The source log data can be submitted to SCF through a CLS trigger, and then data processing and analysis, event triggering, and auto scaling can be implemented through function computing of Serverless Framework. The entire workflow requires no OPS and is pay-as-you-go as shown below:
﻿
﻿
Advantages of Function Processing
Data can be collected, stored, processed, analyzed, and displayed in a one-stop manner.
Log processing tasks are fully managed and can be triggered regularly and retried automatically.
More and more built-in function templates are added to reduce the development costs for log processing in popular use cases.
Data processing logic and custom code logic are provided based on SCF.
Computing power is provided based on SCF, with features such as auto scaling, OPS-free usage, and pay-as-you-go billing.
Multi-scenario Function Processing Practices
CLS can send data in a log topic to SCF for processing through a CLS trigger to satisfy the needs of various use cases such as log processing and log cleansing, as detailed below:
Function Processing Scenario
Description
Log ETL
Log data is cleansed, processed, or transformed through SCF
CLS data dump to CKafka
Log data is cleansed and delivered to CKafka through SCF
CLS data dump to COS
Log data is cleansed and delivered to COS through SCF
CLS data dump to ES
Log data is delivered to ES through SCF
Note: 
Data is delivered to SCF, which incurs corresponding computation fees. For billing details, please see Billing Overview.

Was this page helpful?

You can also Contact Sales or Submit a Ticket for help.

Yes

Function Processing Scenario	Description
Log ETL	Log data is cleansed, processed, or transformed through SCF
CLS data dump to CKafka	Log data is cleansed and delivered to CKafka through SCF
CLS data dump to COS	Log data is cleansed and delivered to COS through SCF
CLS data dump to ES	Log data is delivered to ES through SCF

tencent cloud

New User Offers

Next-Generation CDN：EdgeOne

Elasticsearch Service Special Offers

Free Tier

Tencent Cloud Startup Program

Special Offers

Cloud Object Storage Special Offers

Featured Products

New Products

Education

Tencent Cloud Online Education Solutions

Gaming

Gaming Solution

Game Media Solutions

Financial Services

Financial Services Solution

Audio & Video

Audio/Video Solution

LVB Recording Solution

Interactive Classroom Solution

Interactive Live Streaming Solution

Audio Chat Social Networking Solution

Real Estate

Tencent Cloud LinkBase(Weiling)

E-commerce

E-commerce retail solutions

Compute

Cloud Virtual Machine

Auto Scaling

Batch Compute

CVM Dedicated Host

Database

TencentDB for MySQL

TencentDB for Redis®

TencentDB for CTSDB

TDSQL for MySQL

Data Transfer Service

TencentDB for MongoDB

TencentDB for PostgreSQL

TencentDB for SQL Server

TencentDB for TcaplusDB

Video Service

Cloud Streaming Services

Video on Demand

Media Processing Service

Cloud Application Rendering

Cloud Contact Center

Game Multimedia Engine

Chat

Real-time Communication

Tencent Effect SDK

AI and Machine Learning

Image Creation Large Model

Face Fusion

eKYC

Optical Character Recognition

TencentCloud TI Platform

Video Creation Large Model

Industry Applications

Tencent HealthCare Omics Platform

Container and Middleware

TDMQ for CKafka

Serverless Cloud Function

Tencent Kubernetes Engine

Tencent Kubernetes Engine for Serverless

Networking

Cloud Load Balancer

Virtual Private Cloud

Direct Connect

Cloud Connect Network

NAT Gateway

VPN Connection

Bandwidth Package

Anycast Internet Acceleration

Elastic Network Interface

Flow Logs

Global Application Acceleration Platform

Security

Captcha