tencent cloud

All product documents
Data Lake Compute
Data Engine Monitoring
Last updated: 2024-07-31 17:31:18
Data Engine Monitoring
Last updated: 2024-07-31 17:31:18
Data Lake Compute (DLC) provides monitoring services for data engines based on the Tencent Cloud Observability Platform (TCOP), ensuring you can understand the real-time status of data engines and configure data alarms. For alarm configuration methods, see Monitoring Alarm Configuration.

Usage Notice

Before using the Data Lake Compute (DLC) monitoring service, you need to activate the TCOP service. If this service is not yet activated, you can use the root account to activate it. The use of the TCOP service may incur related charges. For detailed pricing information, see Billing Overview.

Monitoring Access

Access Point I: Data Lake Compute (DLC) Console

Note:
The account must have monitoring permissions for the data engine.
1. Log in to the DLC console and select the service region.
2. Navigate to the SuperSQL engine page from the left menu.
3. Viewing methods supported:
Method 1: Select the engine type to enter the matching engine monitoring list.
Method 2: Select the target engine from the engine list and click Monitoring to view the target engine monitoring.


Access Point Two: TCOP

1. Log in to the TCOP with an account that has the necessary permissions.
2. Select Cloud Product Monitoring from the left menu, find Data Lake Compute DLC, and choose the type of monitoring you need to view.

3. After selecting the monitoring type, you will enter the monitoring page. Select the corresponding region to view the monitoring resource information for that region.

4. Click the Engine ID to enter the detailed monitoring page.

Monitoring Granularity Configuration

You can configure the monitoring data time range, time granularity, and auto-update interval at the top of the monitoring page.

Monitoring data time range: Accurate to the minute, supports selecting data for a specific time period.
Time granularity: Interval between monitoring points, configurable to 1 minute or 5 minutes.
Auto-update data: Configures the automatic refresh interval for page data, with options to set it to off, 30 seconds, 5 minutes, 30 minutes, or 1 hour.

Monitoring Data Comparison

You can select a time period for data comparison. After selecting the comparison time range through one click, you can view the comparison data in the data compass below.


Monitoring Metrics

Monitoring Type
Monitoring Metrics
CPU
Maximum CPU utilization of all Driver nodes
Maximum CPU utilization of all Executor nodes
Average CPU utilization of all Driver nodes
Average CPU utilization of all Executor nodes
Maximum CPU utilization of all clusters
Average CPU utilization of all clusters
Memory
Maximum memory utilization of all Driver nodes
Maximum memory utilization of all Executor nodes
Average memory utilization of all Driver nodes
Average memory utilization of all Executor nodes
Maximum memory utilization of all clusters
Average memory utilization of all clusters
Tasks
Number of canceled tasks
Number of failed tasks
Number of initialized tasks
Average task initialization time
Maximum task initialization time
Number of queued tasks
Average task queue time
Maximum task queue time
Number of running tasks
Number of successful tasks
Network
Maximum inbound bandwidth of all Driver nodes network
Maximum inbound bandwidth of all Executor nodes network
Average inbound bandwidth of all Driver nodes network
Average inbound bandwidth of all Executor nodes network
Maximum outbound bandwidth of all Driver nodes network
Maximum outbound bandwidth of all Executor nodes network
Average outbound bandwidth of all Driver nodes network
Average outbound bandwidth of all Executor nodes network
Cloud Disk
Maximum cloud disk utilization of all Driver nodes
Maximum cloud disk utilization of all Executor nodes
Average cloud disk utilization of all Driver nodes
Average cloud disk utilization of all Executor nodes
CU
Job Engine CU Count
CU Utilization


Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon