tencent cloud

All product documents
Elastic MapReduce
DocumentationElastic MapReduce EMR on CVM Operation GuideMonitoring and AlarmsMonitoring MetricsDoris Monitoring Metrics
Doris Monitoring Metrics
Download PDF
Last updated: 2023-12-27 14:54:08
Doris Monitoring Metrics
Last updated: 2023-12-27 14:54:08
Download PDF

Doris - FE

Title
Metric
Unit
Description
Node information
FeNodeNum
count
Total number of FE nodes
BeAliveNum
count
Number of alive BE nodes
BkDeadNum
count
Number of dead broker nodes
Connections
Num
count
Number of FE node JVM connections
JVM threads
Total
count
Total number of threads in the JVM of the FE node, including daemon threads and non-daemon threads
Peak
count
Peak number of threads in the JVM of the FE node
GC count
YoungGC
count
FE node JVM Young GC count
OldGC
count
FE node JVM Old GC count
GC time
YoungGC
s
FE node JVM Young GC time
OldGC
s
FE node JVM Old GC time
FE query latency
Quantile75
ms
75th percentile of the FE query latency
Quantile95
ms
95th percentile of the FE query latency
Quantile99
ms
99th percentile of the FE query latency
Quantile999
ms
99.9th percentile of the FE query latency
Maximum compaction score of tablet
MAX
score
Maximum compaction score of FE tablet
Scheduled tablets
ScheduledTablet
count
Number of scheduled tablets in FE
Request response
QPS
count
Number of queries per second
RPS
count
Number of requests that can be processed per second
Query failure rate
ErrRate
%
Query error rate
Cache query
SqlModelHitQuery
count
Number of queries that hit the SQL model
PartitionModelHitQuery
count
Number of queries that hit the partition model
SqlModelQuery
count
Number of queries in the SQL cache model
PartitionModelQuery
count
Number of queries in the partition cache model
CachePartitionHit
count
Number of partitions that hit the cache in the query
CachePartitionScan
count
Number of all partitions scanned in the query
Routine load rows
TotalRows
count
Number of FE routine load rows
ErrorRows
count
Number of FE routine load error rows
Transaction status statistics
Reject
count
Number of rejected transactions on FE
Begin
count
Number of transactions that have begun on FE
Success
count
Number of successful transactions on FE
Failed
count
Number of failed transactions on FE
Images
Write
count
Number of image writes on FE
Push
count
Number of image pushes on FE
ALTER job statistics
RollupRunning
count
Number of running alter jobs of ROLLUP type
SchemaChangeRunning
count
Number of running alter jobs of SCHEMA_CHANGE type
UNKNOWN load job statistics
UNKNOWN
count
Number of load jobs of UNKNOWN type in UNKNOWN status
PENDING
count
Number of load jobs of UNKNOWN type in PENDING status
ETL
count
Number of load jobs of UNKNOWN type in ETL status
LOADING
count
Number of load jobs of UNKNOWN type in LOADING status
COMMITTED
count
Number of load jobs of UNKNOWN type in COMMITTED status
FINISHED
count
Number of load jobs of UNKNOWN type in FINISHED status
CANCELLED
count
Number of load jobs of UNKNOWN type in CANCELLED status
SPARK load job statistics
UNKNOWN
count
Number of load jobs of SPARK type in UNKNOWN status
PENDING
count
Number of load jobs of SPARK type in PENDING status
ETL
count
Number of load jobs of SPARK type in ETL status
LOADING
count
Number of load jobs of SPARK type in LOADING status
COMMITTED
count
Number of load jobs of SPARK type in COMMITTED status
FINISHED
count
Number of load jobs of SPARK type in FINISHED status
CANCELLED
count
Number of load jobs of SPARK type in CANCELLED status
DELETE load job statistics
UNKNOWN
count
Number of load jobs of DELETE type in UNKNOWN status
PENDING
count
Number of load jobs of DELETE type in PENDING status
ETL
count
Number of load jobs of DELETE type in ETL status
LOADING
count
Number of load jobs of DELETE type in LOADING status
COMMITTED
count
Number of load jobs of DELETE type in COMMITTED status
FINISHED
count
Number of load jobs of DELETE type in FINISHED status
CANCELLED
count
Number of load jobs of DELETE type in CANCELLED status
INSERT load job statistics
UNKNOWN
count
Number of load jobs of INSERT type in UNKNOWN status
PENDING
count
Number of load jobs of INSERT type in PENDING status
ETL
count
Number of load jobs of INSERT type in ETL status
LOADING
count
Number of load jobs of INSERT type in LOADING status
COMMITTED
count
Number of load jobs of INSERT type in COMMITTED status
FINISHED
count
Number of load jobs of INSERT type in FINISHED status
CANCELLED
count
Number of load jobs of INSERT type in CANCELLED status
BROKER load job statistics
UNKNOWN
count
Number of load jobs of BROKER type in UNKNOWN status
PENDING
count
Number of load jobs of BROKER type in PENDING status
ETL
count
Number of load jobs of BROKER type in ETL status
LOADING
count
Number of load jobs of BROKER type in LOADING status
COMMITTED
count
Number of load jobs of BROKER type in COMMITTED status
FINISHED
count
Number of load jobs of BROKER type in FINISHED status
CANCELLED
count
Number of load jobs of BROKER type in CANCELLED status
MINI load job statistics
UNKNOWN
count
Number of load jobs of MINI type in UNKNOWN status
PENDING
count
Number of load jobs of MINI type in PENDING status
ETL
count
Number of load jobs of MINI type in ETL status
LOADING
count
Number of load jobs of MINI type in LOADING status
COMMITTED
count
Number of load jobs of MINI type in COMMITTED status
FINISHED
count
Number of load jobs of MINI type in FINISHED status
CANCELLED
count
Number of load jobs of MINI type in CANCELLED status
HADOOP load job statistics
UNKNOWN
count
Number of load jobs of HADOOP type in UNKNOWN status
PENDING
count
Number of load jobs of HADOOP type in PENDING status
ETL
count
Number of load jobs of HADOOP type in ETL status
LOADING
count
Number of load jobs of HADOOP type in LOADING status
COMMITTED
count
Number of load jobs of HADOOP type in COMMITTED status
FINISHED
count
Number of load jobs of HADOOP type in FINISHED status
CANCELLED
count
Number of load jobs of HADOOP type in CANCELLED status

Doris - BE

Title
Metric
Unit
Description
Thrift utilization
Broker
count
Number of thrifts used by broker
Backend
count
Number of thrifts used by BE
Extdatasource
count
Number of thrifts used by extdatasource
Frontend
count
Number of thrifts used by FE
Streaming load statistics
RequestsTotal
count
Number of streaming load requests
CurrentProcessing
count
Number of existing streaming load processes
PipeCount
count
Number of streaming load pipes
Streaming load time
Duration
ms
Streaming load duration
Streaming load data volume
LoadTotal
bytes
Size of data imported by streaming load
Fragment statistics
PlanFragment
count
Number of plan fragments
Endpoint
count
Number of DataStreams
RequestsTotal
count
Number of fragment requests
Fragment request duration
Duration
μs
Fragment request duration
BE memory
Total
bytes
Size of BE memory pool
Allocated
bytes
Size of allocated BE memory
Maximum compaction score of tablet
CumulativeMax
score
Maximum cumulative compaction score of tablet
BaseMax
score
Maximum base compaction score of tablet
Data handled by compaction
Cumulative
bytes
Amount of data handled by cumulative compaction
Base
bytes
Amount of data handled by base compaction
Delta data handled by compaction
Cumulative
bytes
Amount of delta data handled by cumulative compaction
Base
bytes
Amount of delta data handled by base compaction
MemPools used by compaction
CurrentConsumption
count
Sum of MemPools used by compaction (all compaction threads)
Process file handles
Used
count
Number of file handles used by BE process
SoftLimit
count
Soft limit on file handles for BE process
HardLimit
count
Hard limit on file handles for BE process
Running threads in process
NUM
count
Number of threads running in BE process
Engine request statistics
FailedBaseCompaction
count
Number of failed engine requests of base_compaction type
FailedCultCompt
count
Number of failed engine requests of cumulative_compaction type
TotalBaseCompaction
count
Total number of engine requests of base_compaction type
TotalCultCompt
count
Total number of engine requests of cumulative_compaction type

Doris - BK

Title
Metric
Unit
Description
GC count
YGC
-
Young GC count
FGC
-
Full GC count
GC time
FGCT
s
Full GC time
GCT
s
Garbage collection time
YGCT
s
Young GC time
Memory zone proportion
S0
%
Percentage of used Survivor 0 memory
E
%
Percentage of used Eden memory
CCS
%
Percentage of used compressed class space memory
S1
%
Percentage of used Survivor 1 memory
O
%
Percentage of used Old memory
M
%
Percentage of used Metaspace memory
JVM memory
MemHeapUsedM
MB
Size of HeapMemory currently used by JVM
MemHeapCommittedM
MB
Size of HeapMemory committed by JVM
MemHeapMaxM
MB
Size of HeapMemory configured by JVM
MemHeapInitM
MB
Size of initial JVM HeapMem
MemNonHeapUsedM
MB
Size of NonHeapMemory currently used by JVM
MemNonHeapCommittedM
MB
Size of NonHeapMemory currently committed by JVM
MemNonHeapInitM
MB
Size of initial JVM NonHeapMem
CPU utilization
ProcessCpuLoad
%
CPU utilization
File handles
MaxFileDescriptorCount
-
Maximum number of file descriptors
OpenFileDescriptorCount
-
Number of opened file descriptors
CPU usage time
ProcessCpuTime
ms
Cumulative CPU usage time
Process execution duration
Uptime
s
Process execution duration
Worker threads
ThreadCount
-
Number of threads
PeakThreadCount
-
Peak number of threads
DaemonThreadCount
-
Number of backend threads

Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Contact Us
Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 available.

Submit a Ticket
7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon