Elastic MapReduce
- Release Notes and Announcements
- Announcements
- Security Announcements
- Product Introduction
- Product release
- Purchase Guide
- EMR on CVM Billing Instructions
- EMR on TKE Billing Instructions
- EMR Serverless HBase Billing Instructions
- Getting Started
- EMR on CVM Operation Guide
- Planning Cluster
- Cross-AZ Cluster
- Configuring Cluster
- Administrative rights
- Managing Cluster
- Auto Scaling
- Disk Management
- Managing Service
- Configuration Management
- YARN Resource Scheduling
- Monitoring and Alarms
- Application Analysis
- Monitoring Metrics
- EMR on TKE Operation Guide
- Configuring Cluster
- Permission Management
- Cluster Management
- Service Management
- Configuration Management
- Monitoring and Ops
- Application Analysis
- EMR Serverless HBase Operation Guide
- Planning an Instance
- Managing an Instance
- Monitoring and Alarms
- Development Guide
- EMR Development Guide
- Hadoop Development Guide
- Spark Development Guide
- Hbase Development Guide
- Phoenix on Hbase Development Guide
- Hive Development Guide
- Basic Hive Operations
- Advanced Usage
- Presto Development Guide
- Sqoop Development Guide
- Hue Development Guide
- Flume Development Guide
- Kerberos Development Guide
- Knox Development Guide
- Alluxio Development Guide
- Kylin Development Guide
- Livy Development Guide
- Kyuubi Development Guide
- Zeppelin Development Guide
- Hudi Development Guide
- Superset Development Guide
- Impala Development Guide
- Druid Development Guide
- TensorFlow Development Guide
- Kudu Development Guide
- Ranger Development Guide
- Ranger User Guide
- Kafka Development Guide
- StarRocks Development Guide
- Flink Development Guide
- Practical Tutorial
- Practice of EMR on CVM Ops
- Data Migration
- Practical Tutorial on Custom Scaling
- Practical Tutorial on Setting Scaling Rules
- API Documentation
- Making API Requests
- Cluster Resource Management APIs
- Cluster Services APIs
- FAQs
- EMR on CVM
DocumentationElastic MapReduce EMR on CVM Operation GuideMonitoring and AlarmsMonitoring MetricsDruid Monitoring Metrics
Druid Monitoring Metrics
Last updated: 2023-12-27 14:51:14
Druid - Broker
Metric Name | Unit | Description |
YGC | - | Young GC count |
FGC | - | Full GC count |
FGCT | s | Full GC time |
GCT | s | Garbage collection time |
YGCT | s | Young GC time |
S0 | % | Percentage of used Survivor 0 memory |
E | % | Percentage of used Eden memory |
CCS | % | Percentage of memory used by compressed class space |
S1 | % | Percentage of used Survivor 1 memory |
O | % | Percentage of used Old memory |
M | % | Percentage of used Metaspace memory |
MemHeapInitM | MB | Size of initial JVM HeapMem |
MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
ThreadsNew | - | Number of threads in NEW state |
ThreadsRunnable | - | Number of threads in RUNNABLE state |
ThreadsBlocked | - | Number of threads in BLOCKED state |
ThreadsWaiting | - | Number of threads in WAITING state |
ThreadsTimedWaiting | - | Number of threads in TIMED_WAITING state |
ThreadsTerminated | - | Number of threads in TERMINATED state |
LogFatal | - | Number of FATAL logs |
LogError | - | Number of ERROR logs |
LogWarn | - | Number of WARN logs |
LogInfo | - | Number of INFO logs |
jetty.numOpenConnections | - | Number of open Jetty connections |
segment.scan.pending | - | Number of segments in queue waiting to be scanned |
broker.query.count | - | number of total queries |
broker.query.success.count | - | number of queries successfully processed |
broker.query.failed.count | - | number of failed queries |
broker.query.interrupted.count | - | number of queries interrupted due to cancellation or timeout |
normal.count | - | Number of queries with delay shorter than 1 second |
abnormal.count | - | Number of queries with delay longer than or equal to 1 second |
Druid - Coordinator
Metric Name | Unit | Description |
segment.assigned.count | - | Number of segments loaded into Druid cluster |
segment.moved.count | - | Number of segments moved in Druid cluster |
segment.dropped.count | - | Number of segments deleted in Druid cluster due to expiration |
segment.deleted.count | - | Number of segments deleted in Druid cluster due to rule settings |
segment.unneeded.count | - | Number of segments deleted in Druid cluster for being marked as "unused" |
segment.cost.raw | ms | Used in cost balancing. The raw cost of hosting segments. |
segment.cost.normalization | ms | Used in cost balancing. The normalization of hosting segments. |
segment.cost.normalized | ms | Used in cost balancing. The normalized cost of hosting segments. |
segment.loadQueue.size | Bytes | Size in bytes of segments to load. |
segment.loadQueue.failed | - | Number of segments that failed to load. |
segment.loadQueue.count | - | Number of segments to load. |
segment.dropQueue.count | - | Number of segments to drop. |
segment.overshadowed.count | - | Number of overshadowed segments. |
tier.historical.count | - | Number of available historical nodes in each tier. |
tier.replication.factor | - | Configured maximum replication factor in each tier. |
tier.required.capacity | Bytes | Total capacity in bytes required in each tier. |
tier.total.capacity | Bytes | Total capacity in bytes available in each tier. |
compact.task.count | - | Number of compaction tasks |
YGC | - | Young GC count |
FGC | - | Full GC count |
FGCT | s | Full GC time |
GCT | s | Garbage collection time |
YGCT | s | Young GC time |
S0 | % | Percentage of used Survivor 0 memory |
E | % | Percentage of used Eden memory |
CCS | % | Percentage of memory used by compressed class space |
S1 | % | Percentage of used Survivor 1 memory |
O | % | Percentage of used Old memory |
M | % | Percentage of used Metaspace memory |
MemHeapInitM | MB | Size of initial JVM HeapMem |
MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
ThreadsNew | - | Number of threads in NEW state |
ThreadsRunnable | - | Number of threads in RUNNABLE state |
ThreadsBlocked | - | Number of threads in BLOCKED state |
ThreadsWaiting | - | Number of threads in WAITING state |
ThreadsTimedWaiting | - | Number of threads in TIMED_WAITING state |
ThreadsTerminated | - | Number of threads in TERMINATED state |
LogFatal | - | Number of FATAL logs |
LogError | - | Number of ERROR logs |
LogWarn | - | Number of WARN logs |
LogInfo | - | Number of INFO logs |
segment.size | Bytes | Total size of used segments in a data source. Emitted only for data sources to which at least one used segment belongs. |
segment.count | - | Number of used segments belonging to a data source. Emitted only for data sources to which at least one used segment belongs. |
segment.unavailable.count | - | Number of segments (not including replicas) left to load until segments that should be loaded in the cluster are available for queries. |
segment.underReplicated.count | - | Number of segments (including replicas) left to load until segments that should be loaded in the cluster are available for queries. |
jetty.numOpenConnections | - | Number of open Jetty connections |
Druid - Historical
Metric Name | Unit | Description |
YGC | - | Young GC count |
FGC | - | Full GC count |
FGCT | s | Full GC time |
GCT | s | Garbage collection time |
YGCT | s | Young GC time |
S0 | % | Percentage of used Survivor 0 memory |
E | % | Percentage of used Eden memory |
CCS | % | Percentage of memory used by compressed class space |
S1 | % | Percentage of used Survivor 1 memory |
O | % | Percentage of used Old memory |
M | % | Percentage of used Metaspace memory |
MemHeapInitM | MB | Size of initial JVM HeapMem |
MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
ThreadsNew | - | Number of threads in NEW state |
ThreadsRunnable | - | Number of threads in RUNNABLE state |
ThreadsBlocked | - | Number of threads in BLOCKED state |
ThreadsWaiting | - | Number of threads in WAITING state |
ThreadsTimedWaiting | - | Number of threads in TIMED_WAITING state |
ThreadsTerminated | - | Number of threads in TERMINATED state |
LogFatal | - | Number of FATAL logs |
LogError | - | Number of ERROR logs |
LogWarn | - | Number of WARN logs |
LogInfo | - | Number of INFO logs |
jetty.numOpenConnections | - | Number of open Jetty connections |
segment.scan.pending | - | Number of segments in queue waiting to be scanned |
segment.max | Bytes | Maximum byte limit available for segments |
segment.pendingdelete | Bytes | On-disk size in bytes of segments that are waiting to be cleared out |
historical.query.count | - | Total number of historical queries |
historical.query.success.count | - | Total number of historical query successes |
historical.query.failed.count | - | Total number of historical query failures |
historical.query.interrupted.count | - | Total number of historical query interruptions |
normal.count | - | Number of queries with delay shorter than 1 second |
abnormal.count | - | Number of queries with delay longer than or equal to 1 second |
Druid - MiddleManager
Metric Name | Unit | Description |
YGC | - | Young GC count |
FGC | - | Full GC count |
FGCT | s | Full GC time |
GCT | s | Garbage collection time |
YGCT | s | Young GC time |
S0 | % | Percentage of used Survivor 0 memory |
E | % | Percentage of used Eden memory |
CCS | % | Percentage of memory used by compressed class space |
S1 | % | Percentage of used Survivor 1 memory |
O | % | Percentage of used Old memory |
M | % | Percentage of used Metaspace memory |
MemHeapInitM | MB | Size of initial JVM HeapMem |
MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
ThreadsNew | - | Number of threads in NEW state |
ThreadsRunnable | - | Number of threads in RUNNABLE state |
ThreadsBlocked | - | Number of threads in BLOCKED state |
ThreadsWaiting | - | Number of threads in WAITING state |
ThreadsTimedWaiting | - | Number of threads in TIMED_WAITING state |
ThreadsTerminated | - | Number of threads in TERMINATED state |
LogFatal | - | Number of FATAL logs |
LogError | - | Number of ERROR logs |
LogWarn | - | Number of WARN logs |
LogInfo | - | Number of INFO logs |
jetty.numOpenConnections | - | Number of open Jetty connections |
Druid - Overlord
Metric Name | Unit | Description |
YGC | - | Young GC count |
FGC | - | Full GC count |
FGCT | s | Full GC time |
GCT | s | Garbage collection time |
YGCT | s | Young GC time |
S0 | % | Percentage of used Survivor 0 memory |
E | % | Percentage of used Eden memory |
CCS | % | Percentage of memory used by compressed class space |
S1 | % | Percentage of used Survivor 1 memory |
O | % | Percentage of used Old memory |
M | % | Percentage of used Metaspace memory |
MemHeapInitM | MB | Size of initial JVM HeapMem |
MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
ThreadsNew | - | Number of threads in NEW state |
ThreadsRunnable | - | Number of threads in RUNNABLE state |
ThreadsBlocked | - | Number of threads in BLOCKED state |
ThreadsWaiting | - | Number of threads in WAITING state |
ThreadsTimedWaiting | - | Number of threads in TIMED_WAITING state |
ThreadsTerminated | - | Number of threads in TERMINATED state |
LogFatal | - | Number of FATAL logs |
LogError | - | Number of ERROR logs |
LogWarn | - | Number of WARN logs |
LogInfo | - | Number of INFO logs |
jetty.numOpenConnections | - | Number of open Jetty connections |
Druid - Router
Metric Name | Unit | Description |
YGC | - | Young GC count |
FGC | - | Full GC count |
FGCT | s | Full GC time |
GCT | s | Garbage collection time |
YGCT | s | Young GC time |
S0 | % | Percentage of used Survivor 0 memory |
E | % | Percentage of used Eden memory |
CCS | % | Percentage of memory used by compressed class space |
S1 | % | Percentage of used Survivor 1 memory |
O | % | Percentage of used Old memory |
M | % | Percentage of used Metaspace memory |
MemHeapInitM | MB | Size of initial JVM HeapMem |
MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
ThreadsNew | - | Number of threads in NEW state |
ThreadsRunnable | - | Number of threads in RUNNABLE state |
ThreadsBlocked | - | Number of threads in BLOCKED state |
ThreadsWaiting | - | Number of threads in WAITING state |
ThreadsTimedWaiting | - | Number of threads in TIMED_WAITING state |
ThreadsTerminated | - | Number of threads in TERMINATED state |
LogFatal | - | Number of FATAL logs |
LogError | - | Number of ERROR logs |
LogWarn | - | Number of WARN logs |
LogInfo | - | Number of INFO logs |
jetty.numOpenConnections | - | Number of open Jetty connections |
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No