Elastic MapReduce
- Release Notes and Announcements
- Announcements
- Security Announcements
- Product Introduction
- Product release
- Purchase Guide
- EMR on CVM Billing Instructions
- EMR on TKE Billing Instructions
- EMR Serverless HBase Billing Instructions
- Getting Started
- EMR on CVM Operation Guide
- Planning Cluster
- Cross-AZ Cluster
- Configuring Cluster
- Administrative rights
- Managing Cluster
- Auto Scaling
- Disk Management
- Managing Service
- Configuration Management
- YARN Resource Scheduling
- Monitoring and Alarms
- Application Analysis
- Monitoring Metrics
- EMR on TKE Operation Guide
- Configuring Cluster
- Permission Management
- Cluster Management
- Service Management
- Configuration Management
- Monitoring and Ops
- Application Analysis
- EMR Serverless HBase Operation Guide
- Planning an Instance
- Managing an Instance
- Monitoring and Alarms
- Development Guide
- EMR Development Guide
- Hadoop Development Guide
- Spark Development Guide
- Hbase Development Guide
- Phoenix on Hbase Development Guide
- Hive Development Guide
- Basic Hive Operations
- Advanced Usage
- Presto Development Guide
- Sqoop Development Guide
- Hue Development Guide
- Flume Development Guide
- Kerberos Development Guide
- Knox Development Guide
- Alluxio Development Guide
- Kylin Development Guide
- Livy Development Guide
- Kyuubi Development Guide
- Zeppelin Development Guide
- Hudi Development Guide
- Superset Development Guide
- Impala Development Guide
- Druid Development Guide
- TensorFlow Development Guide
- Kudu Development Guide
- Ranger Development Guide
- Ranger User Guide
- Kafka Development Guide
- StarRocks Development Guide
- Flink Development Guide
- Practical Tutorial
- Practice of EMR on CVM Ops
- Data Migration
- Practical Tutorial on Custom Scaling
- Practical Tutorial on Setting Scaling Rules
- API Documentation
- Making API Requests
- Cluster Resource Management APIs
- Cluster Services APIs
- FAQs
- EMR on CVM
DocumentationElastic MapReduce EMR on CVM Operation GuideMonitoring and AlarmsMonitoring MetricsHive Monitoring Metrics
Hive Monitoring Metrics
Last updated: 2023-12-27 14:49:37
Hive - HiveMetaStore
Title | Metric | Unit | Description |
GC count | YGC | - | Young GC count |
| FGC | - | Full GC count |
GC time | FGCT | s | Full GC time |
| GCT | s | Garbage collection time |
| YGCT | s | Young GC time |
Memory zone proportion | S0 | % | Percentage of used Survivor 0 memory |
| E | % | Percentage of used Eden memory |
| CCS | % | Percentage of used compressed class space memory |
| S1 | % | Percentage of used Survivor 1 memory |
| O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
JVM memory | MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
| MemHeapCommittedM | MB | Size of HeapMemory committed by JVM |
| MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
| MemHeapInitM | MB | Size of initial JVM HeapMem |
| MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
| MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
| MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
File descriptors | OpenFileDescriptorCount | - | Number of opened file descriptors |
| MaxFileDescriptorCount | - | Maximum number of file descriptors |
CPU utilization | ProcessCpuLoad | % | Process CPU utilization |
| SystemCpuLoad | % | System CPU utilization |
Percentage of CPU usage time | CPURate | seconds/second | Percentage of CPU usage time |
Worker threads | DaemonThreadCount | - | Number of daemon threads |
| ThreadCount | - | Total number of threads |
Cumulative CPU usage time | ProcessCpuTime | ms | Cumulative CPU usage time |
Process execution duration | Uptime | s | Process execution duration |
GC extra sleep time | ExtraSleepTime | ms/s | GC extra sleep time |
ALTER TABLE request duration | HIVE.HMS.API_ALTER_TABLE | ms | Average duration of ALTER TABLE requests |
ALTER TABLE WITH ENV CONTEXT request duration | HIVE.HMS.API_ALTER_TABLE_WITH_ENV_CONTEXT | ms | Average duration of ALTER TABLE WITH ENV CONTEXT requests |
CREATE TABLE request duration | HIVE.HMS.API_CREATE_TABLE | ms | Average duration of CREATE TABLE requests |
CREATE TABLE WITH ENV CONTEXT request duration | HIVE.HMS.API_CREATE_TABLE_WITH_ENV_CONTEXT | ms | Average duration of CREATE TABLE WITH ENV CONTEXT requests |
DROP TABLE request duration | HIVE.HMS.API_DROP_TABLE | ms | Average duration of DROP TABLE requests |
DROP TABLE WITH ENV CONTEXT request duration | HIVE.HMS.API_DROP_TABLE_WITH_ENV_CONTEXT | ms | Average duration of DROP TABLE WITH ENV CONTEXT requests |
GET TABLE request duration | HIVE.HMS.API_GET_TABLE | ms | Average duration of GET TABLE requests |
GET TABLES request duration | HIVE.HMS.API_GET_TABLES | ms | Average duration of GET TABLES requests |
GET MULTI TABLE request duration | HIVE.HMS.API_GET_MULTI_TABLE | ms | Average duration of GET MULTI TABLE requests |
GET TABLE REQ request duration | HIVE.HMS.API_GET_TABLE_REQ | ms | Average duration of GET TABLE REQ requests |
GET DATABASE request duration | HIVE.HMS.API_GET_DATABASE | ms | Average duration of GET DATABASE requests |
GET DATABASES request duration | HIVE.HMS.API_GET_DATABASES | ms | Average duration of GET DATABASES requests |
GET ALL DATABASES request duration | HIVE.HMS.API_GET_ALL_DATABASES | ms | Average duration of GET ALL DATABASES requests |
GET ALL FUNCTIONS request duration | HIVE.HMS.API_GET_ALL_FUNCTIONS | ms | Average duration of GET ALL FUNCTIONS requests |
Current number of active CREATE TABLE requests | HIVE.HMS.ACTIVE_CALLS_API_CREATE_TABLE | - | Current number of active CREATE TABLE requests |
Current number of active DROP TABLE requests | HIVE.HMS.ACTIVE_CALLS_API_DROP_TABLE | - | Current number of active DROP TABLE requests |
Current number of active ALTER TABLE requests | HIVE.HMS.ACTIVE_CALLS_API_ALTER_TABLE | - | Current number of active ALTER TABLE requests |
Hive - HiveServer2
Title | Metric | Unit | Description |
GC count | YGC | - | Young GC count |
| FGC | - | Full GC count |
GC time | FGCT | s | Full GC time |
| GCT | s | Garbage collection time |
| YGCT | s | Young GC time |
Memory zone proportion | S0 | % | Percentage of used Survivor 0 memory |
| E | % | Percentage of used Eden memory |
| CCS | % | Percentage of used compressed class space memory |
| S1 | % | Percentage of used Survivor 1 memory |
| O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
JVM memory | MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
| MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
| MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
| MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
| MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
| MemHeapInitM | MB | Size of initial JVM HeapMem |
| MemNonHeapInitM | MB | Size of initial JVM NonHeapMem |
Percentage of used heap memory | MemHeapUsedRate | % | Proportion of the heap memory size currently used by JVM to the heap memory size configured for JVM |
CPU utilization | ProcessCpuLoad | % | CPU utilization |
Percentage of CPU usage time | CPUUsedRate | seconds/second | Percentage of CPU usage time |
File descriptors | MaxFileDescriptorCount | - | Maximum number of file descriptors |
| OpenFileDescriptorCount | - | Number of opened file descriptors |
Cumulative CPU usage time | ProcessCpuTime | ms | Cumulative CPU usage time |
Process execution duration | Uptime | s | Process execution duration |
Worker threads | DaemonThreadCount | - | Number of daemon threads |
| ThreadCount | - | Total number of threads |
Driver execution latency | 99th_percentile | ms | 99th percentile of driver execution latency |
| Avg | ms | Average driver execution latency |
Open connections | NumOpenConnections | - | Number of open connections |
Current size of the pool of async HiveServer2 threads | PoolSize | - | Current size of the pool of async HiveServer2 threads |
Current size of the queue for async HiveServer2 operations | QueueSize | - | Current size of the queue for async HiveServer2 operations |
Hive operations | Closed | - | Number of closed operations |
| Finished | - | Number of completed operations |
| Canceled | - | Number of canceled operations |
| Error | - | Number of erroneous operations |
GC extra sleep time | ExtraSleepTime | ms/s | GC extra sleep time |
Number of API requests | HIVE.H2.ACTIVE.CALLS.API | Count | Current number of serializePlan requests |
| | Count | Current number of semanticAnalyze requests |
| | Count | Current number of runtask requests |
| | Count | Current number of releaseLocks requests |
| | Count | Current number of getSplits requests |
Duration of SQL tasks in PENDING status | HIVE.H2.SQL.OPERATION.PENDING | ms | Average duration of SQL tasks in PENDING status |
Duration of SQL tasks in RUNNING status | HIVE.H2.SQL.OPERATION.RUNNING | ms | Average duration of SQL tasks in RUNNING status |
Current number of active users | HIVE.H2.SQL.OPERATION | Count | Current number of active users |
Query execution time | HIVE.H2.EXECUTING.QUERIES | ms | Average query execution time |
Query submission time | HIVE.H2.SUBMITTED.QUERIES | ms | Query submission time |
Number of submitted Hive on MR jobs | HIVE.H2.MR.TASKS | Count | Number of submitted Hive on MR jobs |
Number of submitted Hive on Spark jobs | HIVE.H2.SPARK.TASKS | Count | Number of submitted Hive on Tez jobs |
Number of submitted Hive on Tez jobs | HIVE.H2.TEZ.TASKS | Count | Number of submitted Hive on Spark jobs |
Failed queries | HIVE.H2.FAILED.QUERIES.RATE | Count/min | Number of failed queries per minute |
Number of worker threads | HIVE.H2.THREAD.COUNT | - | Number of JVM blocked threads |
| | - | Number of JVM terminate threads |
| | - | Number of JVM deadlock threads |
| | - | Number of JVM new threads |
| | - | Number of JVM runnable threads |
| | - | Number of JVM timed_waiting threads |
| | - | Number of JVM waiting threads |
Number of sessions | HIVE.H2.OPEN.SESSIONS | - | Number of open sessions |
Current number of active sessions | HIVE.H2.ACTIVE.SESSIONS | - | Number of active sessions |
Hive - HiveWebHcat
Title | Metric | Unit | Description |
GC count | YGC | - | Young GC count |
| FGC | - | Full GC count |
GC time | FGCT | s | Full GC time |
| GCT | s | Garbage collection time |
| YGCT | s | Young GC time |
Memory zone proportion | S0 | % | Percentage of used Survivor 0 memory |
| E | % | Percentage of used Eden memory |
| CCS | % | Percentage of used compressed class space memory |
| S1 | % | Percentage of used Survivor 1 memory |
| O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No