tencent cloud

Feedback

Hive Monitoring Metrics

Last updated: 2023-12-27 14:49:37

    Hive - HiveMetaStore

    Title
    Metric
    Unit
    Description
    GC count
    YGC
    -
    Young GC count
    FGC
    -
    Full GC count
    GC time
    FGCT
    s
    Full GC time
    GCT
    s
    Garbage collection time
    YGCT
    s
    Young GC time
    Memory zone proportion
    S0
    %
    Percentage of used Survivor 0 memory
    E
    %
    Percentage of used Eden memory
    CCS
    %
    Percentage of used compressed class space memory
    S1
    %
    Percentage of used Survivor 1 memory
    O
    %
    Percentage of used Old memory
    M
    %
    Percentage of used Metaspace memory
    JVM memory
    MemHeapUsedM
    MB
    Size of HeapMemory currently used by JVM
    MemHeapCommittedM
    MB
    Size of HeapMemory committed by JVM
    MemHeapMaxM
    MB
    Size of HeapMemory configured by JVM
    MemHeapInitM
    MB
    Size of initial JVM HeapMem
    MemNonHeapUsedM
    MB
    Size of NonHeapMemory currently used by JVM
    MemNonHeapCommittedM
    MB
    Size of NonHeapMemory currently committed by JVM
    MemNonHeapInitM
    MB
    Size of initial JVM NonHeapMem
    File descriptors
    OpenFileDescriptorCount
    -
    Number of opened file descriptors
    MaxFileDescriptorCount
    -
    Maximum number of file descriptors
    CPU utilization
    ProcessCpuLoad
    %
    Process CPU utilization
    SystemCpuLoad
    %
    System CPU utilization
    Percentage of CPU usage time
    CPURate
    seconds/second
    Percentage of CPU usage time
    Worker threads
    DaemonThreadCount
    -
    Number of daemon threads
    ThreadCount
    -
    Total number of threads
    Cumulative CPU usage time
    ProcessCpuTime
    ms
    Cumulative CPU usage time
    Process execution duration
    Uptime
    s
    Process execution duration
    GC extra sleep time
    ExtraSleepTime
    ms/s
    GC extra sleep time
    ALTER TABLE request duration
    HIVE.HMS.API_ALTER_TABLE
    ms
    Average duration of ALTER TABLE requests
    ALTER TABLE WITH ENV CONTEXT request duration
    HIVE.HMS.API_ALTER_TABLE_WITH_ENV_CONTEXT
    ms
    Average duration of ALTER TABLE WITH ENV CONTEXT requests
    CREATE TABLE request duration
    HIVE.HMS.API_CREATE_TABLE
    ms
    Average duration of CREATE TABLE requests
    CREATE TABLE WITH ENV CONTEXT request duration
    HIVE.HMS.API_CREATE_TABLE_WITH_ENV_CONTEXT
    ms
    Average duration of CREATE TABLE WITH ENV CONTEXT requests
    DROP TABLE request duration
    HIVE.HMS.API_DROP_TABLE
    ms
    Average duration of DROP TABLE requests
    DROP TABLE WITH ENV CONTEXT request duration
    HIVE.HMS.API_DROP_TABLE_WITH_ENV_CONTEXT
    ms
    Average duration of DROP TABLE WITH ENV CONTEXT requests
    GET TABLE request duration
    HIVE.HMS.API_GET_TABLE
    ms
    Average duration of GET TABLE requests
    GET TABLES request duration
    HIVE.HMS.API_GET_TABLES
    ms
    Average duration of GET TABLES requests
    GET MULTI TABLE request duration
    HIVE.HMS.API_GET_MULTI_TABLE
    ms
    Average duration of GET MULTI TABLE requests
    GET TABLE REQ request duration
    HIVE.HMS.API_GET_TABLE_REQ
    ms
    Average duration of GET TABLE REQ requests
    GET DATABASE request duration
    HIVE.HMS.API_GET_DATABASE
    ms
    Average duration of GET DATABASE requests
    GET DATABASES request duration
    HIVE.HMS.API_GET_DATABASES
    ms
    Average duration of GET DATABASES requests
    GET ALL DATABASES request duration
    HIVE.HMS.API_GET_ALL_DATABASES
    ms
    Average duration of GET ALL DATABASES requests
    GET ALL FUNCTIONS request duration
    HIVE.HMS.API_GET_ALL_FUNCTIONS
    ms
    Average duration of GET ALL FUNCTIONS requests
    Current number of active CREATE TABLE requests
    HIVE.HMS.ACTIVE_CALLS_API_CREATE_TABLE
    -
    Current number of active CREATE TABLE requests
    Current number of active DROP TABLE requests
    HIVE.HMS.ACTIVE_CALLS_API_DROP_TABLE
    -
    Current number of active DROP TABLE requests
    Current number of active ALTER TABLE requests
    HIVE.HMS.ACTIVE_CALLS_API_ALTER_TABLE
    -
    Current number of active ALTER TABLE requests

    Hive - HiveServer2

    Title
    Metric
    Unit
    Description
    GC count
    YGC
    -
    Young GC count
    FGC
    -
    Full GC count
    GC time
    FGCT
    s
    Full GC time
    GCT
    s
    Garbage collection time
    YGCT
    s
    Young GC time
    Memory zone proportion
    S0
    %
    Percentage of used Survivor 0 memory
    E
    %
    Percentage of used Eden memory
    CCS
    %
    Percentage of used compressed class space memory
    S1
    %
    Percentage of used Survivor 1 memory
    O
    %
    Percentage of used Old memory
    M
    %
    Percentage of used Metaspace memory
    JVM memory
    MemNonHeapUsedM
    MB
    Size of NonHeapMemory currently used by JVM
    MemNonHeapCommittedM
    MB
    Size of NonHeapMemory currently committed by JVM
    MemHeapUsedM
    MB
    Size of HeapMemory currently used by JVM
    MemHeapCommittedM
    MB
    Size of HeapMemory currently committed by JVM
    MemHeapMaxM
    MB
    Size of HeapMemory configured by JVM
    MemHeapInitM
    MB
    Size of initial JVM HeapMem
    MemNonHeapInitM
    MB
    Size of initial JVM NonHeapMem
    Percentage of used heap memory
    MemHeapUsedRate
    %
    Proportion of the heap memory size currently used by JVM to the heap memory size configured for JVM
    CPU utilization
    ProcessCpuLoad
    %
    CPU utilization
    Percentage of CPU usage time
    CPUUsedRate
    seconds/second
    Percentage of CPU usage time
    File descriptors
    MaxFileDescriptorCount
    -
    Maximum number of file descriptors
    OpenFileDescriptorCount
    -
    Number of opened file descriptors
    Cumulative CPU usage time
    ProcessCpuTime
    ms
    Cumulative CPU usage time
    Process execution duration
    Uptime
    s
    Process execution duration
    Worker threads
    DaemonThreadCount
    -
    Number of daemon threads
    ThreadCount
    -
    Total number of threads
    Driver execution latency
    99th_percentile
    ms
    99th percentile of driver execution latency
    Avg
    ms
    Average driver execution latency
    Open connections
    NumOpenConnections
    -
    Number of open connections
    Current size of the pool of async HiveServer2 threads
    PoolSize
    -
    Current size of the pool of async HiveServer2 threads
    Current size of the queue for async HiveServer2 operations
    QueueSize
    -
    Current size of the queue for async HiveServer2 operations
    Hive operations
    Closed
    -
    Number of closed operations
    Finished
    -
    Number of completed operations
    Canceled
    -
    Number of canceled operations
    Error
    -
    Number of erroneous operations
    GC extra sleep time
    ExtraSleepTime
    ms/s
    GC extra sleep time
    Number of API requests
    HIVE.H2.ACTIVE.CALLS.API
    Count
    Current number of serializePlan requests
    Count
    Current number of semanticAnalyze requests
    Count
    Current number of runtask requests
    Count
    Current number of releaseLocks requests
    Count
    Current number of getSplits requests
    Duration of SQL tasks in PENDING status
    HIVE.H2.SQL.OPERATION.PENDING
    ms
    Average duration of SQL tasks in PENDING status
    Duration of SQL tasks in RUNNING status
    HIVE.H2.SQL.OPERATION.RUNNING
    ms
    Average duration of SQL tasks in RUNNING status
    Current number of active users
    HIVE.H2.SQL.OPERATION
    Count
    Current number of active users
    Query execution time
    HIVE.H2.EXECUTING.QUERIES
    ms
    Average query execution time
    Query submission time
    HIVE.H2.SUBMITTED.QUERIES
    ms
    Query submission time
    Number of submitted Hive on MR jobs
    HIVE.H2.MR.TASKS
    Count
    Number of submitted Hive on MR jobs
    Number of submitted Hive on Spark jobs
    HIVE.H2.SPARK.TASKS
    Count
    Number of submitted Hive on Tez jobs
    Number of submitted Hive on Tez jobs
    HIVE.H2.TEZ.TASKS
    Count
    Number of submitted Hive on Spark jobs
    Failed queries
    HIVE.H2.FAILED.QUERIES.RATE
    Count/min
    Number of failed queries per minute
    Number of worker threads
    HIVE.H2.THREAD.COUNT
    -
    Number of JVM blocked threads
    -
    Number of JVM terminate threads
    -
    Number of JVM deadlock threads
    -
    Number of JVM new threads
    -
    Number of JVM runnable threads
    -
    Number of JVM timed_waiting threads
    -
    Number of JVM waiting threads
    Number of sessions
    HIVE.H2.OPEN.SESSIONS
    -
    Number of open sessions
    Current number of active sessions
    HIVE.H2.ACTIVE.SESSIONS
    -
    Number of active sessions

    Hive - HiveWebHcat

    Title
    Metric
    Unit
    Description
    GC count
    YGC
    -
    Young GC count
    FGC
    -
    Full GC count
    GC time
    FGCT
    s
    Full GC time
    GCT
    s
    Garbage collection time
    YGCT
    s
    Young GC time
    Memory zone proportion
    S0
    %
    Percentage of used Survivor 0 memory
    E
    %
    Percentage of used Eden memory
    CCS
    %
    Percentage of used compressed class space memory
    S1
    %
    Percentage of used Survivor 1 memory
    O
    %
    Percentage of used Old memory
    M
    %
    Percentage of used Metaspace memory
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support