tencent cloud

Feedback

Impala Monitoring Metrics

Last updated: 2023-12-27 14:52:35
    Note:
    Currently, only Impala v3.4.0 and later support Impala metrics.

    Impala - catalog

    Title
    Metric
    Unit
    Description
    Resident set size
    RSS
    bytes
    Resident set size
    JVM memory
    MemHeapInitM
    MB
    Peak size of initial JVM HeapMemory
    MemHeapCommittedM
    MB
    Size of HeapMemory currently committed by JVM
    MemHeapMaxM
    MB
    Size of HeapMemory configured by JVM
    MemHeapUsedM
    MB
    Size of HeapMemory currently used by JVM
    MemNonHeapInitM
    MB
    Size of initial JVM NonHeapMemory
    MemNonHeapCommittedM
    MB
    Size of NonHeapMemory currently committed by JVM
    MemNonHeapUsedM
    MB
    Size of NonHeapMemory currently used by JVM
    Interval between heartbeats from the daemon process to StateStore
    Last
    s
    Latest interval between heartbeats from the daemon process to StateStore
    Max
    s
    Maximum interval between heartbeats from the daemon process to StateStore
    Mean
    s
    Average interval between heartbeats from the daemon process to StateStore
    Min
    s
    Minimum interval between heartbeats from the daemon process to StateStore
    Stddev
    s
    Standard deviation in the interval between heartbeats from the daemon process to StateStore
    TCMalloc memory
    Used
    bytes
    Number of bytes used by the program
    PageheapFreeBytes
    bytes
    Number of bytes of free mapped pages in the page heap
    PageheapUnmappedBytes
    bytes
    Number of bytes of free unmapped pages in the page heap
    PhysicalBytesReserved
    bytes
    Amount of physical memory used by the process
    TotalBytesReserved
    bytes
    Number of bytes of system memory reserved by TCMalloc
    Active connections
    Thrift_Server_Connections_Used
    -
    Number of active connections
    Process execution duration
    Uptime
    s
    Process execution duration
    File descriptors
    MaxFileDescriptorCount
    -
    Maximum number of file descriptors
    OpenFileDescriptorCount
    -
    Number of opened file descriptors
    Threads
    ThreadCount
    -
    Total number of threads
    DaemonThreadCount
    -
    Number of daemon threads
    CPU utilization
    SystemCpuLoad
    -
    System CPU Utilization

    Impala - StateStore

    Title
    Metric
    Unit
    Description
    Resident set size
    RSS
    bytes
    Resident set size
    TCMalloc memory
    Used
    bytes
    Number of bytes used by the program
    PageheapFreeBytes
    bytes
    Number of bytes of free mapped pages in the page heap
    PageheapUnmappedBytes
    bytes
    Number of bytes of free unmapped pages in the page heap
    PhysicalBytesReserved
    bytes
    Amount of physical memory used by the process
    TotalBytesReserved
    bytes
    Number of bytes of system memory reserved by TCMalloc
    Connections
    Used
    -
    Number of active connections
    Running threads
    Count
    -
    Number of running threads
    StateStore subscribers
    Count
    -
    Number of StateStore subscribers

    Impala - daemon

    Title
    Metric
    Unit
    Description
    JVM memory
    MemHeapInitM
    MB
    Peak size of initial JVM HeapMemory
    MemHeapCommittedM
    MB
    Size of HeapMemory currently committed by JVM
    MemHeapMaxM
    MB
    Size of HeapMemory configured by JVM
    MemHeapUsedM
    MB
    Size of HeapMemory currently used by JVM
    MemNonHeapInitM
    MB
    Size of initial JVM NonHeapMemory
    MemNonHeapCommittedM
    MB
    Size of NonHeapMemory currently committed by JVM
    MemNonHeapUsedM
    MB
    Size of NonHeapMemory currently used by JVM
    TCMalloc memory
    Used
    bytes
    Number of bytes used by the program
    PageheapFreeBytes
    bytes
    Number of bytes of free mapped pages in the page heap
    PageheapUnmappedBytes
    bytes
    Number of bytes of free unmapped pages in the page heap
    PhysicalBytesReserved
    bytes
    Amount of physical memory used by the process
    TotalBytesReserved
    bytes
    Number of bytes of system memory reserved by TCMalloc
    Threads
    ThreadCount
    -
    Total number of threads
    DaemonThreadCount
    -
    Number of daemon threads
    Process execution duration
    Uptime
    s
    Process execution duration
    File descriptors
    MaxFileDescriptorCount
    -
    Maximum number of file descriptors
    OpenFileDescriptorCount
    -
    Number of opened file descriptors
    CPU utilization
    SystemCpuLoad
    -
    System CPU Utilization
    Beeswax API client connections
    Use
    -
    Number of active Beeswax API connections
    Conn_In_Use
    -
    Number of active Beeswax API connections to this Impala daemon
    TotalConns
    -
    Total number of active Beeswax API connections to this Impala daemon
    ConnSetupQueueSize
    -
    Number of Beeswax API connections that this Impala daemon has received and are waiting to establish
    HS2 API client connections
    Use
    -
    Number of active HS2 API connections
    Conn_In_Use
    -
    Number of active HS2 API connections
    TotalConns
    -
    Total number of HS2 API connections this Impala daemon has established during the lifecycle
    ConnSetupQueueSize
    -
    Number of HS2 API connections that this Impala daemon has received and are waiting to establish
    Thread manager
    RunningThreads
    -
    Number of running threads
    TotalCreatedThreads
    -
    Number of threads created during the lifecycle
    Memory manager limit
    Limit
    Bytes
    Memory beyond the memory limit (default value: -1)
    Amount of memory beyond the memory limit (default value: -1)
    OverLimit
    Bytes
    Number of threads created during the lifecycle
    HS2 API client wait time for connection establishment
    P20
    us
    HS2 API client wait time for connection establishment
    P50
    P70
    P90
    P95
    P99.9
    Beeswax API client wait time for service thread establishment
    P20
    us
    Beeswax API client wait time for service thread establishment
    P50
    P70
    P90
    P95
    P99.9
    Timed-out Beeswax API connections
    TimeOutCnncRequests
    -
    Number of timed-out Beeswax API connections
    Time spent parsing requests from request pool (milliseconds)
    Total
    ms
    Time spent parsing requests from request pool (milliseconds)
    Cache misses in external data source cache class
    Misses
    -
    Number of cache misses in external data source cache class
    Impala backend server connection requests that timed out waiting for setup
    ConnSetupQueueSize
    -
    Number of Impala backend server connection requests that timed out waiting for setup
    Impala backend connection requests that timed out waiting for setup
    TimeOutCnncRequests
    -
    Number of Impala backend connection requests that timed out waiting for setup
    Total Impala backend client connections to this Impala daemon
    TotalConnections
    -
    Total number of Impala backend client connections to this Impala daemon
    Time spent by Impala backend client waiting for connection establishment
    P20
    us
    Time spent by Impala backend client waiting for connection establishment
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    Time spent by Impala backend client waiting for service thread
    P20
    us
    Time spent by Impala backend client waiting for service thread
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    HS2 API client wait time for service thread establishment
    P20
    us
    HS2 API client wait time for service thread establishment
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    HS2 HTTP API client wait time for service thread
    P20
    us
    HS2 HTTP API client wait time for service thread
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    DataStreamService: Rejected service queue overflows
    RpcsQueueOverflow
    -
    DataStreamService: Number of rejected service queue overflows
    ControlStreamService: Rejected service queue overflows
    RpcsQueueOverflow
    -
    ControlStreamService: Number of rejected service queue overflows
    DataStreamService: Used bytes
    PeakUsageBytes
    Bytes
    Peak number of bytes used by Memtracker DataStreamService
    CurrentUsageBytes
    Bytes
    Current number of bytes used by Memtracker DataStreamService
    ControlService: Used bytes
    PeakUsageBytes
    Bytes
    Peak number of bytes used by Memtracker ControlService
    CurrentUsageBytes
    Bytes
    Current number of bytes used by Memtracker ControlService
    Resident set size (RSS) for this process
    RSS
    Bytes
    Resident set size (RSS) for this process
    Total backends registered in StateStore
    Total
    -
    Total number of backends registered in StateStore
    Query release delay
    P20
    us
    Query release delay
    P50
    P70
    P90
    P95
    P99.9
    Count
    Sum
    Opened HDFS filed
    NumFilesOpenForInsert
    -
    Number of opened HDFS files
    Scan range read during the lifecycle of the process
    ScanRangesTotal
    -
    Scan range read during the lifecycle of the process
    Opened Beeswax sessions
    NumOpenBeeswaxSessions
    -
    Number of opened Beeswax sessions
    Total query fragments processed during the lifecycle of the process
    NumFragments
    -
    Total number of query fragments processed during the lifecycle of the process
    Total scan ranges read during the lifecycle of the process without volume metadata
    ScanRangesNumMissingVolumId
    -
    Total number of scan ranges read during the lifecycle of the process without volume metadata
    Hedged read attempts
    HedgedReadOps
    -
    Number of hedged read attempts
    Total queries processed during the lifecycle of the process
    NumQueries
    -
    Total number of queries processed during the lifecycle of the process
    Total rows supporting caching HS2 FETCH_FIRST
    ResultSetCacheTotalNumRows
    -
    Total number of rows supporting caching HS2 FETCH_FIRST
    Total queries registered on this Impala server
    NumQueriesRegistered
    -
    Total number of queries registered on this Impala server
    Total backend queries
    NumQueriesExecuted
    -
    Total number of backend queries
    Sessions terminated due to inactivity
    NumSessionsExpired
    -
    Number of sessions terminated due to inactivity
    Queries terminated due to inactivity
    NumQueriesExpired
    -
    Number of queries terminated due to inactivity
    Opened HS2 sessions
    NumOpenHS2Sessions
    -
    Number of opened HS2 sessions
    Tables in catalog
    NumTables
    -
    Number of tables in catalog
    Databases in catalog
    NumDatabases
    -
    Number of databases in catalog
    Bytes written to the disk by the I/O manager
    BytesWritten
    -
    Number of bytes written to the disk by the I/O manager
    Files opened by the I/O manager
    NumOpenFiles
    -
    Number of files opened by the I/O manager
    Used HDFS file handles
    NumFileHandlesOutstanding
    Bytes
    Number of used HDFS file handles
    Read local bytes
    LocalBytesRead
    Bytes
    Number of local bytes read by the I/O manager
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support