tencent cloud

Feedback

Doris Monitoring Metrics

Last updated: 2023-12-27 14:54:08

    Doris - FE

    Title
    Metric
    Unit
    Description
    Node information
    FeNodeNum
    count
    Total number of FE nodes
    BeAliveNum
    count
    Number of alive BE nodes
    BkDeadNum
    count
    Number of dead broker nodes
    Connections
    Num
    count
    Number of FE node JVM connections
    JVM threads
    Total
    count
    Total number of threads in the JVM of the FE node, including daemon threads and non-daemon threads
    Peak
    count
    Peak number of threads in the JVM of the FE node
    GC count
    YoungGC
    count
    FE node JVM Young GC count
    OldGC
    count
    FE node JVM Old GC count
    GC time
    YoungGC
    s
    FE node JVM Young GC time
    OldGC
    s
    FE node JVM Old GC time
    FE query latency
    Quantile75
    ms
    75th percentile of the FE query latency
    Quantile95
    ms
    95th percentile of the FE query latency
    Quantile99
    ms
    99th percentile of the FE query latency
    Quantile999
    ms
    99.9th percentile of the FE query latency
    Maximum compaction score of tablet
    MAX
    score
    Maximum compaction score of FE tablet
    Scheduled tablets
    ScheduledTablet
    count
    Number of scheduled tablets in FE
    Request response
    QPS
    count
    Number of queries per second
    RPS
    count
    Number of requests that can be processed per second
    Query failure rate
    ErrRate
    %
    Query error rate
    Cache query
    SqlModelHitQuery
    count
    Number of queries that hit the SQL model
    PartitionModelHitQuery
    count
    Number of queries that hit the partition model
    SqlModelQuery
    count
    Number of queries in the SQL cache model
    PartitionModelQuery
    count
    Number of queries in the partition cache model
    CachePartitionHit
    count
    Number of partitions that hit the cache in the query
    CachePartitionScan
    count
    Number of all partitions scanned in the query
    Routine load rows
    TotalRows
    count
    Number of FE routine load rows
    ErrorRows
    count
    Number of FE routine load error rows
    Transaction status statistics
    Reject
    count
    Number of rejected transactions on FE
    Begin
    count
    Number of transactions that have begun on FE
    Success
    count
    Number of successful transactions on FE
    Failed
    count
    Number of failed transactions on FE
    Images
    Write
    count
    Number of image writes on FE
    Push
    count
    Number of image pushes on FE
    ALTER job statistics
    RollupRunning
    count
    Number of running alter jobs of ROLLUP type
    SchemaChangeRunning
    count
    Number of running alter jobs of SCHEMA_CHANGE type
    UNKNOWN load job statistics
    UNKNOWN
    count
    Number of load jobs of UNKNOWN type in UNKNOWN status
    PENDING
    count
    Number of load jobs of UNKNOWN type in PENDING status
    ETL
    count
    Number of load jobs of UNKNOWN type in ETL status
    LOADING
    count
    Number of load jobs of UNKNOWN type in LOADING status
    COMMITTED
    count
    Number of load jobs of UNKNOWN type in COMMITTED status
    FINISHED
    count
    Number of load jobs of UNKNOWN type in FINISHED status
    CANCELLED
    count
    Number of load jobs of UNKNOWN type in CANCELLED status
    SPARK load job statistics
    UNKNOWN
    count
    Number of load jobs of SPARK type in UNKNOWN status
    PENDING
    count
    Number of load jobs of SPARK type in PENDING status
    ETL
    count
    Number of load jobs of SPARK type in ETL status
    LOADING
    count
    Number of load jobs of SPARK type in LOADING status
    COMMITTED
    count
    Number of load jobs of SPARK type in COMMITTED status
    FINISHED
    count
    Number of load jobs of SPARK type in FINISHED status
    CANCELLED
    count
    Number of load jobs of SPARK type in CANCELLED status
    DELETE load job statistics
    UNKNOWN
    count
    Number of load jobs of DELETE type in UNKNOWN status
    PENDING
    count
    Number of load jobs of DELETE type in PENDING status
    ETL
    count
    Number of load jobs of DELETE type in ETL status
    LOADING
    count
    Number of load jobs of DELETE type in LOADING status
    COMMITTED
    count
    Number of load jobs of DELETE type in COMMITTED status
    FINISHED
    count
    Number of load jobs of DELETE type in FINISHED status
    CANCELLED
    count
    Number of load jobs of DELETE type in CANCELLED status
    INSERT load job statistics
    UNKNOWN
    count
    Number of load jobs of INSERT type in UNKNOWN status
    PENDING
    count
    Number of load jobs of INSERT type in PENDING status
    ETL
    count
    Number of load jobs of INSERT type in ETL status
    LOADING
    count
    Number of load jobs of INSERT type in LOADING status
    COMMITTED
    count
    Number of load jobs of INSERT type in COMMITTED status
    FINISHED
    count
    Number of load jobs of INSERT type in FINISHED status
    CANCELLED
    count
    Number of load jobs of INSERT type in CANCELLED status
    BROKER load job statistics
    UNKNOWN
    count
    Number of load jobs of BROKER type in UNKNOWN status
    PENDING
    count
    Number of load jobs of BROKER type in PENDING status
    ETL
    count
    Number of load jobs of BROKER type in ETL status
    LOADING
    count
    Number of load jobs of BROKER type in LOADING status
    COMMITTED
    count
    Number of load jobs of BROKER type in COMMITTED status
    FINISHED
    count
    Number of load jobs of BROKER type in FINISHED status
    CANCELLED
    count
    Number of load jobs of BROKER type in CANCELLED status
    MINI load job statistics
    UNKNOWN
    count
    Number of load jobs of MINI type in UNKNOWN status
    PENDING
    count
    Number of load jobs of MINI type in PENDING status
    ETL
    count
    Number of load jobs of MINI type in ETL status
    LOADING
    count
    Number of load jobs of MINI type in LOADING status
    COMMITTED
    count
    Number of load jobs of MINI type in COMMITTED status
    FINISHED
    count
    Number of load jobs of MINI type in FINISHED status
    CANCELLED
    count
    Number of load jobs of MINI type in CANCELLED status
    HADOOP load job statistics
    UNKNOWN
    count
    Number of load jobs of HADOOP type in UNKNOWN status
    PENDING
    count
    Number of load jobs of HADOOP type in PENDING status
    ETL
    count
    Number of load jobs of HADOOP type in ETL status
    LOADING
    count
    Number of load jobs of HADOOP type in LOADING status
    COMMITTED
    count
    Number of load jobs of HADOOP type in COMMITTED status
    FINISHED
    count
    Number of load jobs of HADOOP type in FINISHED status
    CANCELLED
    count
    Number of load jobs of HADOOP type in CANCELLED status

    Doris - BE

    Title
    Metric
    Unit
    Description
    Thrift utilization
    Broker
    count
    Number of thrifts used by broker
    Backend
    count
    Number of thrifts used by BE
    Extdatasource
    count
    Number of thrifts used by extdatasource
    Frontend
    count
    Number of thrifts used by FE
    Streaming load statistics
    RequestsTotal
    count
    Number of streaming load requests
    CurrentProcessing
    count
    Number of existing streaming load processes
    PipeCount
    count
    Number of streaming load pipes
    Streaming load time
    Duration
    ms
    Streaming load duration
    Streaming load data volume
    LoadTotal
    bytes
    Size of data imported by streaming load
    Fragment statistics
    PlanFragment
    count
    Number of plan fragments
    Endpoint
    count
    Number of DataStreams
    RequestsTotal
    count
    Number of fragment requests
    Fragment request duration
    Duration
    μs
    Fragment request duration
    BE memory
    Total
    bytes
    Size of BE memory pool
    Allocated
    bytes
    Size of allocated BE memory
    Maximum compaction score of tablet
    CumulativeMax
    score
    Maximum cumulative compaction score of tablet
    BaseMax
    score
    Maximum base compaction score of tablet
    Data handled by compaction
    Cumulative
    bytes
    Amount of data handled by cumulative compaction
    Base
    bytes
    Amount of data handled by base compaction
    Delta data handled by compaction
    Cumulative
    bytes
    Amount of delta data handled by cumulative compaction
    Base
    bytes
    Amount of delta data handled by base compaction
    MemPools used by compaction
    CurrentConsumption
    count
    Sum of MemPools used by compaction (all compaction threads)
    Process file handles
    Used
    count
    Number of file handles used by BE process
    SoftLimit
    count
    Soft limit on file handles for BE process
    HardLimit
    count
    Hard limit on file handles for BE process
    Running threads in process
    NUM
    count
    Number of threads running in BE process
    Engine request statistics
    FailedBaseCompaction
    count
    Number of failed engine requests of base_compaction type
    FailedCultCompt
    count
    Number of failed engine requests of cumulative_compaction type
    TotalBaseCompaction
    count
    Total number of engine requests of base_compaction type
    TotalCultCompt
    count
    Total number of engine requests of cumulative_compaction type

    Doris - BK

    Title
    Metric
    Unit
    Description
    GC count
    YGC
    -
    Young GC count
    FGC
    -
    Full GC count
    GC time
    FGCT
    s
    Full GC time
    GCT
    s
    Garbage collection time
    YGCT
    s
    Young GC time
    Memory zone proportion
    S0
    %
    Percentage of used Survivor 0 memory
    E
    %
    Percentage of used Eden memory
    CCS
    %
    Percentage of used compressed class space memory
    S1
    %
    Percentage of used Survivor 1 memory
    O
    %
    Percentage of used Old memory
    M
    %
    Percentage of used Metaspace memory
    JVM memory
    MemHeapUsedM
    MB
    Size of HeapMemory currently used by JVM
    MemHeapCommittedM
    MB
    Size of HeapMemory committed by JVM
    MemHeapMaxM
    MB
    Size of HeapMemory configured by JVM
    MemHeapInitM
    MB
    Size of initial JVM HeapMem
    MemNonHeapUsedM
    MB
    Size of NonHeapMemory currently used by JVM
    MemNonHeapCommittedM
    MB
    Size of NonHeapMemory currently committed by JVM
    MemNonHeapInitM
    MB
    Size of initial JVM NonHeapMem
    CPU utilization
    ProcessCpuLoad
    %
    CPU utilization
    File handles
    MaxFileDescriptorCount
    -
    Maximum number of file descriptors
    OpenFileDescriptorCount
    -
    Number of opened file descriptors
    CPU usage time
    ProcessCpuTime
    ms
    Cumulative CPU usage time
    Process execution duration
    Uptime
    s
    Process execution duration
    Worker threads
    ThreadCount
    -
    Number of threads
    PeakThreadCount
    -
    Peak number of threads
    DaemonThreadCount
    -
    Number of backend threads
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support