tencent cloud

Feedback

StarRocks Monitoring Metrics

Last updated: 2023-12-27 15:00:50

    StarRocks - BE

    Title
    Metric
    Unit
    Description
    Delta data handled by compaction
    Cumulative
    rowsets
    Amount of delta data handled by cumulative compaction
    Base
    rowsets
    Amount of delta data handled by base compaction
    Update
    rowsets
    Amount of delta data handled by update compaction
    Data handled by compaction
    Cumulative
    bytes
    Amount of data handled by cumulative compaction
    Base
    bytes
    Amount of data handled by base compaction
    Update
    bytes
    Amount of data handled by update compaction
    Maximum compaction score of tablet
    CumulativeMax
    score
    Maximum cumulative compaction score of tablet
    BaseMax
    score
    Maximum base compaction score of tablet
    Engine request failure statistics (1)
    base_compaction
    count
    Number of failed engine requests of base_compaction type
    clone
    count
    Number of failed engine requests of clone type
    create_rollup
    count
    Number of failed engine requests of create_rollup type
    create_tablet
    count
    Number of failed engine requests of create_tablet type
    cumulative_compaction
    count
    Number of failed engine requests of cumulative_compaction type
    delete
    count
    Number of failed engine requests of delete type
    finish_task
    count
    Number of failed engine requests of finish_task type
    Engine request failure statistics (2)
    publish
    count
    Number of failed engine requests of publish type
    report_all_tablets
    count
    Number of failed engine requests of report_all_tablets type
    report_disk
    count
    Number of failed engine requests of report_disk type
    report_tablet
    count
    Number of failed engine requests of report_tablet type
    report_task
    count
    Number of failed engine requests of report_task type
    schema_change
    count
    Number of failed engine requests of schema_change type
    Engine request statistics (1)
    base_compaction
    count
    Number of failed engine requests of base_compaction type
    clone
    count
    Number of failed engine requests of clone type
    create_rollup
    count
    Number of failed engine requests of create_rollup type
    create_tablet
    count
    Number of failed engine requests of create_tablet type
    cumulative_compaction
    count
    Number of failed engine requests of cumulative_compaction type
    delete
    count
    Number of failed engine requests of delete type
    drop_tablet
    count
    Number of failed engine requests of drop_tablet type
    finish_task
    count
    Number of failed engine requests of finish_task type
    Engine request statistics (2)
    publish
    count
    Number of failed engine requests of publish type
    report_all_tablets
    count
    Number of failed engine requests of report_all_tablets type
    report_disk
    count
    Number of failed engine requests of report_disk type
    report_tablet
    count
    Number of failed engine requests of report_tablet type
    report_task
    count
    Number of failed engine requests of report_task type
    schema_change
    count
    Number of failed engine requests of schema_change type
    storage_migrate
    count
    Number of failed engine requests of storage_migrate type
    Fragment statistics
    PlanFragment
    count
    Number of plan fragments
    Endpoint
    count
    Number of DataStreams
    Fragment request duration
    Duration
    μs
    Fragment request duration
    Transaction request statistics
    begin
    count
    Number of transaction requests of begin type
    commit
    count
    Number of transaction requests of commit type
    exec
    count
    Number of transaction requests of exec type
    rollback
    count
    Number of transaction requests of rollback type
    Data imported by streaming load
    LoadTotal
    bytes
    Amount of data imported by streaming load
    Streaming load statistics
    CurrentProcessing
    count
    Number of existing streaming load processes
    PipeCount
    count
    Number of streaming load pipes
    Streaming load duration
    Duration
    ms
    Streaming load duration
    BE memory
    Total
    bytes
    Size of BE memory pool
    Allocated
    bytes
    Size of allocated BE memory
    Process file handles
    Used
    count
    Number of file handles used by BE process
    SoftLimit
    count
    Soft limit on file handles for BE process
    HardLimit
    count
    Hard limit on file handles for BE process
    Running threads in process
    Thread
    count
    Number of threads running in BE process
    Used thrifts
    Broker
    count
    Number of thrifts used by broker
    Backend
    count
    Number of thrifts used by BE
    Frontend
    count
    Number of thrifts used by FE
    Tablet write statistics
    Writer
    count
    Statistics of tablet writes on BE

    StarRocks - FE

    Title
    Metric
    Unit
    Description
    ALTER job statistics
    RollupRunning
    count
    Number of running alter jobs of rollup type
    SchemaChangeRunning
    count
    Number of running alter jobs of schema_change type
    Image statistics
    Write
    count
    Number of image writes on FE
    Push
    count
    Number of image pushes on FE
    Scheduled tablets
    ScheduledTablet
    count
    Number of scheduled tablets on FE
    Transaction status statistics
    Reject
    count
    Number of rejected transactions on FE
    Begin
    count
    Number of started transactions on FE
    Success
    count
    Number of successful transactions on FE
    Failed
    count
    Number of failed transactions on FE
    Heap memory in JVM
    max
    bytes
    Maximum amount of heap memory
    committed
    bytes
    Amount of committed heap memory
    used
    bytes
    Amount of used heap memory
    Non-heap memory in JVM
    committed
    bytes
    Amount of committed non-heap memory
    used
    bytes
    Amount of used non-heap memory
    Old memory in JVM
    used
    bytes
    Amount of used old memory
    peak_used
    bytes
    Maximum amount of used old memory
    max
    bytes
    Maximum amount of old memory
    Young memory in JVM
    used
    bytes
    Amount of used young memory
    peak_used
    bytes
    Maximum amount of used young memory
    max
    bytes
    Maximum amount of young memory
    Routine load queue size
    report queue
    count
    Size of FE report queue
    Routine load rows
    TotalRows
    count
    Number of FE routine load rows
    ErrorRows
    count
    Number of FE routine load error rows
    Routine load size
    Receive
    bytes
    Size of FE routine load
    Maximum compaction score of tablet
    MAX
    score
    Maximum compaction score of FE tablet
    EditLog write latency
    Quantile75
    ms
    75th percentile of the FE EditLog write latency
    Quantile95
    ms
    95th percentile of the FE EditLog write latency
    Quantile98
    ms
    98th percentile of the FE EditLog write latency
    Quantile99
    ms
    99th percentile of the FE EditLog write latency
    Quantile999
    ms
    99.9th percentile of the FE EditLog write latency
    GC count
    YoungGC
    count
    FE node JVM Young GC count
    OldGC
    count
    FE node JVM Old GC count
    GC time
    YoungGC
    Sec
    FE node JVM Young GC time
    OldGC
    Sec
    FE node JVM Old GC time
    JVM threads
    Total
    count
    Total number of threads in the JVM of the FE node
    Peak
    count
    Peak number of threads in the JVM of the FE node
    BROKER load job statistics
    UNKNOWN
    count
    Number of load jobs of BROKER type in UNKNOWN status
    PENDING
    count
    Number of load jobs of BROKER type in PENDING status
    ETL
    count
    Number of load jobs of BROKER type in ETL status
    LOADING
    count
    Number of load jobs of BROKER type in LOADING status
    COMMITTED
    count
    Number of load jobs of BROKER type in COMMITTED status
    FINISHED
    count
    Number of load jobs of BROKER type in FINISHED status
    CANCELLED
    count
    Number of load jobs of BROKER type in CANCELLED status
    DELETE load job statistics
    UNKNOWN
    count
    Number of load jobs of DELETE type in UNKNOWN status
    PENDING
    count
    Number of load jobs of DELETE type in PENDING status
    ETL
    count
    Number of load jobs of DELETE type in ETL status
    LOADING
    count
    Number of load jobs of DELETE type in LOADING status
    COMMITTED
    count
    Number of load jobs of DELETE type in COMMITTED status
    FINISHED
    count
    Number of load jobs of DELETE type in FINISHED status
    CANCELLED
    count
    Number of load jobs of DELETE type in CANCELLED status
    HADOOP load job statistics
    UNKNOWN
    count
    Number of load jobs of HADOOP type in UNKNOWN status
    PENDING
    count
    Number of load jobs of HADOOP type in PENDING status
    ETL
    count
    Number of load jobs of HADOOP type in ETL status
    LOADING
    count
    Number of load jobs of HADOOP type in LOADING status
    COMMITTED
    count
    Number of load jobs of HADOOP type in COMMITTED status
    FINISHED
    count
    Number of load jobs of HADOOP type in FINISHED status
    CANCELLED
    count
    Number of load jobs of HADOOP type in CANCELLED status
    INSERT load job statistics
    UNKNOWN
    count
    Number of load jobs of INSERT type in UNKNOWN status
    PENDING
    count
    Number of load jobs of INSERT type in PENDING status
    ETL
    count
    Number of load jobs of INSERT type in ETL status
    LOADING
    count
    Number of load jobs of INSERT type in LOADING status
    COMMITTED
    count
    Number of load jobs of INSERT type in COMMITTED status
    FINISHED
    count
    Number of load jobs of INSERT type in FINISHED status
    CANCELLED
    count
    Number of load jobs of INSERT type in CANCELLED status
    Routine load job statistics
    NEED_SCHEDULE
    count
    Number of routine load jobs in NEED_SCHEDULE status
    RUNNING
    count
    Number of routine load jobs in RUNNING status
    PAUSED
    count
    Number of routine load jobs in PAUSED status
    STOPPED
    count
    Number of routine load jobs in STOPPED status
    CANCELLED
    count
    Number of routine load jobs in CANCELLED status
    SPARK load job statistics
    UNKNOWN
    count
    Number of load jobs of SPARK type in UNKNOWN status
    PENDING
    count
    Number of load jobs of SPARK type in PENDING status
    ETL
    count
    Number of load jobs of SPARK type in ETL status
    LOADING
    count
    Number of load jobs of SPARK type in LOADING status
    COMMITTED
    count
    Number of load jobs of SPARK type in COMMITTED status
    FINISHED
    count
    Number of load jobs of SPARK type in FINISHED status
    CANCELLED
    count
    Number of load jobs of SPARK type in CANCELLED status
    FE MASTER
    FE Master
    count
    Whether it is the FE master. Valid values: 1: Master; 0: Follower.
    Node information
    FeNodeNum
    count
    Total number of FE nodes
    BeNodeNum
    count
    Total number of BE nodes
    BeAliveNum
    count
    Number of live BE nodes
    BeDecommissionedNum
    count
    Number of live BE nodes
    BkDeadNum
    count
    Number of dead broker nodes
    Request response
    QPS
    count/s
    Number of queries per second
    RPS
    count/s
    Number of requests that can be processed per second
    FE query statistics
    total
    count
    Total number of FE queries
    err
    count
    Total number of FE query errors
    timeout
    count
    Number of timed-out FE queries
    success
    count
    Total number of successful FE queries
    slow
    count
    Total number of slow FE queries
    Query failure rate
    ErrRate
    %
    Query error rate
    FE query latency
    Quantile75
    ms
    75th percentile of the FE query latency
    Quantile95
    ms
    95th percentile of the FE query latency
    Quantile99
    ms
    99th percentile of the FE query latency
    Quantile999
    ms
    99.9th percentile of the FE query latency
    Connections
    Num
    count
    Number of FE node connections

    StarRocks - Broker

    Title
    Metric
    Unit
    Description
    CPU utilization
    ProcessCpuLoad
    %
    Process CPU utilization
    CPU usage time
    ProcessCpuTime
    ms
    Cumulative CPU usage time
    GC count
    YGC
    -
    Young GC count
    FGC
    -
    Full GC count
    GC time
    GCT
    s
    Garbage collection time
    FGCT
    s
    Full GC time
    YGCT
    s
    Young GC time
    Memory zone proportion
    O
    %
    Percentage of used Old memory
    M
    %
    Percentage of used Metaspace memory
    CCS
    %
    Percentage of used compressed class space memory
    S0
    %
    Percentage of used Survivor 0 memory
    S1
    %
    Percentage of used Survivor 1 memory
    E
    %
    Percentage of used Eden memory
    JVM memory
    MemHeapInitM
    MB
    Size of initial JVM HeapMemory
    MemNonHeapInitM
    MB
    Size of initial JVM NonHeapMemory
    MemHeapMaxM
    MB
    Size of HeapMemory configured by JVM
    MemHeapCommittedM
    MB
    Size of HeapMemory currently committed by JVM
    MemHeapUsedM
    MB
    Size of HeapMemory currently used by JVM
    MemNonHeapCommittedM
    MB
    Size of NonHeapMemory currently committed by JVM
    MemNonHeapUsedM
    MB
    Size of NonHeapMemory currently used by JVM
    File handles
    OpenFileDescriptorCount
    count
    Number of opened file descriptors
    MaxFileDescriptorCount
    count
    Maximum number of file descriptors
    Process execution duration
    Uptime
    s
    Process execution duration
    Worker threads
    PeakThreadCount
    count
    Peak number of threads
    ThreadCount
    count
    Total number of threads
    DaemonThreadCount
    count
    Number of Daemon threads
    
    Contact Us

    Contact our sales team or business advisors to help your business.

    Technical Support

    Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

    7x24 Phone Support