Elastic MapReduce
- Release Notes and Announcements
- Announcements
- Security Announcements
- Product Introduction
- Product release
- Purchase Guide
- EMR on CVM Billing Instructions
- EMR on TKE Billing Instructions
- EMR Serverless HBase Billing Instructions
- Getting Started
- EMR on CVM Operation Guide
- Planning Cluster
- Cross-AZ Cluster
- Configuring Cluster
- Administrative rights
- Managing Cluster
- Auto Scaling
- Disk Management
- Managing Service
- Configuration Management
- YARN Resource Scheduling
- Monitoring and Alarms
- Application Analysis
- Monitoring Metrics
- EMR on TKE Operation Guide
- Configuring Cluster
- Permission Management
- Cluster Management
- Service Management
- Configuration Management
- Monitoring and Ops
- Application Analysis
- EMR Serverless HBase Operation Guide
- Planning an Instance
- Managing an Instance
- Monitoring and Alarms
- Development Guide
- EMR Development Guide
- Hadoop Development Guide
- Spark Development Guide
- Hbase Development Guide
- Phoenix on Hbase Development Guide
- Hive Development Guide
- Basic Hive Operations
- Advanced Usage
- Presto Development Guide
- Sqoop Development Guide
- Hue Development Guide
- Flume Development Guide
- Kerberos Development Guide
- Knox Development Guide
- Alluxio Development Guide
- Kylin Development Guide
- Livy Development Guide
- Kyuubi Development Guide
- Zeppelin Development Guide
- Hudi Development Guide
- Superset Development Guide
- Impala Development Guide
- Druid Development Guide
- TensorFlow Development Guide
- Kudu Development Guide
- Ranger Development Guide
- Ranger User Guide
- Kafka Development Guide
- StarRocks Development Guide
- Flink Development Guide
- Practical Tutorial
- Practice of EMR on CVM Ops
- Data Migration
- Practical Tutorial on Custom Scaling
- Practical Tutorial on Setting Scaling Rules
- API Documentation
- Making API Requests
- Cluster Resource Management APIs
- Cluster Services APIs
- FAQs
- EMR on CVM
DocumentationElastic MapReduce EMR on CVM Operation GuideMonitoring and AlarmsMonitoring MetricsStarRocks Monitoring Metrics
StarRocks Monitoring Metrics
Last updated: 2023-12-27 15:00:50
StarRocks - BE
Title | Metric | Unit | Description |
Delta data handled by compaction | Cumulative | rowsets | Amount of delta data handled by cumulative compaction |
| Base | rowsets | Amount of delta data handled by base compaction |
| Update | rowsets | Amount of delta data handled by update compaction |
Data handled by compaction | Cumulative | bytes | Amount of data handled by cumulative compaction |
| Base | bytes | Amount of data handled by base compaction |
| Update | bytes | Amount of data handled by update compaction |
Maximum compaction score of tablet | CumulativeMax | score | Maximum cumulative compaction score of tablet |
| BaseMax | score | Maximum base compaction score of tablet |
Engine request failure statistics (1) | base_compaction | count | Number of failed engine requests of base_compaction type |
| clone | count | Number of failed engine requests of clone type |
| create_rollup | count | Number of failed engine requests of create_rollup type |
| create_tablet | count | Number of failed engine requests of create_tablet type |
| cumulative_compaction | count | Number of failed engine requests of cumulative_compaction type |
| delete | count | Number of failed engine requests of delete type |
| finish_task | count | Number of failed engine requests of finish_task type |
Engine request failure statistics (2) | publish | count | Number of failed engine requests of publish type |
| report_all_tablets | count | Number of failed engine requests of report_all_tablets type |
| report_disk | count | Number of failed engine requests of report_disk type |
| report_tablet | count | Number of failed engine requests of report_tablet type |
| report_task | count | Number of failed engine requests of report_task type |
| schema_change | count | Number of failed engine requests of schema_change type |
Engine request statistics (1) | base_compaction | count | Number of failed engine requests of base_compaction type |
| clone | count | Number of failed engine requests of clone type |
| create_rollup | count | Number of failed engine requests of create_rollup type |
| create_tablet | count | Number of failed engine requests of create_tablet type |
| cumulative_compaction | count | Number of failed engine requests of cumulative_compaction type |
| delete | count | Number of failed engine requests of delete type |
| drop_tablet | count | Number of failed engine requests of drop_tablet type |
| finish_task | count | Number of failed engine requests of finish_task type |
Engine request statistics (2) | publish | count | Number of failed engine requests of publish type |
| report_all_tablets | count | Number of failed engine requests of report_all_tablets type |
| report_disk | count | Number of failed engine requests of report_disk type |
| report_tablet | count | Number of failed engine requests of report_tablet type |
| report_task | count | Number of failed engine requests of report_task type |
| schema_change | count | Number of failed engine requests of schema_change type |
| storage_migrate | count | Number of failed engine requests of storage_migrate type |
Fragment statistics | PlanFragment | count | Number of plan fragments |
| Endpoint | count | Number of DataStreams |
Fragment request duration | Duration | μs | Fragment request duration |
Transaction request statistics | begin | count | Number of transaction requests of begin type |
| commit | count | Number of transaction requests of commit type |
| exec | count | Number of transaction requests of exec type |
| rollback | count | Number of transaction requests of rollback type |
Data imported by streaming load | LoadTotal | bytes | Amount of data imported by streaming load |
Streaming load statistics | CurrentProcessing | count | Number of existing streaming load processes |
| PipeCount | count | Number of streaming load pipes |
Streaming load duration | Duration | ms | Streaming load duration |
BE memory | Total | bytes | Size of BE memory pool |
| Allocated | bytes | Size of allocated BE memory |
Process file handles | Used | count | Number of file handles used by BE process |
| SoftLimit | count | Soft limit on file handles for BE process |
| HardLimit | count | Hard limit on file handles for BE process |
Running threads in process | Thread | count | Number of threads running in BE process |
Used thrifts | Broker | count | Number of thrifts used by broker |
| Backend | count | Number of thrifts used by BE |
| Frontend | count | Number of thrifts used by FE |
Tablet write statistics | Writer | count | Statistics of tablet writes on BE |
StarRocks - FE
Title | Metric | Unit | Description |
ALTER job statistics | RollupRunning | count | Number of running alter jobs of rollup type |
| SchemaChangeRunning | count | Number of running alter jobs of schema_change type |
Image statistics | Write | count | Number of image writes on FE |
| Push | count | Number of image pushes on FE |
Scheduled tablets | ScheduledTablet | count | Number of scheduled tablets on FE |
Transaction status statistics | Reject | count | Number of rejected transactions on FE |
| Begin | count | Number of started transactions on FE |
| Success | count | Number of successful transactions on FE |
| Failed | count | Number of failed transactions on FE |
Heap memory in JVM | max | bytes | Maximum amount of heap memory |
| committed | bytes | Amount of committed heap memory |
| used | bytes | Amount of used heap memory |
Non-heap memory in JVM | committed | bytes | Amount of committed non-heap memory |
| used | bytes | Amount of used non-heap memory |
Old memory in JVM | used | bytes | Amount of used old memory |
| peak_used | bytes | Maximum amount of used old memory |
| max | bytes | Maximum amount of old memory |
Young memory in JVM | used | bytes | Amount of used young memory |
| peak_used | bytes | Maximum amount of used young memory |
| max | bytes | Maximum amount of young memory |
Routine load queue size | report queue | count | Size of FE report queue |
Routine load rows | TotalRows | count | Number of FE routine load rows |
| ErrorRows | count | Number of FE routine load error rows |
Routine load size | Receive | bytes | Size of FE routine load |
Maximum compaction score of tablet | MAX | score | Maximum compaction score of FE tablet |
EditLog write latency | Quantile75 | ms | 75th percentile of the FE EditLog write latency |
| Quantile95 | ms | 95th percentile of the FE EditLog write latency |
| Quantile98 | ms | 98th percentile of the FE EditLog write latency |
| Quantile99 | ms | 99th percentile of the FE EditLog write latency |
| Quantile999 | ms | 99.9th percentile of the FE EditLog write latency |
GC count | YoungGC | count | FE node JVM Young GC count |
| OldGC | count | FE node JVM Old GC count |
GC time | YoungGC | Sec | FE node JVM Young GC time |
| OldGC | Sec | FE node JVM Old GC time |
JVM threads | Total | count | Total number of threads in the JVM of the FE node |
| Peak | count | Peak number of threads in the JVM of the FE node |
BROKER load job statistics | UNKNOWN | count | Number of load jobs of BROKER type in UNKNOWN status |
| PENDING | count | Number of load jobs of BROKER type in PENDING status |
| ETL | count | Number of load jobs of BROKER type in ETL status |
| LOADING | count | Number of load jobs of BROKER type in LOADING status |
| COMMITTED | count | Number of load jobs of BROKER type in COMMITTED status |
| FINISHED | count | Number of load jobs of BROKER type in FINISHED status |
| CANCELLED | count | Number of load jobs of BROKER type in CANCELLED status |
DELETE load job statistics | UNKNOWN | count | Number of load jobs of DELETE type in UNKNOWN status |
| PENDING | count | Number of load jobs of DELETE type in PENDING status |
| ETL | count | Number of load jobs of DELETE type in ETL status |
| LOADING | count | Number of load jobs of DELETE type in LOADING status |
| COMMITTED | count | Number of load jobs of DELETE type in COMMITTED status |
| FINISHED | count | Number of load jobs of DELETE type in FINISHED status |
| CANCELLED | count | Number of load jobs of DELETE type in CANCELLED status |
HADOOP load job statistics | UNKNOWN | count | Number of load jobs of HADOOP type in UNKNOWN status |
| PENDING | count | Number of load jobs of HADOOP type in PENDING status |
| ETL | count | Number of load jobs of HADOOP type in ETL status |
| LOADING | count | Number of load jobs of HADOOP type in LOADING status |
| COMMITTED | count | Number of load jobs of HADOOP type in COMMITTED status |
| FINISHED | count | Number of load jobs of HADOOP type in FINISHED status |
| CANCELLED | count | Number of load jobs of HADOOP type in CANCELLED status |
INSERT load job statistics | UNKNOWN | count | Number of load jobs of INSERT type in UNKNOWN status |
| PENDING | count | Number of load jobs of INSERT type in PENDING status |
| ETL | count | Number of load jobs of INSERT type in ETL status |
| LOADING | count | Number of load jobs of INSERT type in LOADING status |
| COMMITTED | count | Number of load jobs of INSERT type in COMMITTED status |
| FINISHED | count | Number of load jobs of INSERT type in FINISHED status |
| CANCELLED | count | Number of load jobs of INSERT type in CANCELLED status |
Routine load job statistics | NEED_SCHEDULE | count | Number of routine load jobs in NEED_SCHEDULE status |
| RUNNING | count | Number of routine load jobs in RUNNING status |
| PAUSED | count | Number of routine load jobs in PAUSED status |
| STOPPED | count | Number of routine load jobs in STOPPED status |
| CANCELLED | count | Number of routine load jobs in CANCELLED status |
SPARK load job statistics | UNKNOWN | count | Number of load jobs of SPARK type in UNKNOWN status |
| PENDING | count | Number of load jobs of SPARK type in PENDING status |
| ETL | count | Number of load jobs of SPARK type in ETL status |
| LOADING | count | Number of load jobs of SPARK type in LOADING status |
| COMMITTED | count | Number of load jobs of SPARK type in COMMITTED status |
| FINISHED | count | Number of load jobs of SPARK type in FINISHED status |
| CANCELLED | count | Number of load jobs of SPARK type in CANCELLED status |
FE MASTER | FE Master | count | Whether it is the FE master. Valid values: 1: Master; 0: Follower. |
Node information | FeNodeNum | count | Total number of FE nodes |
| BeNodeNum | count | Total number of BE nodes |
| BeAliveNum | count | Number of live BE nodes |
| BeDecommissionedNum | count | Number of live BE nodes |
| BkDeadNum | count | Number of dead broker nodes |
Request response | QPS | count/s | Number of queries per second |
| RPS | count/s | Number of requests that can be processed per second |
FE query statistics | total | count | Total number of FE queries |
| err | count | Total number of FE query errors |
| timeout | count | Number of timed-out FE queries |
| success | count | Total number of successful FE queries |
| slow | count | Total number of slow FE queries |
Query failure rate | ErrRate | % | Query error rate |
FE query latency | Quantile75 | ms | 75th percentile of the FE query latency |
| Quantile95 | ms | 95th percentile of the FE query latency |
| Quantile99 | ms | 99th percentile of the FE query latency |
| Quantile999 | ms | 99.9th percentile of the FE query latency |
Connections | Num | count | Number of FE node connections |
StarRocks - Broker
Title | Metric | Unit | Description |
CPU utilization | ProcessCpuLoad | % | Process CPU utilization |
CPU usage time | ProcessCpuTime | ms | Cumulative CPU usage time |
GC count | YGC | - | Young GC count |
| FGC | - | Full GC count |
GC time | GCT | s | Garbage collection time |
| FGCT | s | Full GC time |
| YGCT | s | Young GC time |
Memory zone proportion | O | % | Percentage of used Old memory |
| M | % | Percentage of used Metaspace memory |
| CCS | % | Percentage of used compressed class space memory |
| S0 | % | Percentage of used Survivor 0 memory |
| S1 | % | Percentage of used Survivor 1 memory |
| E | % | Percentage of used Eden memory |
JVM memory | MemHeapInitM | MB | Size of initial JVM HeapMemory |
| MemNonHeapInitM | MB | Size of initial JVM NonHeapMemory |
| MemHeapMaxM | MB | Size of HeapMemory configured by JVM |
| MemHeapCommittedM | MB | Size of HeapMemory currently committed by JVM |
| MemHeapUsedM | MB | Size of HeapMemory currently used by JVM |
| MemNonHeapCommittedM | MB | Size of NonHeapMemory currently committed by JVM |
| MemNonHeapUsedM | MB | Size of NonHeapMemory currently used by JVM |
File handles | OpenFileDescriptorCount | count | Number of opened file descriptors |
| MaxFileDescriptorCount | count | Maximum number of file descriptors |
Process execution duration | Uptime | s | Process execution duration |
Worker threads | PeakThreadCount | count | Peak number of threads |
| ThreadCount | count | Total number of threads |
| DaemonThreadCount | count | Number of Daemon threads |
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No