Tencent Cloud Observability Platform
- Release Notes and Announcements
- Product Introduction
- Purchase Guide
- Application Performance Management
- Pay-as-you-go (Postpaid)
- Packages (Prepaid)
- Mobile App Performance Monitoring
- Real User Monitoring
- Cloud Automated Testing
- Prometheus Monitoring
- Pay-as-You-Go (Postpaid)
- Quick Start
- EventBridge
- Cloud Product Monitoring
- Tencent Cloud Service Metrics
- Microservice
- Networking
- TencentDB
- TencentDB for Redis Monitoring Metrics
- CPM
- CDN And EdgeOne
- Operation Guide
- Cloud Monitoring Overview
- Monitoring View
- CM Connection to Grafana
- Troubleshooting
- Application Performance Management
- Access Guide
- Accessing Go Application
- Accessing Java Application
- Accessing Python Application
- Accessing Node.js Application
- Accessing PHP Application
- Accessing .NET Application
- Operation Guide
- Resource Management
- Application Monitoring
- Application Diagnosis
- Database Call Monitoring
- Access Management
- Alarm Service
- System Configuration
- Associate Logs
- Inject TraceID Into Logs
- Practical Tutorial
- Parameter Information
- APM Data Protocol Standard
- Mobile App Performance Monitoring
- Access Guide
- Android Use Cases
- iOS Use Cases
- Tencent Cloud Real User Monitoring
- Operation Guide
- Application Management
- Access Management
- Resource Tag
- Connection Guide
- Web Use Cases
- Cloud Automated Testing
- Operation Guide
- Creating Test Task
- Testing Statistics
- Access Management
- References
- Testing Nodes
- FAQs
- Performance Testing Service
- Operation Guide
- Performance Testing in Script Mode
- Script Examples
- HTTP-based Performance Testing
- Performance Testing in JMeter Mode
- Project Management
- Scenario Management
- Advanced Configuration
- Export Stress Test Indicators
- Traffic Recording
- Performance Testing Report
- Access Control
- Alarm Management
- Tag Management
- Practice Tutorial
- JavaScript API List
- pts/http
- Response
- pts/dataset
- pts/grpc
- pts/jsonpath
- pts/redis
- pts/url
- URL
- pts/util
- pts/ws
- pts/socketio
- socketio
- pts/socket
- Prometheus Monitoring
- Product Introduction
- Access Guide
- EMR Integration
- Java Application Integration
- Exporter Integration
- Operation Guide
- Instance
- Recording Rule
- Alerting Rule
- Access Control
- TKE Metrics
- Practical Tutorial
- Terraform
- Grafana
- Operation Guide
- Instance
- Tencent Cloud Service Integration
- Plugin Management
- Dashboard
- Operation Guide
- Configuring Dashboard
- Monitoring Charts
- Creating Chart
- Use Cases of Different Chart Types
- Alarm Management
- Console Operation Guide
- Alarm Policy
- Configuring alert trigger conditions
- Alarm Notification
- Alarm Callback
- Alarm Receiving Channels and SMS Quota
- Dynamic Threshold Alarm
- Silencing Alarm
- EventBridge
- Product Introduction
- Practical Tutorial
- Migrating Event Alarm
- FAQs
- Related Agreements
- API Documentation
- Making API Requests
- Monitoring Data Query APIs
- Alarm APIs
- Notification Template APIs
- Legacy Alert APIs
- Prometheus Service APIs
- Grafana Service APIs
- Event Center APIs
- TencentCloud Managed Service for Prometheus APIs
- Monitoring APIs
DocumentationTencent Cloud Observability PlatformCloud Product MonitoringTencent Cloud Service MetricsData AnalysisEMREMR (YARN)
EMR (YARN)
Last updated: 2024-01-27 17:52:39
Namespace
Namespace=QCE/TXMR_YARN
Monitoring Metrics
YARN - Overview
Parameter | Metric | Unit | Description | Dimension |
EmrHdfsOverview YarnRmNumsNumactivenms | Number of nodes_NumActiveNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
EmrHdfsOverview YarnRmNumsNumde commissionednms | Number of nodes_NumDecommissionedNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
EmrHdfsOverviewYarn RmNumsNumlostnms | Number of nodes_NumLostNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
EmrHdfsOverview YarnRmNumsNumun healthynms | Number of nodes_NumUnhealthyNMs | - | Number of nodes | host4yarnoverview, id4yarnoverview |
YARN - OverviewAggregation
Parameter | Metric | Unit | Description | Dimension |
EmrHdfsOverviewAggregation YarnRmNumsNumactivenms | Number of nodes_NumActiveNMs | - | Number of nodes | id4yarnoverview |
EmrHdfsOverviewAggregation YarnRmNumsNumde commissionednms | Number of nodes_NumDecommissionedNMs | - | Number of nodes | id4yarnoverview |
EmrHdfsOverviewAggregation RmNumsNumlostnms | Number of nodes_NumLostNMs | - | Number of nodes | id4yarnoverview |
EmrHdfsOverviewAggregation YarnRmNumsNumun healthynms | Number of nodes_NumUnhealthyNMs | - | Number of nodes | id4yarnoverview |
YARN - Cluster
Parameter | Metric | Unit | Description | Dimension |
YarnClusterResAppFailed | Applications_failed | - | Total number of applications | host4yarnoverview, id4yarnoverview |
YarnClusterResAppKilled | Applications_killed | - | Total number of applications | host4yarnoverview, id4yarnoverview |
YarnClusterResAppPending | Applications_pending | - | Total number of applications | host4yarnoverview, id4yarnoverview |
YarnClusterResAppRunning | Applications_running | - | Total number of applications | host4yarnoverview, id4yarnoverview |
YarnClusterRes AppSubmitted | Applications_submitted | - | Total number of applications | host4yarnoverview, id4yarnoverview |
YarnClusterResContainer Containersallocated | Containers_containersAllocated | - | Total number of released containers | host4yarnoverview, id4yarnoverview |
YarnClusterResContainer Containerspending | Containers_containersPending | - | Total number of released containers | host4yarnoverview, id4yarnoverview |
YarnClusterResContainer Containersreserved | Containers_containersReserved | - | Total number of released containers | host4yarnoverview, id4yarnoverview |
YarnClusterResCpu Allocatedvirtualcores | Cores_allocatedVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
YarnClusterResCpu Availablevirtualcores | Cores_availableVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
YarnClusterResCpu Reservedvirtualcores | Cores_reservedVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
YarnClusterResCpu Totalvirtualcores | Cores_totalVirtualCores | - | Number of CPU cores | host4yarnoverview, id4yarnoverview |
YarnClusterResCpu UsageRatioUsageratio | CPU utilization_usageRatio | % | Memory size | host4yarnoverview, id4yarnoverview |
YarnClusterResMem Allocatedmb | Memory_allocatedMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
YarnClusterResMem Availablemb | Memory_availableMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
YarnClusterResMem Reservedmb | Memory_reservedMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
YarnClusterRes MemTotalmb | Memory_totalMB | MB | Memory size | host4yarnoverview, id4yarnoverview |
YarnClusterResMem UsageRatioUsageratio | Memory utilization_usageRatio | % | Memory size | host4yarnoverview, id4yarnoverview |
YARN - ResourceManager
Parameter | Metric | Unit | Description | Dimension |
YarnRmRpcAuth5000 Rpcauthenticationfailures | Number of RPC authentication authorizations_RpcAuthenticationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthenticationsuccesses | Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationfailures | Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationsuccesses | Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Receivedbytes | Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Sentbytes | Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpc Connections5000 Numopenconnections | Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcprocessingtimenumops | Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcqueuetimenumops | Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcQueueLen5000 Callqueuelength | RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcprocessingtimeavgtime | Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcqueuetimeavgtime | Average RPC processing time_RpcQueueTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthenticationfailures | Number of RPC authentication authorizations_RpcAuthenticationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthenticationsuccesses | Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationfailures | Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationsuccesses | Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Receivedbytes | Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Sentbytes | Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcConnections5000 Numopenconnections | Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcprocessingtimenumops | Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcqueuetimenumops | Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcQueueLen5000 Callqueuelength | RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcprocessingtimeavgtime | Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcqueuetimeavgtime | Average RPC processing time_RpcQueueTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthenticationfailures | Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthenticationsuccesses | Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationfailures | Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationsuccesses | Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Receivedbytes | Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Sentbytes | Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcConnections5000 Numopenconnections | Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcprocessingtimenumops | Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcqueuetimenumops | Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcQueueLen5000 Callqueuelength | RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcprocessingtimeavgtime | Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcqueuetimeavgtime | Average RPC processing time_RpcQueueTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthenticationfailures | Number of RPC authentication authorizations_RpcAuthenticationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthenticationsuccesses | Number of RPC authentication authorizations_RpcAuthenticationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationfailures | Number of RPC authentication authorizations_RpcAuthorizationFailures | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcAuth5000 Rpcauthorizationsuccesses | Number of RPC authentication authorizations_RpcAuthorizationSuccesses | - | Number of RPC authentication authorizations | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Receivedbytes | Volume of data received/sent by RPC_ReceivedBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcBytes5000 Sentbytes | Volume of data received/sent by RPC_SentBytes | bytes/s | Volume of data received/sent by RPC | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpc Connections5000 Numopenconnections | Number of RPC connections_NumOpenConnections | - | Number of RPC connections | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcprocessingtimenumops | Number of RPC requests_RpcProcessingTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcOps5000 Rpcqueuetimenumops | Number of RPC requests_RpcQueueTimeNumOps | - | Number of RPC requests | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpc QueueLen5000 Callqueuelength | RPC queue length_CallQueueLength | - | RPC queue length | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcprocessingtimeavgtime | Average RPC processing time_RpcProcessingTimeAvgTime | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRpcTime5000 Rpcqueuetimeavgtime | GC count_YGC | s | Average RPC processing time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilGcCountYgc | GC count_FGC | - | GC count | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilGcCountFgc | GC time_FGCT | - | GC count | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilGcTimeFgct | GC time_FGCT | s | GC time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilGcTimeGct | GC time_YGCT | s | GC time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilGcTimeYgct | Memory space percentage_S0 | s | GC time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilMemoryS0 | Memory space percentage_E | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilMemoryE | Memory space percentage_CCS | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilMemoryCcs | Memory space percentage_S1 | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilMemoryS1 | Memory space percentage_O | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilMemoryO | Memory space percentage_M | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmGcUtilMemoryM | Number of JVM threads_ThreadsNew | % | Memory space percentage | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmJava ThreadsThreadsnew | Number of JVM threads_ThreadsRunnable | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmJavaThreads Threadsrunnable | Number of JVM threads_ThreadsBlocked | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmJavaThreads Threadsblocked | Number of JVM threads_ThreadsWaiting | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmJavaThreads Threadswaiting | Number of JVM threads_ThreadsTimedWaiting | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmJavaThreads Threadstimedwaiting | Number of JVM threads_ThreadsTerminated | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmJavaThreads Threadsterminated | Number of JVM logs_LogFatal | - | Number of JVM threads | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmLogTotalLogfatal | Number of JVM logs_LogError | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmLogTotalLogerror | Number of JVM logs_LogWarn | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmLogTotalLogwarn | Number of JVM logs_LogInfo | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmLogTotalLoginfo | JVM memory_MemNonHeapUsedM | - | Number of JVM logs | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmMem Memnonheapusedm | JVM memory_MemNonHeapCommittedM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmMemMem nonheapcommittedm | JVM memory_MemHeapUsedM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmMemMem heapusedm | JVM memory_MemHeapCommittedM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmMemMem heapcommittedm | JVM memory_MemHeapMaxM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmMem Memheapmaxm | JVM memory_MemMaxM | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmJvmMemMemmaxm | CPU utilization_ProcessCpuLoad | MB | JVM memory | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmOsCpuLoad Processcpuload | Cumulative CPU usage time_ProcessCpuTime | % | CPU utilization | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmOsCpuTime Processcputime | Number of file descriptors_MaxFileDescriptorCount | ms | Cumulative CPU usage time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmOsFdCount Maxfiledescriptorcount | Number of file descriptors_OpenFileDescriptorCount | - | Number of file descriptors | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmOsFdCount Openfiledescriptorcount | Process run time_Uptime | - | Number of file descriptors | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmRtUptimeUptime | Process run time_Uptime | s | Process run time | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmThreadCount Daemonthreadcount | Number of worker threads_DaemonThreadCount | - | Number of worker threads | host4yarnresourcemanager, id4yarnresourcemanager |
YarnRmThreadCount Threadcount | Number of worker threads_ThreadCount | - | Number of worker threads | host4yarnresourcemanager, id4yarnresourcemanager |
YARN - JobHistoryServer
Parameter | Metric | Unit | Description | Dimension |
YarnJhJvmJava ThreadsThreadsnew | Number of JVM threads_ThreadsNew | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmJava ThreadsThreadsrunnable | Number of JVM threads_ThreadsRunnable | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmJava ThreadsThreadsblocked | Number of JVM threads_ThreadsBlocked | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmJava ThreadsThreadswaiting | Number of JVM threads_ThreadsWaiting | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmJava ThreadsThreadstimedwaiting | Number of JVM threads_ThreadsTimedWaiting | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmJava ThreadsThreadsterminated | Number of JVM threads_ThreadsTerminated | - | Number of JVM threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmLogTotalLogfatal | Number of JVM logs_LogFatal | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmLogTotalLogerror | Number of JVM logs_LogError | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmLogTotalLogwarn | Number of JVM logs_LogWarn | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmLogTotalLoginfo | Number of JVM logs_LogInfo | - | Number of JVM logs | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmMemMem nonheapusedm | JVM memory_MemNonHeapUsedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmMemMem nonheapcommittedm | JVM memory_MemNonHeapCommittedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmMemMem heapusedm | JVM memory_MemHeapUsedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmMemMem heapcommittedm | JVM memory_MemHeapCommittedM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmMemMem heapmaxm | JVM memory_MemHeapMaxM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhJvmMemMem maxm | JVM memory_MemMaxM | MB | JVM memory | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilGcCountYgc | GC count_YGC | - | GC count | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilGcCountFgc | GC count_FGC | - | GC count | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilGcTimeFgct | GC time_FGCT | s | GC time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilGcTimeGct | GC time_FGCT | s | GC time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilGcTimeYgct | GC time_YGCT | s | GC time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilMemoryS0 | Memory space percentage_S0 | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilMemoryE | Memory space percentage_E | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilMemoryCcs | Memory space percentage_CCS | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilMemoryS1 | Memory space percentage_S1 | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilMemoryO | Memory space percentage_O | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhsGcUtilMemoryM | Memory space percentage_M | % | Memory space percentage | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhOsCpuLoad Processcpuload | CPU utilization_ProcessCpuLoad | % | CPU utilization | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhOsCpuTime Processcputime | Cumulative CPU usage time_ProcessCpuTime | ms | Cumulative CPU usage time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhOsFdCountMax filedescriptorcount | Number of file descriptors_MaxFileDescriptorCount | - | Number of file descriptors | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhOsFdCountOpen filedescriptorcount | Number of file descriptors_OpenFileDescriptorCount | - | Number of file descriptors | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhRtUptimeUptime | Process run time_Uptime | s | Process run time | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhThreadCount Daemonthreadcount | Number of worker threads_DaemonThreadCount | - | Number of worker threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YarnJhThreadCount Threadcount | Number of worker threads_ThreadCount | - | Number of worker threads | host4yarnjobhistoryserver, id4yarnjobhistoryserver |
YARN - NodeManager
Parameter | Metric | Unit | Description | Dimension |
YarnNmGcUtilGcCountYgc | GC count_YGC | - | GC count | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilGcCountFgc | GC count_FGC | - | GC count | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilGcTimeFgct | GC time_FGCT | s | GC time | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilGcTimeGct | GC time_FGCT | s | GC time | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilGcTimeYgct | GC time_YGCT | s | GC time | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilMemoryS0 | Memory space percentage_S0 | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilMemoryE | Memory space percentage_E | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilMemoryCcs | Memory space percentage_CCS | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilMemoryS1 | Memory space percentage_S1 | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilMemoryO | Memory space percentage_O | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
YarnNmGcUtilMemoryM | Memory space percentage_M | % | Memory space percentage | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmJavaThreads Threadsnew | Number of JVM threads_ThreadsNew | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmJavaThreads Threadsrunnable | Number of JVM threads_ThreadsRunnable | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmJavaThreads Threadsblocked | Number of JVM threads_ThreadsBlocked | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmJavaThreads Threadswaiting | Number of JVM threads_ThreadsWaiting | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmJavaThreads Threadstimedwaiting | Number of JVM threads_ThreadsTimedWaiting | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmJavaThreads Threadsterminated | Number of JVM threads_ThreadsTerminated | - | Number of JVM threads | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmLog TotalLogfatal | Number of JVM logs_LogFatal | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmLog TotalLogerror | Number of JVM logs_LogError | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmLog TotalLogwarn | Number of JVM logs_LogWarn | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmLog TotalLoginfo | Number of JVM logs_LogInfo | - | Number of JVM logs | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmMem Memnonheapusedm | JVM memory_MemNonHeapUsedM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmMem Memnonheapcommittedm | JVM memory_MemNonHeapCommittedM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmMemMem heapusedm | JVM memory_MemHeapUsedM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmMemMem heapcommittedm | JVM memory_MemHeapCommittedM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmMem Memheapmaxm | JVM memory_MemHeapMaxM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
YarnNmJvmMem Memmaxm | JVM memory_MemMaxM | MB | JVM memory | id4yarnnodemanager, host4yarnnodemanager |
YarnNmVcores Availablevcores | Number of CPU cores_AvailableVCores | - | Number of CPU cores | id4yarnnodemanager, host4yarnnodemanager |
YarnNmVcores Allocatedvcores | Number of CPU cores_AllocatedVCores | - | Number of CPU cores | id4yarnnodemanager, host4yarnnodemanager |
YarnNmMemAllocatedgb | Memory size_AllocatedGB | GB | Memory size | id4yarnnodemanager, host4yarnnodemanager |
YarnNmMemAvailablegb | Memory size_AvailableGB | GB | Memory size | id4yarnnodemanager, host4yarnnodemanager |
YarnNmOsCpuLoad Processcpuload | CPU utilization_ProcessCpuLoad | % | CPU utilization | id4yarnnodemanager, host4yarnnodemanager |
YarnNmOsCpuTime Processcputime | Cumulative CPU usage time_ProcessCpuTime | ms | Cumulative CPU usage time | id4yarnnodemanager, host4yarnnodemanager |
YarnNmOsFdCount Maxfiledescriptorcount | Number of file descriptors_MaxFileDescriptorCount | - | Number of file descriptors | id4yarnnodemanager, host4yarnnodemanager |
YarnNmOsFdCount Openfiledescriptorcount | Number of file descriptors_OpenFileDescriptorCount | - | Number of file descriptors | id4yarnnodemanager, host4yarnnodemanager |
YarnNmRtUptimeUptime | Process run time_Uptime | s | Process run time | id4yarnnodemanager, host4yarnnodemanager |
YarnNmThreadCount Daemonthreadcount | Number of worker threads_DaemonThreadCount | - | Number of worker threads | id4yarnnodemanager, host4yarnnodemanager |
YarnNmThread CountThreadcount | Number of worker threads_ThreadCount | - | Number of worker threads | id4yarnnodemanager, host4yarnnodemanager |
Dimension and Parameters
Parameter | Dimension | Dimension Description | Format |
Instances.N.Dimensions.0.Name | id4yarnoverview | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnoverview |
Instances.N.Dimensions.0.Value | id4yarnoverview | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
Instances.N.Dimensions.1.Name | host4yarnoverview | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnoverview |
Instances.N.Dimensions.1.Value | host4yarnoverview | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
Instances.N.Dimensions.0.Name | id4yarnresourcemanager | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnresourcemanager |
Instances.N.Dimensions.0.Value | id4yarnresourcemanager | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
Instances.N.Dimensions.1.Name | host4yarnresourcemanager | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnresourcemanager |
Instances.N.Dimensions.1.Value | host4yarnresourcemanager | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
Instances.N.Dimensions.0.Name | id4yarnjobhistoryserver | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnjobhistoryserver |
Instances.N.Dimensions.0.Value | id4yarnjobhistoryserver | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
Instances.N.Dimensions.1.Name | host4yarnjobhistoryserver | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnjobhistoryserver |
Instances.N.Dimensions.1.Value | host4yarnjobhistoryserver | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
Instances.N.Dimensions.0.Name | id4yarnnodemanager | Dimension name of the EMR instance ID | String-type dimension name, such as id4yarnnodemanager |
Instances.N.Dimensions.0.Value | id4yarnnodemanager | Specific EMR instance ID | Specific EMR instance ID, such as emr-mm8bs222 |
Instances.N.Dimensions.1.Name | host4yarnnodemanager | Dimension name of the node IP in the EMR instance | String-type dimension name, such as host4yarnnodemanager |
Instances.N.Dimensions.1.Value | host4yarnnodemanager | Specific node IP in the EMR instance | Specific node IP, which can be obtained by clicking Instance > Cluster Resources > Resource Management > Node Private IP in the EMR console or calling the DescribeClusterNodes API. |
Input Parameter Description
EMR (YARN) supports querying monitoring data based on the following five combinations of dimensions. The values for the input parameters are as follows:
1. To query the metric monitoring data of Yarn - Overview Aggregation or YARN - Cluster, use the following input parameters: &Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnoverview
&Instances.N.Dimensions.0.Value=EMR instance ID
2. To query the metric monitoring data of Yarn - Overview, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnoverview
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnoverview
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
3. To query the metric monitoring data of YARN - ResourceManager, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnresourcemanager
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnresourcemanager
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
4. To query the metric monitoring data of YARN - JobHistoryServer, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnjobhistoryserver
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnjobhistoryserver
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
5. To query the metric monitoring data of YARN - NodeManager, use the following input parameters:
&Namespace=QCE/TXMR_YARN
&Instances.N.Dimensions.0.Name=id4yarnnodemanager
&Instances.N.Dimensions.0.Value=EMR instance ID
&Instances.N.Dimensions.1.Name=host4yarnnodemanager
&Instances.N.Dimensions.1.Value=Specific node IP in the EMR instance
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No