Execution Resource Group - Scheduling Resource Group, supports creation, editing, operation and maintenance scheduling resource groups. Scheduling resource groups are divided into standard scheduling resource groups and custom Definition scheduling resource groups.
Create Standard Scheduling Resource Group
Configure the resource group on the resource group purchase page, set up billing, and associate with projects to complete the creation of the resource group.
Parameter
Description
Region
The physical region to which the resource group belongs. The region where the scheduling resource group is located, where cloud products in different regions do not have inter-network connectivity. Once created, the region cannot be changed, so please choose carefully; it is recommended to select the same region as the product version to reduce service access latency
Network
Specify the VPC and subnet information that need to be configured for the current resource group. The VPC selected for scheduling resources must have public internet access capability. If the existing network is not suitable, you can go to the console to create a new VPC or subnet
Specification
The specifications of a single resource pack include the number of cores and memory
Quantity
Total number of resource packages contained in the resource group
Resource Group Name
Set the display name of the resource group. Names cannot be empty and support Chinese, English, numbers, -, _
Description(Optional)
Set remark information for the current resource group
Billing mode
Monthly subscription
Purchase period
Supports 1 month, 2 months, 3 months, 4 months, 5 months, 6 months, 7 months, 8 months, 9 months, 1 year, 2 years, 3 years, 4 years purchase duration
Renewal
After selecting auto-renewal, if the account balance is sufficient, the equipment will be automatically renewed monthly after expiration
Associated Project
After associating with the project space, only tasks within this project can use this resource group to run. This can be modified later in the product console.
After finishing the configuration, click Purchase Now and complete the payment to go to the console page to view the scheduling resource group information.
Create Custom Definition Scheduling Resource Group
Create Custom Definition Scheduling Resource Group
Resource groups and the compute engine configured under this space must be located in the same region.
2. Step 2: Install Agent
Scheduling Resource Group Details
Click Resource Group Name to enter the resource group information page, view resource information, resource monitoring, and perform resource group operation and maintenance.
Resource Group Information
In the Resource Information Tab, you can view the basic resource information and detailed resource information.
Basic Information: Resource Group Name, Resource Group Type, Associated Project, Running Status, Region, Description Information.
Resource Information: Resource Specifications, Concurrency, Hard Disk, VPC, Subnet, Creation Time, Expiration Time.
Parameter Description:
Parameter
Description
Basic Info
Resource Group Name
User-Defined scheduling resource group name.
Resource Group Type
The type of the scheduling resource group.
Associated Project
Associated project of the current scheduling resource group.
Running Status
The running status of the current scheduling resource group, including states like Running, Creating, Creation Failed, Initializing, Running Exception, Updating, Update Failed, Expired, Releasing, and Released.
Region
Home region of the current scheduling resource group.
Description(Optional)
User-defined scheduling resource group description.
Resource Information
Resource specification
Specification type of the scheduling resource group.
Concurrent Number
Maximum concurrent quantity supported by the current scheduling resource group.
Disk
Hard disk space size of the current resource group.
VPC
VPC network information of the current scheduling resource group.
Subnet
Subnet information of the current scheduling resource group.
Creation Time
Creation time of the current scheduling resource group.
Expiration time
Expiration time of the current scheduling resource group.
Resource Group Monitoring
The resource monitoring tab allows monitoring of the scheduling resource's usage, real-time monitoring of key indicators, including concurrent utilization rate, number of instances running, disk utilization rate, etc. It displays the resource usage trend within a user-defined time interval through charts.
Parameter description:
Parameter
Description
Real-time resource usage details
Concurrent Usage
Displays the concurrent occupancy percentage of the scheduling resource group, the number of instances running/concurrent number. (This is an estimated utilization rate, influenced by the task resource occupancy size, for reference only)
Running Instances
Displays the count of instances currently running in the scheduling resources.
Instances Waiting to Run
Displays the count of instances waiting in the scheduling resources.
Disk Utilization
Displays the current disk utilization percentage, along with used and total capacity.
Resource usage details
Concurrent Usage (%)
Displays the fluctuation of the concurrent utilization rate during the last 1-hour statistical interval.
Disk Utilization (%)
Displays the fluctuation of the disk utilization rate during the last 1-hour statistical interval.
CPU Utilization (%)
Displays the fluctuation of CPU utilization during the last 1-hour statistical interval.
Average System Load
Displays the fluctuation of CPU system average load during the last 1-hour statistical interval.
Memory Utilization (%)
Displays the fluctuation of memory utilization during the last 1-hour statistical interval.
Memory Usage (MB)
Displays the fluctuation of memory usage during the last 1-hour statistical interval.
Running Instances
Displays the fluctuation of running instance count during the last 1-hour statistical interval.
Number of Scheduled Tasks
Displays the fluctuation of the number of tasks in scheduling during the last 1-hour statistical interval.
Resource Group Operation and Maintenance
Resource group operation currently offers the feature of installation and operation management for Python packages, providing Python package support for Python tasks in data development.
The resource group operation interface provides entry points for Python package installation, Uninstall, and viewing, as well as a command execution record list. Users can view information related to Python installations and Uninstall here, including name, installation type, creator, status, description, and time, among others.
Python Package Installation
1. Click on Python Package Installation, then configure the Python package information in the pop-up.
Note:
This feature is only effective in the new specification of scheduling resources. The old specification does not support installation.
Information
Description(Optional)
Command Name
Automatic Generation, default as "Python Installation Package_Current Time", which the user can modify.
Package Type
Python Version, including Python2, Python3.
Select Install package
Supports keyword search, currently supported installation packages include:
You can select different versions of the Python package.
Command Execution Path
The default path provided by WeData, which is the installation path for Python packages.
Install command
Automatically generated.
Timeout Time
Maximum duration for the installation command execution. If it exceeds this time, the execution will be terminated.
Description(Optional)
Custom Description Information.
2. Once the Python package installation steps are configured, the installation command can be generated. On the resource group operation and maintenance page, click 'Run' in the corresponding installation command operation column to execute the Python package installation command. Upon successful installation, a command execution success message will be displayed in the status column.
3. Click on View Result under the operation column to view the detailed execution of the installation command.
4. Click on Command Name in the list to view command details.
View Python Packages
After clicking 'View Python Packages', a pop-up will display information about the Python packages installed for Python2 and Python3.
Uninstall Python Packages
After clicking 'Uninstall' for a Python package, you can select the installed Python packages to uninstall in the pop-up.
Information
Description(Optional)
Command Name
Automatic Generation, default as "Python Uninstall Package_Current Time", which the user can modify.
Package Type
Python Version, including Python2, Python3.
Select Uninstall Package
You can select the installed Python packages.
Command Execution Path
The default path provided by WeData, which is the uninstallation path for Python packages.
Uninstall Command
Automatically generated.
Timeout Time
Maximum duration for the installation command execution. If it exceeds this time, the execution will be terminated.
Scheduling Resource Group Operations
Associate/Disassociate Project
Associating a project specifies the project space information currently associated with the scheduling resource group, allowing tasks under that project space to use this resource group.
Note:
The old version resource group can be associated with only one project space, while the new version resource group can be associated with multiple project spaces.
Disassociation removes the scheduling resource group from the resources available for the current space. Disassociation requires that there are no tasks currently running in the project space, otherwise, it will fail.
Adjusting Configurations
Modifying the basic specifications of the resource packages contained in the current resource group or the quantity of resource packages, including changing resource specifications, increasing the quantity of resource packages, and decreasing the quantity of resource packages.
Change Resource Specifications: Expand or narrow down the specifications of the basic resource packages within the resource group, without changing the quantity.
Increase Resource Package Quantity: Upon selection, you can only increase the total number of resource packages under the current resource group.
Decrease Resource Package Quantity: Upon selection, you can only adjust the total number of resource packages contained in the current resource group.
Note
Reducing the number of resource packages may affect the running of tasks associated with the resource group. Please proceed with caution.
Renew
Renewing the current resource involves renewing operations for all resource packages within the resource group when there are multiple resource packages.
Termination
Termination refers to forcibly terminating the current resource group. Once terminated, the resource group cannot be recovered.
Note
If there are tasks currently running associated with the resource group, this action will directly affect the operation and data output of those tasks. Please proceed with caution.
Configure alarms
Monitor the concurrent usage rate and disk utilization rate of the resource group. Send alarm notifications when the usage rate exceeds a certain threshold, facilitating the timely detection of insufficient resource supply.
Parameter
Description
Alarm Conditions
Concurrent Usage
Resource occupancy rate during the concurrent execution of tasks within executable resources. Tasks require queuing under high concurrency conditions.
Disk Utilization
Disk utilization rate of executable resources.
Alarm Notification
Recipient
Allows specific account users or users scheduled by a duty roster to receive notifications when alarm conditions are triggered.
Alarm Method
Currently supports sending alarm notifications through Email, SMS, WeChat, Telephone, WeCom, HTTP, Enterprise WeChat Group, and FeiShu Group.
Note:
Phone, WeChat, email, and other accounts can be configured in Tencent Cloud User Management.
Enterprise WeChat accounts can be configured in Tencent Cloud Federated Accounts.
Alarm Status
Alert Trigger Switch, when the switch is on, the alarm conditions can take effect.
