CKafka supports automatic adjustment of the disk utilization. After the disk utilization reaches the threshold, you can set the Dynamic Message Retention Policy to reduce the message retention time or set the Automatic Disk Capacity Expansion to adjust the disk space.
Dynamic Message Retention Policy: After you set the message retention time, expired messages will be deleted. In case of message surges, normal production and consumption cannot be performed after the disk is full. If you set a dynamic retention policy, when the disk utilization reaches a certain percentage, a certain proportion of data will be automatically expired to avoid the above issue.
Automatic Disk Capacity Expansion: When the disk load gets heavy, messages cannot be produced and consumed normally. After the automatic disk capacity expansion policy is set, when the disk load reaches the trigger threshold, the disk capacity will be automatically adjusted according to the policy, thus avoiding this problem.
Policy Type
Supported by CKafka Standard Edition
Supported by CKafka Pro Edition
Dynamic message retention
Yes
Yes
Automatic disk capacity expansion
No
Yes
Note
You can enable either dynamic message retention or automatic disk capacity expansion at any time.
2. Click Instance List on the left sidebar and then the ID/Name of your instance to enter the instance details page.
3. Select the Smart Ops tab at the top of the page, select the Auto Scaling tab, and configure the disk space adjustment policy in the Disk Utilization Policy module.
Configuring a Disk Utilization Policy
Dynamic Message Retention Policy
Automatic Disk Capacity Expansion Policy
1. In the Disk Utilization Policy module, enable Dynamic Retention Policy.
Note
The default dynamic policy reduces the message retention time by 10% when the disk utilization reaches 75%.
2. Click Configure in the Operation column of the dynamic retention policy to configure Dynamic Policy and Minimum Retention Period.
Dynamic Policy: After message retention time adjustment is triggered, the broker will delete the oldest historical data based on the new retention time. This feature has a certain delay.
Minimum Retention Period: It can be 1 minute to 30 hours. If the dynamic retention period is lower than this parameter, no dynamic adjustment will be triggered.
3. Click View in the Adjustment Record column to enter the event center and view the adjustment records of automatic disk capacity expansion.
1. In the Disk Utilization Processing module, enable Automatic Disk Capacity Expansion.
Note
When the disk utilization reaches 75%, the disk capacity will be automatically expanded by 10% by default. The maximum disk capacity is as displayed in the console, which is the upper limit of the disk corresponding to the current instance specification.
2. Click Configure in the Operation column of the automatic disk capacity expansion policy to configure Dynamic Policy and Max Disk Capacity.
Dynamic Policy: After the disk load reaches the trigger threshold, the disk capacity will be automatically adjusted according to the capacity expansion policy, with a certain delay.
Note
The disk capacity will be expanded in increments of 100 GB.
Max Disk Capacity: Automatic disk capacity expansion will no longer be triggered after the disk capacity has been expanded to the specified value.
3. Click View in the Adjustment Record column to enter the event center and view the adjustment records of automatic disk capacity expansion.
Yes
No
Was this page helpful?