tencent cloud

All product documents
TDMQ for CKafka
Warning Displayed for Message Heap
Last updated: 2024-01-09 14:57:56
Warning Displayed for Message Heap
Last updated: 2024-01-09 14:57:56

Issue Description

A warning is displayed for message heap.

Possible Causes

The client has not consumed messages.
The client’s consumption speed is slow.

Solutions

The client has not consumed messages
You can check the consumption speed of partitions to confirm whether there is consumption as shown below:
The client’s consumption speed is slow
For more information, see Slow Message Consumption.
Open-Source Kafka supports setting a timestamp field and type in a message. Currently, two timestamp types are supported: CreateTime and LogAppendTime.
CreateTime indicates the local time on the client. As client time may vary from server time, check whether the entered time is correct. If it differs too much from the China Standard Time, the CKafka service will not be able to delete data promptly upon expiration based on the normal message retention period, which may cause exceptional message heap.
LogAppendTime indicates the time when a message is produced to the CKafka service, which is the CKafka server time and thus recommended.

Server Stress Testing

If you have questions about the server performance, you can run the following stress test commands to check whether there is a problem on the server:
Sample command for production testing:
bin/kafka-producer-perf-test.sh
--topic test
--num-records 123
--record-size 1000
--producer-props bootstrap.servers= ckafka vip : port
--throughput 20000
Sample command for consumption testing:
bin/kafka-consumer-perf-test.sh
--topic test
--new-consumer
--fetch-size 10000
--messages 1000
--broker-list bootstrap.servers=ckafka vip : port
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 available.

7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon