tencent cloud

All product documents
GPU Usage Shows 100%
Last updated: 2024-01-11 17:11:13
GPU Usage Shows 100%
Last updated: 2024-01-11 17:11:13

Problem Description

When using a GPU instance, if you use nvidia-smi to view the GPU status in the system, the GPU usage may be displayed as 100% while no processes are using GPU, as shown below:




Possible Causes

This may be caused by the ECC Memory Scrubbing mechanism used when the instance loads the NVIDIA driver.

Solution

Run the nvidia-smi -pm 1 command in the instance system to get the GPU Driver into the Persistence mode.

Instructions

1. Log in to the GPU instance and run the following command:
nvidia-smi -pm 1



2. Run the following command to check GPU usage:
nvidia-smi
You will see the GPU usage is normal, as shown below:


Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon