Performance Comparison of Parameter Templates

Test Tool
Sysbench 1.0.20 is the tool used to test the database benchmark performance.
Tool installation
Run the following code to install Sysbench 1.0.20:
git clone https://github.com/akopytov/sysbench.git
git checkout 1.0.20
yum install gcc gcc-c++ autoconf automake make libtool bzr mysql-devel git mysql
cd sysbench
./autogen.sh
./configure
make -j
make install
Note: 
The installation directions above apply to performance stress testing on a CentOS CVM instance. For directions on installing the tool on other operating systems, see the official Sysbench documentation.
Test Environment
Type
Description
Test instance specification
Three common specifications, namely, 4-core CPU and 8 GB memory, 8-core CPU and 32 GB memory, and 16-core CPU and 128 GB memory
Client configuration
64-core CPU and 128 GB memory
Client private network bandwidth
23 Gbps
Test data volume
Database instance memory * 1.2
Test database instance versions
5.6 20210630, 5.7 20210630, and 8.0 20210330
Note on client specification: High-spec client machines are used so as to ensure that the database instance performance can be measured through stress testing on a single client. For low-spec clients, we recommend you use multiple clients for concurrent stress testing and aggregate the results.
Note on network latency: When performing the test, make sure that clients and database instances are in the same AZ to prevent the testing result from being affected by network factors.
Test Method
Test data preparations
sysbench --db-driver=mysql --mysql-host=xxxx --mysql-port=xxxx --mysql-user=xxxx --mysql-password=xxxx --mysql-db=sbtest --table_size=xxxx --tables=xxxx --events=0 --time=600 --threads=xxxx --percentile=95 --report-interval=1 oltp_read_write prepare
Command for performance stress testing
sysbench --db-driver=mysql --mysql-host=xxxx --mysql-port=xxxx --mysql-user=xxxx --mysql-password=xxxx --mysql-db=sbtest --table_size=xxxx --tables=xxxx --events=0 --time=600 --threads=xxxx --percentile=95 --report-interval=1 oltp_read_write run
Descriptions of stress testing parameters:
oltp_read_write indicates to implement the OLTP test by calling the /usr/share/sysbench/oltp_read_write.lua script.
--tables=xxxx indicates the number of tables in this test.
--table_size=xxxx indicates the number of table rows in this test.
--threads=xxxx indicates the number of concurrent connections of the client in this test.
--report-interval=1 indicates that the test result is output once every second.
--percentile=95 indicates the sampling rate, which is 95% by default.
--time=600 indicates the execution time of this test, which is 600 seconds.
Scenario model
The test cases in this document all use the Lua script of sysbench.
For the common configurations, performance testing is conducted for different parameter templates. The test results are as follows:
Test result
v5.6 20210630
CPU (Core)
Memory (GB)
Threads
Test Duration
Template
SysBench QPS
SysBench TPS
avg_lat
4
8
32
10 min
Default template (disused)
34428.69
1721.43
18.59 ms
﻿
﻿
﻿
﻿
High-performance parameter template
35917.50
1795.87
17.82 ms
﻿
﻿
﻿
﻿
High-stability parameter template
34834.04
1741.70
18.37 ms
8
32
64
10 min
Default template (disused)
61210.19
3060.51
20.91 ms
﻿
﻿
﻿
﻿
High-performance parameter template
67719.55
3385.98
18.90 ms
﻿
﻿
﻿
﻿
High-stability parameter template
64910.09
3245.50
19.72 ms
16
128
128
10 min
Default template (disused)
106965.44
5348.27
23.93 ms
﻿
﻿
﻿
﻿
High-performance parameter template
127955.48
6397.77
20.00 ms
﻿
﻿
﻿
﻿
High-stability parameter template
119509.02
5975.45
21.41 ms
v5.7 20210630
CPU (Core)
Memory (GB)
Threads
Test Duration
Template
SysBench QPS
SysBench TPS
avg_lat
4
8
32
10 min
Default template (disused)
34428.69
1721.43
18.59 ms
﻿
﻿
﻿
﻿
High-performance parameter template
35917.50
1795.87
17.82 ms
﻿
﻿
﻿
﻿
High-stability parameter template
34834.04
1741.70
18.37 ms
8
32
64
10 min
Default template (disused)
61210.19
3060.51
20.91 ms
﻿
﻿
﻿
﻿
High-performance parameter template
67719.55
3385.98
18.90 ms
﻿
﻿
﻿
﻿
High-stability parameter template
64910.09
3245.50
19.72 ms
16
128
128
10 min
Default template (disused)
106965.44
5348.27
23.93 ms
﻿
﻿
﻿
﻿
High-performance parameter template
127955.48
6397.77
20.00 ms
﻿
﻿
﻿
﻿
High-stability parameter template
119509.02
5975.45
21.41 ms
v8.0 20210330
CPU (Core)
Memory (GB)
Threads
Test Duration
Template
SysBench QPS
SysBench TPS
avg_lat
4
8
32
10 min
Default template (disused)
32594.79
1629.74
19.63 ms
﻿
﻿
﻿
﻿
High-performance parameter template
33383.77
1669.19
19.17 ms
﻿
﻿
﻿
﻿
High-stability parameter template
32071.90
1603.60
19.95 ms
8
32
64
10 min
Default template (disused)
65718.22
3285.91
19.47 ms
﻿
﻿
﻿
﻿
High-performance parameter template
70195.37
3509.77
18.23 ms
﻿
﻿
﻿
﻿
High-stability parameter template
60704.69
3035.23
21.08 ms
16
128
128
10 min
Default template (disused)
132023.66
6601.18
19.38 ms
﻿
﻿
﻿
﻿
High-performance parameter template
151021.67
7551.08
16.95 ms
﻿
﻿
﻿
﻿
High-stability parameter template
132391.01
6619.55
19.33 ms

Was this page helpful?

You can also Contact Sales or Submit a Ticket for help.

Yes

Type	Description
Test instance specification	Three common specifications, namely, 4-core CPU and 8 GB memory, 8-core CPU and 32 GB memory, and 16-core CPU and 128 GB memory
Client configuration	64-core CPU and 128 GB memory
Client private network bandwidth	23 Gbps
Test data volume	Database instance memory * 1.2
Test database instance versions	5.6 20210630, 5.7 20210630, and 8.0 20210330

CPU (Core)	Memory (GB)	Threads	Test Duration	Template	SysBench QPS	SysBench TPS	avg_lat
4	8	32	10 min	Default template (disused)	34428.69	1721.43	18.59 ms
								High-performance parameter template	35917.50	1795.87	17.82 ms
								High-stability parameter template	34834.04	1741.70	18.37 ms
8	32	64	10 min	Default template (disused)	61210.19	3060.51	20.91 ms
								High-performance parameter template	67719.55	3385.98	18.90 ms
								High-stability parameter template	64910.09	3245.50	19.72 ms
16	128	128	10 min	Default template (disused)	106965.44	5348.27	23.93 ms
								High-performance parameter template	127955.48	6397.77	20.00 ms
								High-stability parameter template	119509.02	5975.45	21.41 ms

tencent cloud

Sign Up

Log in

Compute

Microservice

Data Migration

Database SaaS Tool

Data Security

Application Security

Big Data

Tencent Big Model

Internet of Things

Stream Services

Cloud Real-time Rendering

Management and Audit Tools

Edge Computing

Serverless

Relational Database

Networking

Business Security

Domains & Websites

Face Recognition

AI Platform Service

Middleware

Media On-Demand

Game Services

Developer Tools

Container

Essential Storage Service

Enterprise Distributed DBMS

CDN and Acceleration

Security Services

Enterprise Applications

Voice Technology

Natural Language Processing

Communication

Media Process Services

Education Sevices

Monitor and Operation

Distributed cloud

Data Process and Analysis

NoSQL Database

Network Security

Cloud Security

Office Collaboration

Image Creation

Optical Character Recognition

Interactive Video Services

Media SDK

Cloud Resource Management

More

Test Tool

Tool installation

Test Environment

Test Method

Test data preparations

Command for performance stress testing

Scenario model

Test result

v5.6 20210630

v5.7 20210630

v8.0 20210330