不同linux发行版 FIO测试结果总结
背景
机器来源
配置:
2路28核心Golden 6330 2.0Ghz
512G内存
硬盘 24块 960G SSD (22块 Raid5 + 2块 hotspare )
测试工具 FIO
测试环境信息
OpenEuler2203
KylinV10SP3
Rocky8.7
CentOS7.9
虚拟机的配置都为 8c 32G内存 500G 精简置备硬盘
全新安装, 最大化GUI安装, 不跑任何应用.
部分结论
1. 开了了写入缓存,一定程度上会降低读取的性能
2. 多虚拟机并行测试挤占了IO资源会导致性能劣化
3. RAID10的写入提升比较明显, 读取提升更加明显.
测试结果-单线程-16深度-单位KIOPS,单个num_jobs 16的IO队列深度
| 系统类型 |
写入-不开写入缓存 |
写入-开写入缓存 |
读取-不开写入缓存 |
读取-开写入缓存 |
| openEuler2203 |
18.797 |
62.076 |
57.947 |
25.394 |
| centos79 |
13.809 |
64.93 |
113.723 |
19.53 |
| rocky87 |
16.233 |
70.542 |
116.261 |
42.408 |
| kylinv10 |
15.508 |
65.031 |
122.621 |
22.765 |
测试结果-2
| 系统类型 |
写入-开写入缓存 |
读取-开写入缓存 |
| openEuler2203-四个机器一起测试 |
62.076 |
25.394 |
| openEuler2203-一个机器单独测试 |
97.602 |
50.412 |
基于Mysql的FIO测试结果信息-write-back
| 系统类型 |
读取 |
写入 |
| openeuler2203 |
5.8 |
4.6 |
| CentOS79 |
5.5 |
3.8 |
| rocky87 |
7.0 |
2.9 |
| kylinv10 |
6.2 |
4.2 |
基于Mysql的FIO测试结果信息-write-through
| 系统类型 |
读取 |
写入 |
| openeuler2203 |
7.6 |
5.1 |
| CentOS79 |
8.6 |
4.9 |
| rocky87 |
8.8 |
3.3 |
| kylinv10 |
9.0 |
4.6 |
物理机的验证结果
| Raid卡配置 |
读IOPS |
写IOPS |
| 8块SSD Raid5 |
45.7k |
15.1k |
| 12块SSD Raid10 |
80.5k |
26.5k |
测试脚本
echo "本次测试测试128k 16k 8k 1k 的 顺序读写 随机读写性能,每个脚本耗时约30s, 总计耗时大约8min左右完成: "
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=128k -rw=write -size=4g --iodepth=16 >write128k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=128k -rw=read -size=4g --iodepth=16 >read128k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=128k -rw=randwrite -size=4g --iodepth=16 >randwrite128k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=128k -rw=randread -size=4g --iodepth=16 >randread128k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=16k -rw=write -size=4g --iodepth=16 >write16k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=16k -rw=read -size=4g --iodepth=16 >read16k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=16k -rw=randwrite -size=4g --iodepth=16 >randwrite16k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=16k -rw=randread -size=4g --iodepth=16 >randread16k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=8k -rw=write -size=4g --iodepth=16 >write8k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=8k -rw=read -size=4g --iodepth=16 >read8k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=8k -rw=randwrite -size=4g --iodepth=16 >randwrite8k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=8k -rw=randread -size=4g --iodepth=16 >randread8k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=1k -rw=write -size=4g --iodepth=16 >write1k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=1k -rw=read -size=4g --iodepth=16 >read1k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=1k -rw=randwrite -size=4g --iodepth=16 >randwrite1k.txt
fio -name=128k -filename=/var/io.speedtest -runtime=30 -direct=1 -bs=1k -rw=randread -size=4g --iodepth=16 >randread1k.txt
echo "测试结果为"
echo "write128k"
sed -n 7p write128k.txt
echo "read128k"
sed -n 6p read128k.txt
echo "randwrite128k"
sed -n 6p randwrite128k.txt
echo "randread128k"
sed -n 6p randread128k.txt
echo "write16k"
sed -n 6p write16k.txt
echo "read16k"
sed -n 6p read16k.txt
echo "randwrite16k"
sed -n 6p randwrite16k.txt
echo "randread16k"
sed -n 6p randread16k.txt
echo "write8k"
sed -n 6p write8k.txt
echo "read8k"
sed -n 6p read8k.txt
echo "randwrite8k"
sed -n 6p randwrite8k.txt
echo "randread8k"
sed -n 6p randread8k.txt
echo "write1k"
sed -n 6p write1k.txt
echo "read1k"
sed -n 6p read1k.txt
echo "randwrite1k"
sed -n 6p randwrite1k.txt
echo "randread1k"
sed -n 6p randread1k.txt
原始测试结果-OpenEuler
write128k
write: IOPS=374, BW=46.8MiB/s (49.0MB/s)(1403MiB/30001msec); 0 zone resets
read128k
read: IOPS=2842, BW=355MiB/s (373MB/s)(4096MiB/11526msec)
randwrite128k
write: IOPS=671, BW=83.9MiB/s (88.0MB/s)(2517MiB/30001msec); 0 zone resets
randread128k
read: IOPS=1741, BW=218MiB/s (228MB/s)(4096MiB/18814msec)
write16k
write: IOPS=2619, BW=40.9MiB/s (42.9MB/s)(1228MiB/30001msec); 0 zone resets
read16k
read: IOPS=8402, BW=131MiB/s (138MB/s)(3939MiB/30001msec)
randwrite16k
write: IOPS=2232, BW=34.9MiB/s (36.6MB/s)(1047MiB/30001msec); 0 zone resets
randread16k
read: IOPS=4258, BW=66.5MiB/s (69.8MB/s)(1996MiB/30001msec)
write8k
write: IOPS=2864, BW=22.4MiB/s (23.5MB/s)(671MiB/30001msec); 0 zone resets
read8k
read: IOPS=11.7k, BW=91.2MiB/s (95.6MB/s)(2736MiB/30001msec)
randwrite8k
write: IOPS=2934, BW=22.9MiB/s (24.0MB/s)(688MiB/30001msec); 0 zone resets
randread8k
read: IOPS=4724, BW=36.9MiB/s (38.7MB/s)(1107MiB/30001msec)
write1k
write: IOPS=2954, BW=2955KiB/s (3026kB/s)(86.6MiB/30001msec); 0 zone resets
read1k
read: IOPS=17.7k, BW=17.2MiB/s (18.1MB/s)(517MiB/30001msec)
randwrite1k
write: IOPS=4149, BW=4150KiB/s (4249kB/s)(122MiB/30001msec); 0 zone resets
randread1k
read: IOPS=6580, BW=6580KiB/s (6738kB/s)(193MiB/30001msec)
原始测试结果-CentOS79
write128k
write: IOPS=247, BW=30.9MiB/s (32.4MB/s)(927MiB/30003msec)
read128k
read: IOPS=30.6k, BW=3824MiB/s (4010MB/s)(4096MiB/1071msec)
randwrite128k
write: IOPS=164, BW=20.6MiB/s (21.6MB/s)(617MiB/30002msec)
randread128k
read: IOPS=4240, BW=530MiB/s (556MB/s)(4096MiB/7728msec)
write16k
write: IOPS=1672, BW=26.1MiB/s (27.4MB/s)(784MiB/30001msec)
read16k
read: IOPS=23.4k, BW=365MiB/s (383MB/s)(4096MiB/11208msec)
randwrite16k
write: IOPS=1454, BW=22.7MiB/s (23.8MB/s)(682MiB/30001msec)
randread16k
read: IOPS=7863, BW=123MiB/s (129MB/s)(3686MiB/30001msec)
write8k
write: IOPS=2305, BW=18.0MiB/s (18.9MB/s)(540MiB/30001msec)
read8k
read: IOPS=16.4k, BW=128MiB/s (134MB/s)(3842MiB/30001msec)
randwrite8k
write: IOPS=2622, BW=20.5MiB/s (21.5MB/s)(615MiB/30000msec)
randread8k
read: IOPS=8118, BW=63.4MiB/s (66.5MB/s)(1903MiB/30001msec)
write1k
write: IOPS=3036, BW=3036KiB/s (3109kB/s)(88.0MiB/30001msec)
read1k
read: IOPS=17.0k, BW=16.6MiB/s (17.5MB/s)(499MiB/30001msec)
randwrite1k
write: IOPS=2309, BW=2310KiB/s (2365kB/s)(67.7MiB/30001msec)
randread1k
read: IOPS=6102, BW=6103KiB/s (6249kB/s)(179MiB/30001msec)
原始测试结果-Rocky87
测试结果为
write128k
write: IOPS=226, BW=28.3MiB/s (29.7MB/s)(850MiB/30003msec); 0 zone resets
read128k
read: IOPS=30.5k, BW=3817MiB/s (4003MB/s)(4096MiB/1073msec)
randwrite128k
write: IOPS=130, BW=16.3MiB/s (17.1MB/s)(489MiB/30009msec); 0 zone resets
randread128k
read: IOPS=4683, BW=585MiB/s (614MB/s)(4096MiB/6997msec)
write16k
write: IOPS=2413, BW=37.7MiB/s (39.5MB/s)(1131MiB/30001msec); 0 zone resets
read16k
read: IOPS=25.7k, BW=401MiB/s (421MB/s)(4096MiB/10210msec)
randwrite16k
write: IOPS=1249, BW=19.5MiB/s (20.5MB/s)(586MiB/30001msec); 0 zone resets
randread16k
read: IOPS=7181, BW=112MiB/s (118MB/s)(3367MiB/30001msec)
write8k
write: IOPS=2793, BW=21.8MiB/s (22.9MB/s)(655MiB/30001msec); 0 zone resets
read8k
read: IOPS=19.4k, BW=152MiB/s (159MB/s)(4096MiB/26986msec)
randwrite8k
write: IOPS=2790, BW=21.8MiB/s (22.9MB/s)(654MiB/30001msec); 0 zone resets
randread8k
read: IOPS=6684, BW=52.2MiB/s (54.8MB/s)(1567MiB/30001msec)
write1k
write: IOPS=2801, BW=2801KiB/s (2868kB/s)(82.1MiB/30002msec); 0 zone resets
read1k
read: IOPS=14.4k, BW=14.1MiB/s (14.8MB/s)(423MiB/30001msec)
randwrite1k
write: IOPS=3831, BW=3831KiB/s (3923kB/s)(112MiB/30001msec); 0 zone resets
randread1k
read: IOPS=7713, BW=7714KiB/s (7899kB/s)(226MiB/30001msec)
原始测试结果-KylinV10SP3
write128k
write: IOPS=226, BW=28.3MiB/s (29.6MB/s)(848MiB/30008msec); 0 zone resets
read128k
read: IOPS=30.7k, BW=3832MiB/s (4018MB/s)(4096MiB/1069msec)
randwrite128k
write: IOPS=142, BW=17.8MiB/s (18.7MB/s)(534MiB/30008msec); 0 zone resets
randread128k
read: IOPS=4828, BW=604MiB/s (633MB/s)(4096MiB/6786msec)
write16k
write: IOPS=1646, BW=25.7MiB/s (27.0MB/s)(772MiB/30001msec); 0 zone resets
read16k
read: IOPS=26.3k, BW=410MiB/s (430MB/s)(4096MiB/9979msec)
randwrite16k
write: IOPS=1175, BW=18.4MiB/s (19.3MB/s)(551MiB/30001msec); 0 zone resets
randread16k
read: IOPS=8790, BW=137MiB/s (144MB/s)(4096MiB/29822msec)
write8k
write: IOPS=2817, BW=22.0MiB/s (23.1MB/s)(660MiB/30001msec); 0 zone resets
read8k
read: IOPS=20.4k, BW=159MiB/s (167MB/s)(4096MiB/25723msec)
randwrite8k
write: IOPS=2826, BW=22.1MiB/s (23.2MB/s)(662MiB/30001msec); 0 zone resets
randread8k
read: IOPS=7651, BW=59.8MiB/s (62.7MB/s)(1793MiB/30001msec)
write1k
write: IOPS=2780, BW=2780KiB/s (2847kB/s)(81.5MiB/30001msec); 0 zone resets
read1k
read: IOPS=15.4k, BW=15.1MiB/s (15.8MB/s)(452MiB/30001msec)
randwrite1k
write: IOPS=3896, BW=3896KiB/s (3990kB/s)(114MiB/30001msec); 0 zone resets
randread1k
read: IOPS=8552, BW=8552KiB/s (8757kB/s)(251MiB/30001msec)
开启Raid卡缓存后--OpenEuler2203
测试结果为
write128k
write: IOPS=7184, BW=898MiB/s (942MB/s)(4096MiB/4561msec); 0 zone resets
read128k
read: IOPS=1569, BW=196MiB/s (206MB/s)(4096MiB/20880msec)
randwrite128k
write: IOPS=5784, BW=723MiB/s (758MB/s)(4096MiB/5665msec); 0 zone resets
randread128k
read: IOPS=962, BW=120MiB/s (126MB/s)(3610MiB/30001msec)
write16k
write: IOPS=7752, BW=121MiB/s (127MB/s)(3634MiB/30001msec); 0 zone resets
read16k
read: IOPS=3678, BW=57.5MiB/s (60.3MB/s)(1724MiB/30001msec)
randwrite16k
write: IOPS=7946, BW=124MiB/s (130MB/s)(3725MiB/30001msec); 0 zone resets
randread16k
read: IOPS=1958, BW=30.6MiB/s (32.1MB/s)(918MiB/30002msec)
write8k
write: IOPS=7902, BW=61.7MiB/s (64.7MB/s)(1852MiB/30001msec); 0 zone resets
read8k
read: IOPS=5383, BW=42.1MiB/s (44.1MB/s)(1262MiB/30001msec)
randwrite8k
write: IOPS=8134, BW=63.6MiB/s (66.6MB/s)(1907MiB/30001msec); 0 zone resets
randread8k
read: IOPS=2705, BW=21.1MiB/s (22.2MB/s)(634MiB/30001msec)
write1k
write: IOPS=8168, BW=8169KiB/s (8365kB/s)(239MiB/30001msec); 0 zone resets
read1k
read: IOPS=3769, BW=3769KiB/s (3860kB/s)(110MiB/30001msec)
randwrite1k
write: IOPS=9206, BW=9207KiB/s (9428kB/s)(270MiB/30001msec); 0 zone resets
randread1k
read: IOPS=5370, BW=5371KiB/s (5499kB/s)(157MiB/30001msec)
开启raid卡缓存之后-CentOS79
测试结果为
write128k
write: IOPS=6775, BW=847MiB/s (888MB/s)(4096MiB/4836msec)
read128k
read: IOPS=1320, BW=165MiB/s (173MB/s)(4096MiB/24817msec)
randwrite128k
write: IOPS=5780, BW=723MiB/s (758MB/s)(4096MiB/5669msec)
randread128k
read: IOPS=1088, BW=136MiB/s (143MB/s)(4082MiB/30001msec)
write16k
write: IOPS=10.5k, BW=165MiB/s (173MB/s)(4096MiB/24849msec)
read16k
read: IOPS=3182, BW=49.7MiB/s (52.1MB/s)(1492MiB/30002msec)
randwrite16k
write: IOPS=6644, BW=104MiB/s (109MB/s)(3115MiB/30001msec)
randread16k
read: IOPS=1553, BW=24.3MiB/s (25.5MB/s)(728MiB/30001msec)
write8k
write: IOPS=10.5k, BW=82.1MiB/s (86.1MB/s)(2464MiB/30001msec)
read8k
read: IOPS=4773, BW=37.3MiB/s (39.1MB/s)(1119MiB/30001msec)
randwrite8k
write: IOPS=6725, BW=52.5MiB/s (55.1MB/s)(1576MiB/30001msec)
randread8k
read: IOPS=1863, BW=14.6MiB/s (15.3MB/s)(437MiB/30001msec)
write1k
write: IOPS=11.0k, BW=10.8MiB/s (11.3MB/s)(323MiB/30001msec)
read1k
read: IOPS=3720, BW=3720KiB/s (3810kB/s)(109MiB/30000msec)
randwrite1k
write: IOPS=7006, BW=7006KiB/s (7175kB/s)(205MiB/30002msec)
randread1k
read: IOPS=2031, BW=2032KiB/s (2081kB/s)(59.5MiB/30001msec)
开启raid卡缓存之后-rocky87
测试结果为
write128k
write: IOPS=7697, BW=962MiB/s (1009MB/s)(4096MiB/4257msec); 0 zone resets
read128k
read: IOPS=7337, BW=917MiB/s (962MB/s)(4096MiB/4466msec)
randwrite128k
write: IOPS=5865, BW=733MiB/s (769MB/s)(4096MiB/5587msec); 0 zone resets
randread128k
read: IOPS=1034, BW=129MiB/s (136MB/s)(3879MiB/30001msec)
write16k
write: IOPS=14.8k, BW=231MiB/s (242MB/s)(4096MiB/17712msec); 0 zone resets
read16k
read: IOPS=11.0k, BW=173MiB/s (181MB/s)(4096MiB/23735msec)
randwrite16k
write: IOPS=7439, BW=116MiB/s (122MB/s)(3487MiB/30001msec); 0 zone resets
randread16k
read: IOPS=971, BW=15.2MiB/s (15.9MB/s)(455MiB/30002msec)
write8k
write: IOPS=9723, BW=76.0MiB/s (79.7MB/s)(2279MiB/30001msec); 0 zone resets
read8k
read: IOPS=10.4k, BW=81.5MiB/s (85.5MB/s)(2445MiB/30001msec)
randwrite8k
write: IOPS=7370, BW=57.6MiB/s (60.4MB/s)(1727MiB/30001msec); 0 zone resets
randread8k
read: IOPS=1183, BW=9468KiB/s (9695kB/s)(277MiB/30001msec)
write1k
write: IOPS=10.1k, BW=9.86MiB/s (10.3MB/s)(296MiB/30001msec); 0 zone resets
read1k
read: IOPS=9118, BW=9119KiB/s (9338kB/s)(267MiB/30001msec)
randwrite1k
write: IOPS=7548, BW=7548KiB/s (7729kB/s)(221MiB/30001msec); 0 zone resets
randread1k
read: IOPS=1365, BW=1366KiB/s (1398kB/s)(40.0MiB/30002msec)
开启raid卡缓存之后-kylinv10
write128k
write: IOPS=7724, BW=966MiB/s (1012MB/s)(4096MiB/4242msec);
read128k
read: IOPS=1427, BW=178MiB/s (187MB/s)(4096MiB/22952msec)
randwrite128k
write: IOPS=5928, BW=741MiB/s (777MB/s)(4096MiB/5527msec); 0 zone resets
randread128k
read: IOPS=1135, BW=142MiB/s (149MB/s)(4096MiB/28858msec)
write16k
write: IOPS=11.8k, BW=185MiB/s (194MB/s)(4096MiB/22122msec); 0 zone resets
read16k
read: IOPS=3626, BW=56.7MiB/s (59.4MB/s)(1700MiB/30001msec)
randwrite16k
write: IOPS=6044, BW=94.4MiB/s (99.0MB/s)(2833MiB/30002msec); 0 zone resets
randread16k
read: IOPS=1552, BW=24.3MiB/s (25.4MB/s)(728MiB/30001msec)
write8k
write: IOPS=10.3k, BW=80.2MiB/s (84.1MB/s)(2408MiB/30001msec); 0 zone resets
read8k
read: IOPS=5117, BW=40.0MiB/s (41.9MB/s)(1199MiB/30001msec)
randwrite8k
write: IOPS=6411, BW=50.1MiB/s (52.5MB/s)(1503MiB/30002msec); 0 zone resets
randread8k
read: IOPS=1833, BW=14.3MiB/s (15.0MB/s)(430MiB/30002msec)
write1k
write: IOPS=10.3k, BW=10.1MiB/s (10.6MB/s)(303MiB/30001msec); 0 zone resets
read1k
read: IOPS=6008, BW=6008KiB/s (6153kB/s)(176MiB/30002msec)
randwrite1k
write: IOPS=6524, BW=6525KiB/s (6682kB/s)(191MiB/30001msec); 0 zone resets
randread1k
read: IOPS=2067, BW=2067KiB/s (2117kB/s)(60.6MiB/30003msec)
单独一台机器压测-openEuler
测试结果为
write128k
write: IOPS=9451, BW=1181MiB/s (1239MB/s)(4096MiB/3467msec); 0 zone resets
read128k
read: IOPS=1889, BW=236MiB/s (248MB/s)(4096MiB/17344msec)
randwrite128k
write: IOPS=7408, BW=926MiB/s (971MB/s)(4096MiB/4423msec); 0 zone resets
randread128k
read: IOPS=1395, BW=174MiB/s (183MB/s)(4096MiB/23484msec)
write16k
write: IOPS=17.0k, BW=266MiB/s (279MB/s)(4096MiB/15400msec); 0 zone resets
read16k
read: IOPS=7003, BW=109MiB/s (115MB/s)(3283MiB/30001msec)
randwrite16k
write: IOPS=9573, BW=150MiB/s (157MB/s)(4096MiB/27383msec); 0 zone resets
randread16k
read: IOPS=3056, BW=47.8MiB/s (50.1MB/s)(1433MiB/30001msec)
write8k
write: IOPS=17.0k, BW=133MiB/s (139MB/s)(3983MiB/30001msec); 0 zone resets
read8k
read: IOPS=9704, BW=75.8MiB/s (79.5MB/s)(2275MiB/30001msec)
randwrite8k
write: IOPS=9545, BW=74.6MiB/s (78.2MB/s)(2237MiB/30001msec); 0 zone resets
randread8k
read: IOPS=4094, BW=32.0MiB/s (33.5MB/s)(960MiB/30001msec)
write1k
write: IOPS=18.2k, BW=17.8MiB/s (18.6MB/s)(533MiB/30001msec); 0 zone resets
read1k
read: IOPS=17.9k, BW=17.5MiB/s (18.3MB/s)(524MiB/30001msec)
randwrite1k
write: IOPS=9425, BW=9426KiB/s (9652kB/s)(276MiB/30002msec); 0 zone resets
randread1k
read: IOPS=5371, BW=5371KiB/s (5500kB/s)(157MiB/30001msec)
2
write128k
write: IOPS=9102, BW=1138MiB/s (1193MB/s)(4096MiB/3600msec); 0 zone resets
read128k
read: IOPS=1870, BW=234MiB/s (245MB/s)(4096MiB/17517msec)
randwrite128k
write: IOPS=7289, BW=911MiB/s (955MB/s)(4096MiB/4495msec); 0 zone resets
randread128k
read: IOPS=1392, BW=174MiB/s (182MB/s)(4096MiB/23537msec)
write16k
write: IOPS=16.4k, BW=256MiB/s (269MB/s)(4096MiB/15969msec); 0 zone resets
read16k
read: IOPS=6981, BW=109MiB/s (114MB/s)(3273MiB/30001msec)
randwrite16k
write: IOPS=9696, BW=152MiB/s (159MB/s)(4096MiB/27035msec); 0 zone resets
randread16k
read: IOPS=3056, BW=47.8MiB/s (50.1MB/s)(1433MiB/30001msec)
write8k
write: IOPS=17.4k, BW=136MiB/s (143MB/s)(4079MiB/30001msec); 0 zone resets
read8k
read: IOPS=9686, BW=75.7MiB/s (79.4MB/s)(2270MiB/30001msec)
randwrite8k
write: IOPS=9480, BW=74.1MiB/s (77.7MB/s)(2222MiB/30001msec); 0 zone resets
randread8k
read: IOPS=4134, BW=32.3MiB/s (33.9MB/s)(969MiB/30001msec)
write1k
write: IOPS=18.2k, BW=17.7MiB/s (18.6MB/s)(532MiB/30001msec); 0 zone resets
read1k
read: IOPS=18.3k, BW=17.9MiB/s (18.8MB/s)(537MiB/30001msec)
randwrite1k
write: IOPS=9480, BW=9480KiB/s (9708kB/s)(278MiB/30001msec); 0 zone resets
randread1k
read: IOPS=5387, BW=5388KiB/s (5517kB/s)(158MiB/30001msec)
Mysql的测试结果-centos79
innodb-trxlog: (groupid=0, jobs=160): err= 0: pid=16172: Mon Jun 26 16:07:02 2023
read: IOPS=5488, BW=85.8MiB/s (89.9MB/s)(10.0GiB/120007msec)
clat (usec): min=592, max=31063, avg=4827.11, stdev=2258.93
lat (usec): min=592, max=31063, avg=4827.21, stdev=2258.93
clat percentiles (usec):
| 1.00th=[ 1762], 5.00th=[ 2057], 10.00th=[ 2343], 20.00th=[ 2933],
| 30.00th=[ 3392], 40.00th=[ 3785], 50.00th=[ 4228], 60.00th=[ 4752],
| 70.00th=[ 5669], 80.00th=[ 6980], 90.00th=[ 8160], 95.00th=[ 8848],
| 99.00th=[10421], 99.50th=[12518], 99.90th=[17433], 99.95th=[19530],
| 99.99th=[23987]
bw ( KiB/s): min= 1728, max= 4928, per=3.12%, avg=2743.85, stdev=732.97, samples=7671
iops : min= 108, max= 308, avg=171.45, stdev=45.81, samples=7671
write: IOPS=3788, BW=23.3MiB/s (24.5MB/s)(2802MiB/120030msec)
clat (usec): min=2, max=347497, avg=24326.06, stdev=53886.52
lat (usec): min=2, max=347497, avg=24326.18, stdev=53886.53
clat percentiles (usec):
| 1.00th=[ 39], 5.00th=[ 157], 10.00th=[ 297], 20.00th=[ 1385],
| 30.00th=[ 2638], 40.00th=[ 3523], 50.00th=[ 4948], 60.00th=[ 7373],
| 70.00th=[ 11338], 80.00th=[ 19006], 90.00th=[ 51643], 95.00th=[175113],
| 99.00th=[246416], 99.50th=[258999], 99.90th=[283116], 99.95th=[291505],
| 99.99th=[304088]
bw ( KiB/s): min= 0, max= 1600, per=0.62%, avg=149.26, stdev=287.24, samples=38388
iops : min= 1, max= 100, avg=23.62, stdev=16.87, samples=38388
lat (usec) : 4=0.01%, 10=0.22%, 20=0.08%, 50=0.18%, 100=0.67%
lat (usec) : 250=2.34%, 500=2.38%, 750=1.09%, 1000=0.45%
lat (msec) : 2=4.92%, 4=32.57%, 10=41.11%, 20=6.13%, 50=3.70%
lat (msec) : 100=0.45%, 250=3.35%, 500=0.33%
fsync/fdatasync/sync_file_range:
sync (nsec): min=1548, max=132590k, avg=20413901.95, stdev=10409213.94
sync percentiles (usec):
| 1.00th=[ 3818], 5.00th=[ 6259], 10.00th=[ 8291], 20.00th=[11338],
| 30.00th=[14091], 40.00th=[16319], 50.00th=[19006], 60.00th=[21890],
| 70.00th=[25035], 80.00th=[28443], 90.00th=[33817], 95.00th=[39060],
| 99.00th=[51119], 99.50th=[55837], 99.90th=[72877], 99.95th=[81265],
| 99.99th=[98042]
cpu : usr=0.05%, sys=0.26%, ctx=3026358, majf=0, minf=5554
IO depths : 1=121.8%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=658658,454684,0,242907 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=85.8MiB/s (89.9MB/s), 85.8MiB/s-85.8MiB/s (89.9MB/s-89.9MB/s), io=10.0GiB (10.8GB), run=120007-120007msec
WRITE: bw=23.3MiB/s (24.5MB/s), 23.3MiB/s-23.3MiB/s (24.5MB/s-24.5MB/s), io=2802MiB (2938MB), run=120030-120030msec
Disk stats (read/write):
dm-0: ios=659620/392559, merge=0/0, ticks=3167363/1662274, in_queue=4830670, util=99.94%, aggrios=659630/392646, aggrmerge=0/1, aggrticks=3169919/1667276, aggrin_queue=4837327, aggrutil=99.92%
sda: ios=659630/392646, merge=0/1, ticks=3169919/1667276, in_queue=4837327, util=99.92%
Mysql的测试结果-rocky87
innodb-trxlog: (groupid=0, jobs=160): err= 0: pid=47012: Mon Jun 26 04:10:24 2023
read: IOPS=6997, BW=109MiB/s (115MB/s)(12.8GiB/120004msec)
clat (usec): min=310, max=22497, avg=3822.28, stdev=1627.84
lat (usec): min=310, max=22497, avg=3822.41, stdev=1627.84
clat percentiles (usec):
| 1.00th=[ 1045], 5.00th=[ 2212], 10.00th=[ 2442], 20.00th=[ 2638],
| 30.00th=[ 2769], 40.00th=[ 2900], 50.00th=[ 3064], 60.00th=[ 3425],
| 70.00th=[ 4555], 80.00th=[ 5342], 90.00th=[ 6521], 95.00th=[ 6980],
| 99.00th=[ 7701], 99.50th=[ 8094], 99.90th=[ 9241], 99.95th=[ 9896],
| 99.99th=[13173]
bw ( KiB/s): min=93652, max=308550, per=100.00%, avg=112096.54, stdev=698.13, samples=7648
iops : min= 5852, max=19283, avg=7005.63, stdev=43.63, samples=7648
write: IOPS=2912, BW=28.5MiB/s (29.8MB/s)(3416MiB/120023msec); 0 zone resets
clat (usec): min=2, max=272143, avg=44335.24, stdev=61407.31
lat (usec): min=2, max=272143, avg=44335.38, stdev=61407.31
clat percentiles (usec):
| 1.00th=[ 10], 5.00th=[ 1336], 10.00th=[ 1909], 20.00th=[ 2147],
| 30.00th=[ 2343], 40.00th=[ 2704], 50.00th=[ 4146], 60.00th=[ 5604],
| 70.00th=[ 86508], 80.00th=[113771], 90.00th=[141558], 95.00th=[162530],
| 99.00th=[202376], 99.50th=[212861], 99.90th=[233833], 99.95th=[242222],
| 99.99th=[254804]
bw ( KiB/s): min=14744, max=84740, per=100.00%, avg=29174.34, stdev=104.23, samples=38240
iops : min= 1397, max= 8622, avg=2912.67, stdev= 7.07, samples=38240
lat (usec) : 4=0.01%, 10=0.31%, 20=0.23%, 50=0.06%, 100=0.01%
lat (usec) : 250=0.02%, 500=0.27%, 750=0.34%, 1000=0.52%
lat (msec) : 2=4.94%, 4=53.53%, 10=29.68%, 20=0.16%, 50=0.12%
lat (msec) : 100=2.20%, 250=7.59%, 500=0.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=1119, max=58075k, avg=6477896.80, stdev=3001744.81
sync percentiles (usec):
| 1.00th=[ 619], 5.00th=[ 2212], 10.00th=[ 2638], 20.00th=[ 4047],
| 30.00th=[ 4621], 40.00th=[ 5145], 50.00th=[ 6259], 60.00th=[ 7177],
| 70.00th=[ 8291], 80.00th=[ 8979], 90.00th=[10683], 95.00th=[11338],
| 99.00th=[13435], 99.50th=[14091], 99.90th=[17433], 99.95th=[19792],
| 99.99th=[22152]
cpu : usr=0.03%, sys=0.13%, ctx=1723458, majf=0, minf=2393
IO depths : 1=106.2%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=839771,349547,0,73742 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=109MiB/s (115MB/s), 109MiB/s-109MiB/s (115MB/s-115MB/s), io=12.8GiB (13.8GB), run=120004-120004msec
WRITE: bw=28.5MiB/s (29.8MB/s), 28.5MiB/s-28.5MiB/s (29.8MB/s-29.8MB/s), io=3416MiB (3582MB), run=120023-120023msec
Disk stats (read/write):
dm-0: ios=839222/377201, merge=0/0, ticks=3188909/1141035, in_queue=4329944, util=99.97%, aggrios=840359/375644, aggrmerge=0/2196, aggrticks=3199981/1140458, aggrin_queue=4340439, aggrutil=99.96%
sda: ios=840359/375644, merge=0/2196, ticks=3199981/1140458, in_queue=4340439, util=99.96%
Mysql的测试结果-kylinv10sp2
innodb-trxlog: (groupid=0, jobs=160): err= 0: pid=41787: Mon Jun 26 16:10:26 2023
read: IOPS=6218, BW=97.2MiB/s (102MB/s)(11.4GiB/120005msec)
clat (usec): min=361, max=24841, avg=4279.63, stdev=1754.73
lat (usec): min=361, max=24842, avg=4279.78, stdev=1754.73
clat percentiles (usec):
| 1.00th=[ 1090], 5.00th=[ 2409], 10.00th=[ 2671], 20.00th=[ 2900],
| 30.00th=[ 3064], 40.00th=[ 3261], 50.00th=[ 3589], 60.00th=[ 4228],
| 70.00th=[ 5080], 80.00th=[ 6063], 90.00th=[ 7046], 95.00th=[ 7504],
| 99.00th=[ 8356], 99.50th=[ 8717], 99.90th=[ 9896], 99.95th=[10945],
| 99.99th=[17433]
bw ( KiB/s): min=82410, max=289174, per=99.50%, avg=99004.97, stdev=598.19, samples=7648
iops : min= 5150, max=18073, avg=6187.45, stdev=37.39, samples=7648
write: IOPS=4224, BW=27.0MiB/s (28.3MB/s)(3244MiB/120009msec); 0 zone resets
clat (nsec): min=1375, max=271006k, avg=24767118.21, stdev=33734254.23
lat (nsec): min=1484, max=271006k, avg=24767260.89, stdev=33734259.05
clat percentiles (usec):
| 1.00th=[ 37], 5.00th=[ 229], 10.00th=[ 1745], 20.00th=[ 2474],
| 30.00th=[ 3097], 40.00th=[ 4752], 50.00th=[ 7046], 60.00th=[ 14353],
| 70.00th=[ 28705], 80.00th=[ 50070], 90.00th=[ 69731], 95.00th=[ 88605],
| 99.00th=[158335], 99.50th=[183501], 99.90th=[221250], 99.95th=[235930],
| 99.99th=[248513]
bw ( KiB/s): min=12404, max=92871, per=99.53%, avg=27546.19, stdev=93.15, samples=38240
iops : min= 1312, max=20954, avg=4194.84, stdev=11.66, samples=38240
lat (usec) : 2=0.01%, 4=0.05%, 10=0.19%, 20=0.07%, 50=0.19%
lat (usec) : 100=0.52%, 250=1.12%, 500=0.87%, 750=0.47%, 1000=0.39%
lat (msec) : 2=2.66%, 4=42.18%, 10=32.95%, 20=3.99%, 50=6.17%
lat (msec) : 100=6.69%, 250=1.47%, 500=0.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=902, max=69475k, avg=17259695.34, stdev=8115360.90
sync percentiles (usec):
| 1.00th=[ 1860], 5.00th=[ 5080], 10.00th=[ 7504], 20.00th=[10683],
| 30.00th=[12780], 40.00th=[14484], 50.00th=[16057], 60.00th=[18220],
| 70.00th=[20841], 80.00th=[23987], 90.00th=[28181], 95.00th=[31851],
| 99.00th=[39584], 99.50th=[42730], 99.90th=[51119], 99.95th=[52691],
| 99.99th=[55837]
cpu : usr=0.03%, sys=0.18%, ctx=3078817, majf=0, minf=2382
IO depths : 1=115.8%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=746260,506927,0,197648 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=97.2MiB/s (102MB/s), 97.2MiB/s-97.2MiB/s (102MB/s-102MB/s), io=11.4GiB (12.2GB), run=120005-120005msec
WRITE: bw=27.0MiB/s (28.3MB/s), 27.0MiB/s-27.0MiB/s (28.3MB/s-28.3MB/s), io=3244MiB (3401MB), run=120009-120009msec
Disk stats (read/write):
dm-0: ios=744657/478431, merge=0/0, ticks=3181039/1697753, in_queue=4878792, util=88.23%, aggrios=747601/478267, aggrmerge=0/2248, aggrticks=3189160/1695146, aggrin_queue=4271128, aggrutil=88.17%
sda: ios=747601/478267, merge=0/2248, ticks=3189160/1695146, in_queue=4271128, util=88.17%
Mysql的测试结果-openeuler2203
innodb-trxlog: (groupid=0, jobs=160): err= 0: pid=53033: Mon Jun 26 16:10:24 2023
read: IOPS=5790, BW=90.5MiB/s (94.9MB/s)(10.6GiB/120007msec)
clat (usec): min=790, max=23444, avg=4538.42, stdev=1874.99
lat (usec): min=790, max=23444, avg=4538.59, stdev=1874.99
clat percentiles (usec):
| 1.00th=[ 1909], 5.00th=[ 2442], 10.00th=[ 2671], 20.00th=[ 2933],
| 30.00th=[ 3163], 40.00th=[ 3425], 50.00th=[ 3818], 60.00th=[ 4621],
| 70.00th=[ 5407], 80.00th=[ 6521], 90.00th=[ 7373], 95.00th=[ 7963],
| 99.00th=[ 9372], 99.50th=[ 9765], 99.90th=[10683], 99.95th=[11338],
| 99.99th=[15926]
bw ( KiB/s): min=74560, max=166054, per=99.95%, avg=92597.79, stdev=340.30, samples=7648
iops : min= 4660, max=10374, avg=5787.31, stdev=21.26, samples=7648
write: IOPS=4611, BW=25.7MiB/s (27.0MB/s)(3088MiB/120014msec); 0 zone resets
clat (nsec): min=944, max=244028k, avg=21194998.71, stdev=23715099.39
lat (nsec): min=999, max=244028k, avg=21195105.85, stdev=23715085.45
clat percentiles (usec):
| 1.00th=[ 7], 5.00th=[ 2180], 10.00th=[ 2573], 20.00th=[ 3326],
| 30.00th=[ 4948], 40.00th=[ 7308], 50.00th=[ 13566], 60.00th=[ 20579],
| 70.00th=[ 26608], 80.00th=[ 33817], 90.00th=[ 46924], 95.00th=[ 66323],
| 99.00th=[116917], 99.50th=[139461], 99.90th=[173016], 99.95th=[179307],
| 99.99th=[193987]
bw ( KiB/s): min=12108, max=52553, per=99.90%, avg=26321.40, stdev=72.72, samples=38240
iops : min= 1746, max=10906, avg=4600.24, stdev= 9.56, samples=38240
lat (nsec) : 1000=0.01%
lat (usec) : 2=0.10%, 4=0.19%, 10=0.24%, 20=0.03%, 50=0.01%
lat (usec) : 100=0.01%, 250=0.01%, 500=0.03%, 750=0.04%, 1000=0.05%
lat (msec) : 2=1.70%, 4=38.07%, 10=34.51%, 20=6.90%, 50=14.26%
lat (msec) : 100=3.14%, 250=0.70%
fsync/fdatasync/sync_file_range:
sync (nsec): min=1776, max=99272k, avg=21122021.72, stdev=7629458.80
sync percentiles (usec):
| 1.00th=[ 7308], 5.00th=[10159], 10.00th=[11731], 20.00th=[15139],
| 30.00th=[16909], 40.00th=[18220], 50.00th=[20055], 60.00th=[22152],
| 70.00th=[25035], 80.00th=[27132], 90.00th=[30802], 95.00th=[34866],
| 99.00th=[42730], 99.50th=[46400], 99.90th=[53740], 99.95th=[56886],
| 99.99th=[66323]
cpu : usr=0.04%, sys=0.21%, ctx=3256717, majf=2, minf=2229
IO depths : 1=115.8%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=694850,553443,0,197563 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=90.5MiB/s (94.9MB/s), 90.5MiB/s-90.5MiB/s (94.9MB/s-94.9MB/s), io=10.6GiB (11.4GB), run=120007-120007msec
WRITE: bw=25.7MiB/s (27.0MB/s), 25.7MiB/s-25.7MiB/s (27.0MB/s-27.0MB/s), io=3088MiB (3238MB), run=120014-120014msec
Disk stats (read/write):
dm-0: ios=694821/519512, merge=0/0, ticks=3062259/1954339, in_queue=5016598, util=99.92%, aggrios=696490/504174, aggrmerge=0/17225, aggrticks=3064958/1890955, aggrin_queue=4955914, aggrutil=99.68%
sda: ios=696490/504174, merge=0/17225, ticks=3064958/1890955, in_queue=4955914, util=99.68%