2021-12-21 [redis] 生成rdb对磁盘io的压力测试
2021/12/22 2:25:04
本文主要是介绍2021-12-21 [redis] 生成rdb对磁盘io的压力测试，对大家解决编程问题具有一定的参考价值，需要的程序猿们随着小编来一起学习吧！
目录
摘要:
测试方式:
redis内存数据准备:
数据填充脚本:
测试脚本:
io测试脚本:
磁盘测试脚本:
一. 磁盘写入测试:
二. 单个redis生成快照测试磁盘io:
三. 两个redis进程分别同时生成rdb快照时的磁盘io
测试结果:
一. 磁盘基准写入数据:
二. 单个redis进程生成rdb快照:
三. 两个redis进程分别同时生成rdb快照时的磁盘io
结论:
摘要:
测试redis在生成rdb快照时,性能瓶颈
测试方式:
- 使用dd测试磁盘的写速度
- 测试单个redis生成rdb快照时的磁盘io
- 测试两个redis进程分别同时生成rdb快照时的磁盘io
redis内存数据准备:
- 向redis内填充2G的string类型数据
- 可使用py脚本使用pipeline加快数据填充速度
数据填充脚本:
# -*- coding:utf-8 -*-
import redis
import time
import random
from concurrent.futures import ProcessPoolExecutor
from rediscluster import RedisCluster
# cluster
startup_nodes = [
{"host":"127.0.0.1", "port":7000},
{"host":"127.0.0.1", "port":7001},
{"host":"127.0.0.1", "port":7002},
{"host":"127.0.0.1", "port":7003}
]
# r = RedisCluster(startup_nodes=startup_nodes, decode_responses=True)
# sin
r = redis.Redis(host='127.0.0.1', port=6379, password='')
def try_pipeline():
start = time.time()
with r.pipeline(transaction=False) as p:
for i in range(1, 1000000):
for i in range (1, 10000):
index1 = random.randint(0,1000000)
index2 = random.randint(0,1000000)
index3 = random.randint(0,1000000)
key = "key_" + str(index1) + "_" + str(index2)
value = "value_" + str(index3) + "_" + "9p3gbQjrUOjm5yFARiwrnqoBzswhfJZXcTOetMsSYyxjSluPoJeRR9T2vYKlZc6XxgenvtPHUPu6x1nI7ZdSISJEuDrrScOCG199p3gbQjrUOjm5yFARiwrnqoBzswhfJZXcTOetMsSYyxjSluPoJeRR9T2vYKlZc6XxgenvtPHUPu6x1nI7ZdSISJEuDrrScOCG199p3gbQjrUOjm5yFARiwrnqoBzswhfJZXcTOetMsSYyxjSluPoJeRR9T2vYKlZc6XxgenvtPHUPu6x1nI7ZdSISJEuDrrScOCG199p3gbQjrUOjm5yFARiwrnqoBzswhfJZXcTOetMsSYyxjSluPoJeRR9T2vYKlZc6XxgenvtPHUPu6x1nI7ZdSISJEuDrrScOCG19"
p.set(key, value)
p.execute()
print("ok")
try_pipeline()
测试脚本:
io测试脚本:
#!/bin/bash echo iotop -b -o -n 10 -d 5 -t > ./iotop.log iotop -b -o -n 10 -d 5 -t > ./iotop.log
磁盘测试脚本:
一. 磁盘写入测试:
#!/bin/bash bash ./io.sh & sync;/usr/bin/time -p bash -c "(dd if=/dev/zero of=test.dd bs=1000K count=20000;sync)"
二. 单个redis生成快照测试磁盘io:
#!/bin/bash # rm sin-redis/dump.rdb -f bash ./io.sh & time redis-cli -p 6379 save &
三. 两个redis进程分别同时生成rdb快照时的磁盘io
#!/bin/bash # rm sin-redis/dump.rdb -f # rm sin-redis2/dump.rdb -f bash ./io_two.sh & time redis-cli -p 6379 save & time redis-cli -p 6389 save &
测试结果:
一. 磁盘基准写入数据:
^C3737+0 records in
3737+0 records out
3826688000 bytes (3.8 GB, 3.6 GiB) copied, 13.8006 s, 277 MB/s
real 14.13
user 0.01
sys 3.29
13:37:27 Total DISK READ : 0.00 B/s | Total DISK WRITE : 0.00 B/s
13:37:27 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 0.00 B/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
13:37:32 Total DISK READ : 703.53 K/s | Total DISK WRITE : 452.99 M/s
13:37:32 Actual DISK READ: 703.53 K/s | Actual DISK WRITE: 370.28 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:37:32 3635232 be/4 root 0.00 B/s 452.87 M/s 0.00 % 33.94 % dd if=/dev/zero of=test.dd bs=1000K count=20000'
b'13:37:32 3633611 be/4 root 814.95 B/s 0.00 B/s 0.00 % 15.73 % [kworker/u256:1+flush-8:0]'
b'13:37:32 3635167 be/7 root 702.74 K/s 96.30 K/s 0.00 % 6.52 % platform-python /usr/bin/dnf makecache --timer'
b'13:37:32 3635077 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.03 % [kworker/1:2-events_power_efficient]'
b'13:37:32 3081 be/3 root 0.00 B/s 814.95 B/s 0.00 % 0.00 % auditd'
b'13:37:32 3243 be/4 root 0.00 B/s 814.95 B/s 0.00 % 0.00 % rsyslogd -n [in:imjournal]'
b'13:37:32 3247 be/4 root 0.00 B/s 4.78 K/s 0.00 % 0.00 % rsyslogd -n [rs:main Q:Reg]'
b'13:37:32 340090 be/4 root 0.00 B/s 18.30 K/s 0.00 % 0.00 % java -Dzookeeper.log.dir=/usr/local/apache-zookeeper-3.7.0-bin/bin/../logs -Dzookeeper.log.file=zookeeper-root-server-localhost.localdomain.log -Dzookeeper.root.logger=INFO,CONSOLE -XX:+HeapDumpOnOutOfMemoryError -XX:OnOutOfMemoryError=kill -9 %p -cp /usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-jute-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/snappy-java-1.1.7.7.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-log4j12-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-api-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_common-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-unix-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-epoll-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-resolver-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-handler-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-codec-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-buffer-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/metrics-core-4.1.12.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/log4j-1.2.17.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jline-2.14.6.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-ajax-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-servlet-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-server-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-security-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-io-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-http-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-databind-2.10.5.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-core-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-annotations-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/commons-cli-1.4.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/audience-annotations-0.12.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../conf: -Xmx1000m -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/apache-zookeeper-3.7.0-bin/bin/../conf/zoo.cfg [VM Periodic Tas]'
b'13:37:32 3604087 be/4 root 0.00 B/s 814.95 B/s 0.00 % 0.00 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/bootstrap-fork --type=extensionHost --uriTransformerPath=/root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/vs/server/uriTransformer.js'
b'13:37:32 3635227 be/4 root 0.00 B/s 814.95 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
13:37:37 Total DISK READ : 20.65 K/s | Total DISK WRITE : 179.01 M/s
13:37:37 Actual DISK READ: 20.65 K/s | Actual DISK WRITE: 161.78 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:37:37 3635232 be/4 root 0.00 B/s 178.29 M/s 0.00 % 82.61 % dd if=/dev/zero of=test.dd bs=1000K count=20000'
b'13:37:37 3633611 be/4 root 0.00 B/s 0.00 B/s 0.00 % 79.56 % [kworker/u256:1+flush-8:0]'
b'13:37:37 3635167 be/7 root 16.68 K/s 725.06 K/s 0.00 % 8.92 % platform-python /usr/bin/dnf makecache --timer'
b'13:37:37 3635077 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.06 % [kworker/1:2-events_power_efficient]'
b'13:37:37 3635227 be/4 root 813.22 B/s 1626.43 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
b'13:37:37 340090 be/4 root 0.00 B/s 9.53 K/s 0.00 % 0.00 % java -Dzookeeper.log.dir=/usr/local/apache-zookeeper-3.7.0-bin/bin/../logs -Dzookeeper.log.file=zookeeper-root-server-localhost.localdomain.log -Dzookeeper.root.logger=INFO,CONSOLE -XX:+HeapDumpOnOutOfMemoryError -XX:OnOutOfMemoryError=kill -9 %p -cp /usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-jute-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/snappy-java-1.1.7.7.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-log4j12-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-api-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_common-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-unix-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-epoll-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-resolver-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-handler-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-codec-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-buffer-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/metrics-core-4.1.12.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/log4j-1.2.17.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jline-2.14.6.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-ajax-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-servlet-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-server-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-security-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-io-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-http-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-databind-2.10.5.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-core-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-annotations-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/commons-cli-1.4.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/audience-annotations-0.12.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../conf: -Xmx1000m -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/apache-zookeeper-3.7.0-bin/bin/../conf/zoo.cfg [VM Periodic Tas]'
b'13:37:37 2870558 be/4 root 3.18 K/s 0.00 B/s 0.00 % 0.00 % dirmngr --daemon --homedir /root/.gnupg'
13:37:42 Total DISK READ : 0.00 B/s | Total DISK WRITE : 1239.91 K/s
13:37:42 Actual DISK READ: 10.28 M/s | Actual DISK WRITE: 159.37 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:37:42 3633611 be/4 root 0.00 B/s 0.00 B/s 0.00 % 67.42 % [kworker/u256:1-flush-8:0]'
b'13:37:42 3635167 be/7 root 0.00 B/s 1227.23 K/s 0.00 % 6.29 % platform-python /usr/bin/dnf makecache --timer'
b'13:37:42 3633588 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.05 % [kworker/1:1-events_power_efficient]'
b'13:37:42 3081 be/3 root 0.00 B/s 1622.58 B/s 0.00 % 0.00 % auditd'
b'13:37:42 3247 be/4 root 0.00 B/s 1622.58 B/s 0.00 % 0.00 % rsyslogd -n [rs:main Q:Reg]'
b'13:37:42 340090 be/4 root 0.00 B/s 7.92 K/s 0.00 % 0.00 % java -Dzookeeper.log.dir=/usr/local/apache-zookeeper-3.7.0-bin/bin/../logs -Dzookeeper.log.file=zookeeper-root-server-localhost.localdomain.log -Dzookeeper.root.logger=INFO,CONSOLE -XX:+HeapDumpOnOutOfMemoryError -XX:OnOutOfMemoryError=kill -9 %p -cp /usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-jute-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/snappy-java-1.1.7.7.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-log4j12-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-api-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_common-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-unix-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-epoll-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-resolver-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-handler-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-codec-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-buffer-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/metrics-core-4.1.12.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/log4j-1.2.17.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jline-2.14.6.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-ajax-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-servlet-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-server-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-security-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-io-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-http-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-databind-2.10.5.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-core-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-annotations-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/commons-cli-1.4.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/audience-annotations-0.12.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../conf: -Xmx1000m -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/apache-zookeeper-3.7.0-bin/bin/../conf/zoo.cfg [VM Periodic Tas]'
b'13:37:42 3635227 be/4 root 0.00 B/s 1622.58 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
二. 单个redis进程生成rdb快照:
real 0m16.749s
user 0m0.002s
sys 0m0.006s
13:00:01 Total DISK READ : 0.00 B/s | Total DISK WRITE : 47.68 M/s
13:00:01 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 0.00 B/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:00:01 3597773 be/4 root 0.00 B/s 47.68 M/s 0.00 % 0.00 % redis-server *:6379'
13:00:06 Total DISK READ : 0.00 B/s | Total DISK WRITE : 36.16 M/s
13:00:06 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 31.89 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:00:06 3597773 be/4 root 0.00 B/s 36.16 M/s 0.00 % 2.24 % redis-server *:6379'
b'13:00:06 3632068 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.02 % [kworker/1:1-events_power_efficient]'
b'13:00:06 3632301 be/4 root 0.00 B/s 815.80 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
13:00:11 Total DISK READ : 0.00 B/s | Total DISK WRITE : 37.67 M/s
13:00:11 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 38.04 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:00:11 3597773 be/4 root 0.00 B/s 37.67 M/s 0.00 % 2.24 % redis-server *:6379'
b'13:00:11 3632068 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.02 % [kworker/1:1-events_power_efficient]'
b'13:00:11 3243 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % rsyslogd -n [in:imjournal]'
b'13:00:11 3247 be/4 root 0.00 B/s 811.37 B/s 0.00 % 0.00 % rsyslogd -n [rs:main Q:Reg]'
b'13:00:11 3632301 be/4 root 0.00 B/s 811.37 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
13:00:16 Total DISK READ : 210.03 K/s | Total DISK WRITE : 35.40 M/s
13:00:16 Actual DISK READ: 210.03 K/s | Actual DISK WRITE: 38.29 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:00:16 3592870 be/4 root 46.14 K/s 0.00 B/s 0.00 % 9.24 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/vs/server/main.js --start-server --host=127.0.0.1 --enable-remote-auto-shutdown --port=0 --connection-secret /root/.vscode-server/.899d46d82c4c95423fb7e10e68eba52050e30ba3.token'
b'13:00:16 3592871 be/4 root 42.96 K/s 0.00 B/s 0.00 % 9.14 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/vs/server/main.js --start-server --host=127.0.0.1 --enable-remote-auto-shutdown --port=0 --connection-secret /root/.vscode-server/.899d46d82c4c95423fb7e10e68eba52050e30ba3.token'
b'13:00:16 3592868 be/4 root 86.72 K/s 0.00 B/s 0.00 % 5.13 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/vs/server/main.js --start-server --host=127.0.0.1 --enable-remote-auto-shutdown --port=0 --connection-secret /root/.vscode-server/.899d46d82c4c95423fb7e10e68eba52050e30ba3.token'
b'13:00:16 3592869 be/4 root 34.21 K/s 0.00 B/s 0.00 % 4.57 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/vs/server/main.js --start-server --host=127.0.0.1 --enable-remote-auto-shutdown --port=0 --connection-secret /root/.vscode-server/.899d46d82c4c95423fb7e10e68eba52050e30ba3.token'
b'13:00:16 3597773 be/4 root 0.00 B/s 35.40 M/s 0.00 % 2.34 % redis-server *:6379'
b'13:00:16 3632068 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.01 % [kworker/1:1-events_power_efficient]'
13:00:21 Total DISK READ : 814.43 B/s | Total DISK WRITE : 10.45 M/s
13:00:21 Actual DISK READ: 756.37 K/s | Actual DISK WRITE: 12.43 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:00:21 3597773 be/4 root 814.43 B/s 10.45 M/s 0.00 % 0.67 % redis-server *:6379'
b'13:00:21 3082 be/3 root 0.00 B/s 0.00 B/s 0.00 % 0.06 % auditd'
b'13:00:21 3632068 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.01 % [kworker/1:1-ata_sff]'
b'13:00:21 3607290 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kworker/1:0-mpt_poll_0]'
b'13:00:21 3243 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % rsyslogd -n [in:imjournal]'
13:00:26 Total DISK READ : 0.00 B/s | Total DISK WRITE : 2.39 K/s
13:00:26 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 3.19 K/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'13:00:26 3607290 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.02 % [kworker/1:0-events_power_efficient]'
b'13:00:26 340090 be/4 root 0.00 B/s 1632.62 B/s 0.00 % 0.00 % java -Dzookeeper.log.dir=/usr/local/apache-zookeeper-3.7.0-bin/bin/../logs -Dzookeeper.log.file=zookeeper-root-server-localhost.localdomain.log -Dzookeeper.root.logger=INFO,CONSOLE -XX:+HeapDumpOnOutOfMemoryError -XX:OnOutOfMemoryError=kill -9 %p -cp /usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/classes:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/target/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../build/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-prometheus-metrics-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-jute-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/zookeeper-3.7.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/snappy-java-1.1.7.7.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-log4j12-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/slf4j-api-1.7.30.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient_common-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/simpleclient-0.9.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-unix-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-native-epoll-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-transport-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-resolver-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-handler-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-common-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-codec-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/netty-buffer-4.1.59.Final.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/metrics-core-4.1.12.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/log4j-1.2.17.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jline-2.14.6.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-ajax-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-util-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-servlet-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-server-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-security-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-io-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jetty-http-9.4.38.v20210224.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-databind-2.10.5.1.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-core-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/jackson-annotations-2.10.5.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/commons-cli-1.4.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../lib/audience-annotations-0.12.0.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/usr/local/apache-zookeeper-3.7.0-bin/bin/../conf: -Xmx1000m -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/apache-zookeeper-3.7.0-bin/bin/../conf/zoo.cfg [VM Periodic Tas]'
b'13:00:26 3632301 be/4 root 0.00 B/s 816.31 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
三. 两个redis进程分别同时生成rdb快照时的磁盘io
real 0m15.922s
user 0m0.002s
sys 0m0.005s
OK
real 0m15.929s
user 0m0.002s
sys 0m0.009s
12:58:24 Total DISK READ : 0.00 B/s | Total DISK WRITE : 40.44 M/s
12:58:24 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 0.00 B/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'12:58:24 3597773 be/4 root 0.00 B/s 9.18 M/s 0.00 % 0.00 % redis-server *:6379'
b'12:58:24 3599437 be/4 root 0.00 B/s 31.26 M/s 0.00 % 0.00 % redis-server *:6389'
12:58:29 Total DISK READ : 0.00 B/s | Total DISK WRITE : 72.65 M/s
12:58:29 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 63.46 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'12:58:29 3597773 be/4 root 0.00 B/s 35.98 M/s 0.00 % 0.58 % redis-server *:6379'
b'12:58:29 3599437 be/4 root 0.00 B/s 36.67 M/s 0.00 % 0.42 % redis-server *:6389'
b'12:58:29 3607290 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.02 % [kworker/1:0-ata_sff]'
b'12:58:29 3081 be/3 root 0.00 B/s 1624.04 B/s 0.00 % 0.00 % auditd'
b'12:58:29 3243 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % rsyslogd -n [in:imjournal]'
b'12:58:29 3247 be/4 root 0.00 B/s 812.02 B/s 0.00 % 0.00 % rsyslogd -n [rs:main Q:Reg]'
b'12:58:29 3604087 be/4 root 0.00 B/s 812.02 B/s 0.00 % 0.00 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/bootstrap-fork --type=extensionHost --uriTransformerPath=/root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/vs/server/uriTransformer.js'
b'12:58:29 3632048 be/4 root 0.00 B/s 812.02 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
12:58:34 Total DISK READ : 0.00 B/s | Total DISK WRITE : 75.05 M/s
12:58:34 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 74.72 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'12:58:34 3597773 be/4 root 0.00 B/s 37.22 M/s 0.00 % 0.56 % redis-server *:6379'
b'12:58:34 3599437 be/4 root 0.00 B/s 37.82 M/s 0.00 % 0.24 % redis-server *:6389'
b'12:58:34 3632068 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.04 % [kworker/1:1-events_power_efficient]'
12:58:39 Total DISK READ : 0.00 B/s | Total DISK WRITE : 82.87 M/s
12:58:39 Actual DISK READ: 0.00 B/s | Actual DISK WRITE: 88.83 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'12:58:39 3599437 be/4 root 0.00 B/s 41.86 M/s 0.00 % 0.88 % redis-server *:6389'
b'12:58:39 3597773 be/4 root 0.00 B/s 41.01 M/s 0.00 % 0.32 % redis-server *:6379'
b'12:58:39 3632068 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.03 % [kworker/1:1-events_power_efficient]'
b'12:58:39 3243 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % rsyslogd -n [in:imjournal]'
b'12:58:39 3247 be/4 root 0.00 B/s 811.96 B/s 0.00 % 0.00 % rsyslogd -n [rs:main Q:Reg]'
12:58:44 Total DISK READ : 771.13 K/s | Total DISK WRITE : 9.41 M/s
12:58:44 Actual DISK READ: 771.13 K/s | Actual DISK WRITE: 13.48 M/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'12:58:44 3597773 be/4 root 3.98 K/s 5.17 M/s 0.00 % 0.68 % redis-server *:6379'
b'12:58:44 3599437 be/4 root 3.98 K/s 4.24 M/s 0.00 % 0.67 % redis-server *:6389'
b'12:58:44 3632068 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.04 % [kworker/1:1-xfs-buf/sda3]'
b'12:58:44 3604110 be/4 root 762.38 K/s 0.00 B/s 0.00 % 0.03 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/bootstrap-fork --type=watcherServiceParcel'
b'12:58:44 3607200 be/4 root 814.90 B/s 0.00 B/s 0.00 % 0.00 % [kworker/u256:2-flush-8:0]'
12:58:49 Total DISK READ : 1615.95 B/s | Total DISK WRITE : 807.98 B/s
12:58:49 Actual DISK READ: 1615.95 B/s | Actual DISK WRITE: 0.00 B/s
TIME TID PRIO USER DISK READ DISK WRITE SWAPIN IO COMMAND
b'12:58:49 3607290 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.01 % [kworker/1:0-events_power_efficient]'
b'12:58:49 3598709 be/4 root 1615.95 B/s 0.00 B/s 0.00 % 0.00 % node /root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/bootstrap-fork --type=extensionHost --uriTransformerPath=/root/.vscode-server/bin/899d46d82c4c95423fb7e10e68eba52050e30ba3/out/vs/server/uriTransformer.js'
b'12:58:49 3632048 be/4 root 0.00 B/s 807.98 B/s 0.00 % 0.00 % platform-python -s /usr/sbin/iotop -b -o -n 10 -d 5 -t'
结论:
- 磁盘的写速度在 277 MB/s
- redis生成rdb快照的速度, 无论是单个redis, 还是两个redis进程同时进行. 都保持在 40MB/s左右
- redis生成快照的速度远小于磁盘io的上限
这篇关于2021-12-21 [redis] 生成rdb对磁盘io的压力测试的文章就介绍到这儿，希望我们推荐的文章对大家有所帮助，也希望大家多多支持为之网！
- 2024-11-08阿里云Redis项目实战入门教程
- 2024-11-08阿里云Redis资料：新手入门与初级使用指南
- 2024-11-08阿里云Redis教程：新手入门及实用指南
- 2024-11-07阿里云Redis学习入门：新手必读指南
- 2024-11-07阿里云Redis学习入门：从零开始的操作指南
- 2024-11-07阿里云Redis学习：初学者指南
- 2024-11-06阿里云Redis入门教程：轻松搭建与使用指南
- 2024-11-02Redis项目实战：新手入门教程
- 2024-10-22Redis入门教程：轻松掌握数据存储与操作
- 2024-10-22Redis缓存入门教程：快速掌握Redis缓存基础知识
