SPDK benchmark memo
•
1 like•592 views
This document summarizes benchmark testing of the Intel Storage Performance Development Kit (SPDK) using the Flexible I/O tester (fio). It describes: 1) Installing the required packages and cloning/compiling SPDK and fio. 2) Running fio with the SPDK plugin to perform read operations on a NVMe device at a block size of 4KB with 8 jobs and an iodepth of 4. 3) The results showing over 570k IOPS and 2.2GB/s throughput for the read workload.
![Intel SPDK(Storage Performance Development Kit) benchmark
2
# uname -sr;
Linux 4.10.0-40-generic
# apt-get install libnuma-dev git uuid-dev libaio-dev libcunit1-dev libcunit1 libssl-dev g++ -y
# cd /opt/; git clone https://github.com/axboe/fio
# cd fio; git checkout -b fio-2.21
# make; make install
# cd /opt/; git clone https://github.com/spdk/spdk
# cd sdpk; git submodule update --init
# ./configure --with-fio=/opt/fio/
# make
# /opt/spdk/scripts/setup.sh
# fio --name=nvme --numjobs=8 --filename="trtype=PCIe traddr=0000.01.00.0 ns=1" --bs=4K --iodepth=4
--ioengine=/opt/spdk/examples/nvme/fio_plugin/fio_plugin
--group_reporting --size=50% --runtime=100 --thread=8 --rw=read
nvme: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T)
4096B-4096B, ioengine=spdk, iodepth=4
...
fio-3.2-19-g609ac1
Starting 8 threads
Starting DPDK 17.11.0 initialization...
[ DPDK EAL parameters: fio -c 0x1 -m 512 --file-prefix=spdk_pid18356 ]
EAL: Detected 8 lcore(s)
EAL: No free hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: PCI device 0000:01:00.0 on NUMA socket 0
EAL: probe driver: 8086:2700 spdk_nvme
nvme: (groupid=0, jobs=8): err= 0: pid=18367: Mon Nov 27 15:36:06 2017
read: IOPS=572k, BW=2236MiB/s (2345MB/s)(218GiB/100001msec)
slat (nsec): min=91, max=471828, avg=200.94, stdev=122.85
clat (usec): min=9, max=13319, avg=55.44, stdev= 7.84
lat (usec): min=14, max=13319, avg=55.64, stdev= 7.84
clat percentiles (usec):
| 1.00th=[ 48], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 51],
| 30.00th=[ 52], 40.00th=[ 53], 50.00th=[ 53], 60.00th=[ 54],
| 70.00th=[ 56], 80.00th=[ 60], 90.00th=[ 64], 95.00th=[ 67],
| 99.00th=[ 88], 99.50th=[ 91], 99.90th=[ 100], 99.95th=[ 111],
| 99.99th=[ 121]
bw ( KiB/s): min=242664, max=310392, per=12.50%, avg=286296.77, stdev=11653.87, samples=1592
iops : min=60666, max=77598, avg=71574.18, stdev=2913.46, samples=1592
lat (usec) : 10=0.01%, 20=0.01%, 50=9.44%, 100=90.46%, 250=0.09%
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 20=0.01%](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
More Related Content
What's hot
What's hot (18)
Similar to SPDK benchmark memo
Similar to SPDK benchmark memo (20)
More from Naoto MATSUMOTO
More from Naoto MATSUMOTO (20)
Recently uploaded
Recently uploaded (20)
SPDK benchmark memo
- 1. SPDK benchmark memo 2017/11/27 SAKURA Internet, Inc. Research Center SR / Naoto MATSUMOTO (C) Copyright 1996-2017 SAKURA Internet Inc
- 2. Intel SPDK(Storage Performance Development Kit) benchmark 2 # uname -sr; Linux 4.10.0-40-generic # apt-get install libnuma-dev git uuid-dev libaio-dev libcunit1-dev libcunit1 libssl-dev g++ -y # cd /opt/; git clone https://github.com/axboe/fio # cd fio; git checkout -b fio-2.21 # make; make install # cd /opt/; git clone https://github.com/spdk/spdk # cd sdpk; git submodule update --init # ./configure --with-fio=/opt/fio/ # make # /opt/spdk/scripts/setup.sh # fio --name=nvme --numjobs=8 --filename="trtype=PCIe traddr=0000.01.00.0 ns=1" --bs=4K --iodepth=4 --ioengine=/opt/spdk/examples/nvme/fio_plugin/fio_plugin --group_reporting --size=50% --runtime=100 --thread=8 --rw=read nvme: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=4 ... fio-3.2-19-g609ac1 Starting 8 threads Starting DPDK 17.11.0 initialization... [ DPDK EAL parameters: fio -c 0x1 -m 512 --file-prefix=spdk_pid18356 ] EAL: Detected 8 lcore(s) EAL: No free hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: PCI device 0000:01:00.0 on NUMA socket 0 EAL: probe driver: 8086:2700 spdk_nvme nvme: (groupid=0, jobs=8): err= 0: pid=18367: Mon Nov 27 15:36:06 2017 read: IOPS=572k, BW=2236MiB/s (2345MB/s)(218GiB/100001msec) slat (nsec): min=91, max=471828, avg=200.94, stdev=122.85 clat (usec): min=9, max=13319, avg=55.44, stdev= 7.84 lat (usec): min=14, max=13319, avg=55.64, stdev= 7.84 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 51], | 30.00th=[ 52], 40.00th=[ 53], 50.00th=[ 53], 60.00th=[ 54], | 70.00th=[ 56], 80.00th=[ 60], 90.00th=[ 64], 95.00th=[ 67], | 99.00th=[ 88], 99.50th=[ 91], 99.90th=[ 100], 99.95th=[ 111], | 99.99th=[ 121] bw ( KiB/s): min=242664, max=310392, per=12.50%, avg=286296.77, stdev=11653.87, samples=1592 iops : min=60666, max=77598, avg=71574.18, stdev=2913.46, samples=1592 lat (usec) : 10=0.01%, 20=0.01%, 50=9.44%, 100=90.46%, 250=0.09% lat (usec) : 500=0.01%, 750=0.01% lat (msec) : 2=0.01%, 20=0.01%