[linux-lvm] Testing the new LVM cache feature
Richard W.M. Jones
rjones at redhat.com
Thu May 29 13:52:46 UTC 2014
I've done some more testing, comparing RAID 1 HDD with RAID 1 HDD + an
SSD overlay (using lvm-cache).
I'm now using 'fio', with the following job file:
[virt]
ioengine=libaio
iodepth=4
rw=randrw
bs=64k
direct=1
size=1g
numjobs=4
I'm still seeing almost no benefit from LVM cache. It's about 4%
faster than the underlying, slow HDDs. See attached runs.
The SSD LV is 200 GB and the underlying LV is 800 GB, so I would
expect there is plenty of space to cache things in the SSD during the
test.
For comparison, the fio tests runs about 11 times faster on the SSD.
Any ideas?
Rich.
--
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
virt-p2v converts physical machines to virtual machines. Boot with a
live CD or over the network (PXE) and turn machines into KVM guests.
http://libguestfs.org/virt-v2v
-------------- next part --------------
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
...
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
fio-2.1.2
Starting 4 processes
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: (groupid=0, jobs=1): err= 0: pid=2195: Wed May 28 22:12:50 2014
read : io=523520KB, bw=2600.4KB/s, iops=40, runt=201329msec
slat (usec): min=23, max=24586, avg=65.89, stdev=306.38
clat (usec): min=305, max=1765.7K, avg=84912.67, stdev=124153.30
lat (usec): min=367, max=1765.8K, avg=84979.16, stdev=124150.29
clat percentiles (usec):
| 1.00th=[ 780], 5.00th=[ 6944], 10.00th=[ 9536], 20.00th=[14144],
| 30.00th=[19840], 40.00th=[28032], 50.00th=[40704], 60.00th=[57600],
| 70.00th=[82432], 80.00th=[125440], 90.00th=[209920], 95.00th=[309248],
| 99.00th=[593920], 99.50th=[790528], 99.90th=[1204224], 99.95th=[1286144],
| 99.99th=[1761280]
bw (KB /s): min= 82, max=12416, per=25.85%, avg=2688.32, stdev=1545.40
write: io=525056KB, bw=2607.1KB/s, iops=40, runt=201329msec
slat (usec): min=31, max=140675, avg=132.77, stdev=1945.34
clat (usec): min=346, max=1355.5K, avg=13280.27, stdev=57149.27
lat (usec): min=404, max=1355.6K, avg=13413.69, stdev=57202.63
clat percentiles (usec):
| 1.00th=[ 358], 5.00th=[ 374], 10.00th=[ 434], 20.00th=[ 446],
| 30.00th=[ 644], 40.00th=[ 852], 50.00th=[ 1272], 60.00th=[ 1320],
| 70.00th=[ 1496], 80.00th=[ 5728], 90.00th=[18048], 95.00th=[63232],
| 99.00th=[257024], 99.50th=[382976], 99.90th=[831488], 99.95th=[946176],
| 99.99th=[1351680]
bw (KB /s): min= 121, max=10709, per=25.96%, avg=2708.14, stdev=1769.64
lat (usec) : 500=12.91%, 750=6.04%, 1000=3.25%
lat (msec) : 2=16.32%, 4=1.65%, 10=7.59%, 20=12.91%, 50=14.75%
lat (msec) : 100=9.90%, 250=10.51%, 500=3.19%, 750=0.66%, 1000=0.20%
lat (msec) : 2000=0.13%
cpu : usr=0.11%, sys=0.54%, ctx=16504, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=2196: Wed May 28 22:12:50 2014
read : io=523520KB, bw=2947.6KB/s, iops=46, runt=177615msec
slat (usec): min=24, max=59936, avg=81.73, stdev=987.31
clat (usec): min=149, max=1054.1K, avg=74995.11, stdev=93418.23
lat (usec): min=369, max=1054.2K, avg=75077.47, stdev=93411.06
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 16],
| 30.00th=[ 22], 40.00th=[ 31], 50.00th=[ 42], 60.00th=[ 57],
| 70.00th=[ 80], 80.00th=[ 116], 90.00th=[ 180], 95.00th=[ 260],
| 99.00th=[ 437], 99.50th=[ 529], 99.90th=[ 840], 99.95th=[ 979],
| 99.99th=[ 1057]
bw (KB /s): min= 113, max= 6898, per=29.26%, avg=3043.36, stdev=1217.82
write: io=525056KB, bw=2956.2KB/s, iops=46, runt=177615msec
slat (usec): min=33, max=140655, avg=128.77, stdev=2069.57
clat (usec): min=258, max=1000.6K, avg=11590.37, stdev=57029.08
lat (usec): min=403, max=1000.7K, avg=11719.76, stdev=57077.03
clat percentiles (usec):
| 1.00th=[ 362], 5.00th=[ 378], 10.00th=[ 434], 20.00th=[ 446],
| 30.00th=[ 612], 40.00th=[ 748], 50.00th=[ 1224], 60.00th=[ 1304],
| 70.00th=[ 1352], 80.00th=[ 1528], 90.00th=[ 7776], 95.00th=[55040],
| 99.00th=[244736], 99.50th=[362496], 99.90th=[913408], 99.95th=[929792],
| 99.99th=[1003520]
bw (KB /s): min= 140, max= 7409, per=29.16%, avg=3042.19, stdev=1466.35
lat (usec) : 250=0.01%, 500=13.49%, 750=6.57%, 1000=3.19%
lat (msec) : 2=19.84%, 4=1.70%, 10=5.92%, 20=9.95%, 50=14.89%
lat (msec) : 100=10.81%, 250=10.45%, 500=2.73%, 750=0.31%, 1000=0.13%
lat (msec) : 2000=0.02%
cpu : usr=0.14%, sys=0.59%, ctx=16858, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=2197: Wed May 28 22:12:50 2014
read : io=523520KB, bw=2923.2KB/s, iops=45, runt=179092msec
slat (usec): min=20, max=99838, avg=91.84, stdev=1411.97
clat (usec): min=160, max=1512.4K, avg=75755.06, stdev=105522.71
lat (usec): min=382, max=1512.9K, avg=75847.54, stdev=105514.14
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 15],
| 30.00th=[ 21], 40.00th=[ 29], 50.00th=[ 40], 60.00th=[ 56],
| 70.00th=[ 76], 80.00th=[ 112], 90.00th=[ 186], 95.00th=[ 269],
| 99.00th=[ 469], 99.50th=[ 586], 99.90th=[ 1156], 99.95th=[ 1287],
| 99.99th=[ 1516]
bw (KB /s): min= 124, max= 6144, per=29.37%, avg=3055.29, stdev=1223.87
write: io=525056KB, bw=2931.8KB/s, iops=45, runt=179092msec
slat (usec): min=35, max=140660, avg=114.41, stdev=1768.12
clat (usec): min=345, max=1441.6K, avg=11547.93, stdev=62451.29
lat (usec): min=415, max=1441.7K, avg=11663.01, stdev=62476.14
clat percentiles (usec):
| 1.00th=[ 362], 5.00th=[ 378], 10.00th=[ 434], 20.00th=[ 446],
| 30.00th=[ 596], 40.00th=[ 756], 50.00th=[ 1224], 60.00th=[ 1304],
| 70.00th=[ 1352], 80.00th=[ 1544], 90.00th=[ 8896], 95.00th=[37632],
| 99.00th=[232448], 99.50th=[350208], 99.90th=[995328], 99.95th=[1044480],
| 99.99th=[1433600]
bw (KB /s): min= 80, max= 9325, per=29.37%, avg=3063.24, stdev=1532.25
lat (usec) : 250=0.01%, 500=13.56%, 750=6.50%, 1000=3.08%
lat (msec) : 2=19.73%, 4=1.62%, 10=6.32%, 20=10.52%, 50=14.89%
lat (msec) : 100=10.77%, 250=9.75%, 500=2.72%, 750=0.27%, 1000=0.13%
lat (msec) : 2000=0.14%
cpu : usr=0.14%, sys=0.59%, ctx=16985, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=2198: Wed May 28 22:12:50 2014
read : io=523520KB, bw=2629.9KB/s, iops=41, runt=199069msec
slat (usec): min=25, max=99063, avg=89.77, stdev=1365.24
clat (usec): min=112, max=1392.1K, avg=83373.43, stdev=118987.34
lat (usec): min=369, max=1392.1K, avg=83463.84, stdev=118977.09
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 10], 20.00th=[ 15],
| 30.00th=[ 21], 40.00th=[ 28], 50.00th=[ 40], 60.00th=[ 57],
| 70.00th=[ 81], 80.00th=[ 122], 90.00th=[ 206], 95.00th=[ 310],
| 99.00th=[ 603], 99.50th=[ 734], 99.90th=[ 979], 99.95th=[ 1156],
| 99.99th=[ 1401]
bw (KB /s): min= 64, max= 9708, per=26.35%, avg=2740.70, stdev=1540.11
write: io=525056KB, bw=2637.6KB/s, iops=41, runt=199069msec
slat (usec): min=38, max=140657, avg=121.47, stdev=1860.80
clat (usec): min=349, max=1002.9K, avg=13698.39, stdev=66153.66
lat (usec): min=405, max=1002.9K, avg=13820.49, stdev=66192.16
clat percentiles (usec):
| 1.00th=[ 362], 5.00th=[ 378], 10.00th=[ 434], 20.00th=[ 446],
| 30.00th=[ 652], 40.00th=[ 876], 50.00th=[ 1272], 60.00th=[ 1320],
| 70.00th=[ 1448], 80.00th=[ 2992], 90.00th=[15552], 95.00th=[36096],
| 99.00th=[321536], 99.50th=[489472], 99.90th=[962560], 99.95th=[995328],
| 99.99th=[1003520]
bw (KB /s): min= 71, max= 9836, per=26.41%, avg=2755.14, stdev=1757.17
lat (usec) : 250=0.02%, 500=12.84%, 750=5.83%, 1000=3.12%
lat (msec) : 2=17.58%, 4=1.73%, 10=7.50%, 20=12.41%, 50=14.97%
lat (msec) : 100=9.86%, 250=9.86%, 500=3.19%, 750=0.78%, 1000=0.25%
lat (msec) : 2000=0.06%
cpu : usr=0.12%, sys=0.53%, ctx=16540, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=2045.0MB, aggrb=10401KB/s, minb=2600KB/s, maxb=2947KB/s, mint=177615msec, maxt=201329msec
WRITE: io=2051.0MB, aggrb=10431KB/s, minb=2607KB/s, maxb=2956KB/s, mint=177615msec, maxt=201329msec
Disk stats (read/write):
dm-0: ios=32841/33299, merge=0/0, ticks=2623746/506809, in_queue=3130698, util=100.00%, aggrios=32855/33392, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00%
md127: ios=32855/33392, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16426/33225, aggrmerge=1/168, aggrticks=1311820/306619, aggrin_queue=1618332, aggrutil=98.91%
sda: ios=8494/33223, merge=0/171, ticks=464540/232964, in_queue=697442, util=96.18%
sdb: ios=24359/33228, merge=2/166, ticks=2159100/380274, in_queue=2539222, util=98.91%
-------------- next part --------------
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
...
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
fio-2.1.2
Starting 4 processes
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: Laying out IO file(s) (1 file(s) / 1024MB)
virt: (groupid=0, jobs=1): err= 0: pid=1643: Thu May 29 14:44:39 2014
read : io=523520KB, bw=2721.8KB/s, iops=42, runt=192348msec
slat (usec): min=36, max=11159, avg=79.21, stdev=140.35
clat (usec): min=305, max=1346.1K, avg=82931.26, stdev=118358.55
lat (usec): min=383, max=1347.8K, avg=83011.13, stdev=118357.33
clat percentiles (usec):
| 1.00th=[ 556], 5.00th=[ 6368], 10.00th=[ 8896], 20.00th=[13632],
| 30.00th=[18816], 40.00th=[26496], 50.00th=[38144], 60.00th=[55552],
| 70.00th=[81408], 80.00th=[125440], 90.00th=[211968], 95.00th=[313344],
| 99.00th=[561152], 99.50th=[708608], 99.90th=[1056768], 99.95th=[1138688],
| 99.99th=[1351680]
bw (KB /s): min= 64, max=13714, per=25.99%, avg=2828.82, stdev=1614.75
write: io=525056KB, bw=2729.8KB/s, iops=42, runt=192348msec
slat (usec): min=40, max=120228, avg=113.58, stdev=1327.58
clat (usec): min=345, max=1401.6K, avg=10882.68, stdev=66932.84
lat (usec): min=428, max=1401.7K, avg=10996.89, stdev=66947.30
clat percentiles (usec):
| 1.00th=[ 358], 5.00th=[ 366], 10.00th=[ 386], 20.00th=[ 442],
| 30.00th=[ 612], 40.00th=[ 812], 50.00th=[ 1240], 60.00th=[ 1304],
| 70.00th=[ 1448], 80.00th=[ 2960], 90.00th=[12736], 95.00th=[23168],
| 99.00th=[259072], 99.50th=[403456], 99.90th=[995328], 99.95th=[1286144],
| 99.99th=[1400832]
bw (KB /s): min= 105, max=13079, per=26.20%, avg=2860.76, stdev=1798.77
lat (usec) : 500=13.62%, 750=6.18%, 1000=2.75%
lat (msec) : 2=17.00%, 4=1.83%, 10=8.55%, 20=12.82%, 50=14.40%
lat (msec) : 100=9.28%, 250=9.26%, 500=3.45%, 750=0.50%, 1000=0.23%
lat (msec) : 2000=0.13%
cpu : usr=0.13%, sys=0.69%, ctx=16575, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=1644: Thu May 29 14:44:39 2014
read : io=523520KB, bw=3056.4KB/s, iops=47, runt=171287msec
slat (usec): min=34, max=166, avg=77.72, stdev=12.41
clat (usec): min=314, max=1179.1K, avg=76362.24, stdev=95270.37
lat (usec): min=386, max=1180.8K, avg=76440.60, stdev=95269.97
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 16],
| 30.00th=[ 23], 40.00th=[ 31], 50.00th=[ 42], 60.00th=[ 58],
| 70.00th=[ 80], 80.00th=[ 118], 90.00th=[ 186], 95.00th=[ 262],
| 99.00th=[ 457], 99.50th=[ 570], 99.90th=[ 791], 99.95th=[ 906],
| 99.99th=[ 1188]
bw (KB /s): min= 237, max= 6259, per=28.43%, avg=3094.94, stdev=1094.43
write: io=525056KB, bw=3065.4KB/s, iops=47, runt=171287msec
slat (usec): min=47, max=120139, avg=115.02, stdev=1329.52
clat (usec): min=343, max=958790, avg=7162.31, stdev=39237.72
lat (usec): min=422, max=958895, avg=7277.98, stdev=39265.48
clat percentiles (usec):
| 1.00th=[ 358], 5.00th=[ 370], 10.00th=[ 386], 20.00th=[ 442],
| 30.00th=[ 588], 40.00th=[ 740], 50.00th=[ 1192], 60.00th=[ 1288],
| 70.00th=[ 1320], 80.00th=[ 1496], 90.00th=[ 3216], 95.00th=[15552],
| 99.00th=[183296], 99.50th=[301056], 99.90th=[514048], 99.95th=[610304],
| 99.99th=[962560]
bw (KB /s): min= 100, max= 7418, per=28.37%, avg=3097.42, stdev=1395.25
lat (usec) : 500=13.75%, 750=6.58%, 1000=3.16%
lat (msec) : 2=20.43%, 4=1.64%, 10=6.06%, 20=9.94%, 50=14.88%
lat (msec) : 100=10.52%, 250=9.92%, 500=2.67%, 750=0.35%, 1000=0.06%
lat (msec) : 2000=0.01%
cpu : usr=0.14%, sys=0.79%, ctx=16933, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=1645: Thu May 29 14:44:39 2014
read : io=523520KB, bw=3097.5KB/s, iops=48, runt=169019msec
slat (usec): min=36, max=141, avg=77.24, stdev=12.48
clat (usec): min=311, max=1577.6K, avg=74149.52, stdev=97313.65
lat (usec): min=376, max=1577.6K, avg=74227.41, stdev=97313.32
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 15],
| 30.00th=[ 22], 40.00th=[ 30], 50.00th=[ 42], 60.00th=[ 56],
| 70.00th=[ 77], 80.00th=[ 112], 90.00th=[ 176], 95.00th=[ 251],
| 99.00th=[ 453], 99.50th=[ 578], 99.90th=[ 947], 99.95th=[ 1254],
| 99.99th=[ 1582]
bw (KB /s): min= 62, max= 7492, per=29.37%, avg=3197.36, stdev=1186.93
write: io=525056KB, bw=3106.6KB/s, iops=48, runt=169019msec
slat (usec): min=47, max=120168, avg=112.54, stdev=1325.71
clat (usec): min=335, max=1474.2K, avg=8254.87, stdev=57083.94
lat (usec): min=416, max=1474.3K, avg=8368.05, stdev=57098.21
clat percentiles (usec):
| 1.00th=[ 358], 5.00th=[ 366], 10.00th=[ 386], 20.00th=[ 442],
| 30.00th=[ 564], 40.00th=[ 724], 50.00th=[ 1176], 60.00th=[ 1272],
| 70.00th=[ 1320], 80.00th=[ 1464], 90.00th=[ 2224], 95.00th=[13504],
| 99.00th=[185344], 99.50th=[321536], 99.90th=[1019904], 99.95th=[1073152],
| 99.99th=[1466368]
bw (KB /s): min= 109, max= 8172, per=29.43%, avg=3213.21, stdev=1535.62
lat (usec) : 500=14.15%, 750=6.58%, 1000=3.03%
lat (msec) : 2=20.82%, 4=1.48%, 10=6.24%, 20=9.75%, 50=14.67%
lat (msec) : 100=10.94%, 250=9.46%, 500=2.37%, 750=0.34%, 1000=0.07%
lat (msec) : 2000=0.10%
cpu : usr=0.13%, sys=0.81%, ctx=16936, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=1646: Thu May 29 14:44:39 2014
read : io=523520KB, bw=2773.6KB/s, iops=43, runt=188788msec
slat (usec): min=23, max=2618, avg=77.53, stdev=31.29
clat (usec): min=309, max=1755.5K, avg=82247.61, stdev=119257.63
lat (usec): min=356, max=1755.6K, avg=82325.78, stdev=119257.35
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 10], 20.00th=[ 14],
| 30.00th=[ 20], 40.00th=[ 27], 50.00th=[ 38], 60.00th=[ 55],
| 70.00th=[ 81], 80.00th=[ 122], 90.00th=[ 212], 95.00th=[ 306],
| 99.00th=[ 578], 99.50th=[ 750], 99.90th=[ 988], 99.95th=[ 1106],
| 99.99th=[ 1762]
bw (KB /s): min= 122, max= 9325, per=26.30%, avg=2863.03, stdev=1442.98
write: io=525056KB, bw=2781.2KB/s, iops=43, runt=188788msec
slat (usec): min=44, max=120232, avg=112.99, stdev=1326.51
clat (usec): min=346, max=1033.4K, avg=9830.80, stdev=52064.46
lat (usec): min=421, max=1033.5K, avg=9944.42, stdev=52084.32
clat percentiles (usec):
| 1.00th=[ 362], 5.00th=[ 370], 10.00th=[ 386], 20.00th=[ 446],
| 30.00th=[ 588], 40.00th=[ 788], 50.00th=[ 1240], 60.00th=[ 1304],
| 70.00th=[ 1416], 80.00th=[ 1976], 90.00th=[12736], 95.00th=[23424],
| 99.00th=[244736], 99.50th=[333824], 99.90th=[937984], 99.95th=[954368],
| 99.99th=[1036288]
bw (KB /s): min= 100, max= 8694, per=26.24%, avg=2865.37, stdev=1678.69
lat (usec) : 500=13.65%, 750=6.05%, 1000=2.78%
lat (msec) : 2=18.05%, 4=1.64%, 10=7.68%, 20=12.79%, 50=14.66%
lat (msec) : 100=9.39%, 250=9.17%, 500=3.31%, 750=0.51%, 1000=0.24%
lat (msec) : 2000=0.07%
cpu : usr=0.13%, sys=0.70%, ctx=16629, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=2045.0MB, aggrb=10886KB/s, minb=2721KB/s, maxb=3097KB/s, mint=169019msec, maxt=192348msec
WRITE: io=2051.0MB, aggrb=10918KB/s, minb=2729KB/s, maxb=3106KB/s, mint=169019msec, maxt=192348msec
Disk stats (read/write):
dm-3: ios=32687/32957, merge=0/0, ticks=2580936/388295, in_queue=2969480, util=100.00%, aggrios=10910/11025, aggrmerge=0/0, aggrticks=860321/160031, aggrin_queue=1020354, aggrutil=100.00%
dm-0: ios=5/44, merge=0/0, ticks=10/85, in_queue=95, util=0.05%, aggrios=11/50, aggrmerge=0/2, aggrticks=11/94, aggrin_queue=105, aggrutil=0.05%
sdc: ios=11/50, merge=0/2, ticks=11/94, in_queue=105, util=0.05%
dm-1: ios=6/8, merge=0/0, ticks=1/9, in_queue=10, util=0.01%
dm-2: ios=32721/33023, merge=0/0, ticks=2580952/479999, in_queue=3060959, util=100.00%, aggrios=32721/33023, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00%
md127: ios=32721/33023, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16360/32937, aggrmerge=0/87, aggrticks=1290283/255548, aggrin_queue=1545711, aggrutil=99.71%
sda: ios=8101/32937, merge=1/88, ticks=402681/125603, in_queue=528232, util=96.21%
sdb: ios=24619/32938, merge=0/87, ticks=2177886/385493, in_queue=2563190, util=99.71%
More information about the linux-lvm
mailing list