[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: [linux-lvm] Testing the new LVM cache feature



I did in fact recreate the ext4 filesystem, because I didn't read your
email in time.

Here are the commands I used to create the whole lot:

----------------------------------------------------------------------
lvcreate -L 800G -n testorigin vg_guests @slow
mkfs -t ext4 /dev/vg_guests/testorigin
# at this point, I tested the speed of the uncached LV, see below
lvcreate -L 1G -n lv_cache_meta vg_guests @ssd
lvcreate -L 200G -n lv_cache vg_guests @ssd
lvconvert --type cache-pool --chunksize 32k --poolmetadata vg_guests/lv_cache_meta vg_guests/lv_cache
lvconvert --type cache --cachepool vg_guests/lv_cache vg_guests/testorigin
dmsetup message vg_guests-testorigin 0 sequential_threshold 0
dmsetup message vg_guests-testorigin 0 read_promote_adjustment 0
dmsetup message vg_guests-testorigin 0 write_promote_adjustment 0
# at this point, I tested the speed of the cached LV, see below
----------------------------------------------------------------------

To test the uncached LV, I ran the same fio test twice on the mounted
ext4 filesystem.  The results of the second run are in the first
attachment.

To test the cached LV, I ran these commands 3 times in a row:

md5sum virt.*
echo 3 > /proc/sys/vm/drop_caches

then I ran the fio test twice.  The results of the second run are
attached.

This time the LVM cache test is about 10% slower than the HDD test.
I'm not sure what to make of that at all.

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
Fedora Windows cross-compiler. Compile Windows programs, test, and
build Windows installers. Over 100 libraries supported.
http://fedoraproject.org/wiki/MinGW
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
...
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
fio-2.1.2
Starting 4 processes

virt: (groupid=0, jobs=1): err= 0: pid=5346: Fri May 30 16:06:21 2014
  read : io=523520KB, bw=2910.4KB/s, iops=45, runt=179881msec
    slat (usec): min=21, max=307271, avg=162.28, stdev=4500.17
    clat (usec): min=4, max=1491.2K, avg=78284.57, stdev=119672.87
     lat (usec): min=362, max=1491.2K, avg=78447.46, stdev=119690.26
    clat percentiles (usec):
     |  1.00th=[  410],  5.00th=[ 5536], 10.00th=[ 7968], 20.00th=[12352],
     | 30.00th=[17280], 40.00th=[24448], 50.00th=[35072], 60.00th=[48896],
     | 70.00th=[74240], 80.00th=[116224], 90.00th=[195584], 95.00th=[288768],
     | 99.00th=[577536], 99.50th=[782336], 99.90th=[1187840], 99.95th=[1335296],
     | 99.99th=[1499136]
    bw (KB  /s): min=  228, max=14924, per=25.99%, avg=3025.00, stdev=1860.17
  write: io=525056KB, bw=2918.1KB/s, iops=45, runt=179881msec
    slat (usec): min=32, max=327239, avg=577.55, stdev=9388.69
    clat (usec): min=330, max=1294.2K, avg=8890.55, stdev=46138.42
     lat (usec): min=402, max=1294.3K, avg=9468.75, stdev=47132.58
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  370], 10.00th=[  430], 20.00th=[  450],
     | 30.00th=[  668], 40.00th=[  940], 50.00th=[ 1272], 60.00th=[ 1336],
     | 70.00th=[ 1560], 80.00th=[ 5600], 90.00th=[15424], 95.00th=[24192],
     | 99.00th=[144384], 99.50th=[228352], 99.90th=[741376], 99.95th=[872448],
     | 99.99th=[1286144]
    bw (KB  /s): min=  105, max=13660, per=25.98%, avg=3033.09, stdev=2056.10
    lat (usec) : 10=0.01%, 100=0.01%, 250=0.02%, 500=12.04%, 750=6.01%
    lat (usec) : 1000=3.24%
    lat (msec) : 2=16.93%, 4=2.02%, 10=9.87%, 20=13.46%, 50=15.23%
    lat (msec) : 100=8.54%, 250=9.04%, 500=2.72%, 750=0.54%, 1000=0.24%
    lat (msec) : 2000=0.09%
  cpu          : usr=0.14%, sys=0.59%, ctx=16625, majf=0, minf=24
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=5347: Fri May 30 16:06:21 2014
  read : io=523520KB, bw=3348.3KB/s, iops=52, runt=156355msec
    slat (usec): min=25, max=242606, avg=177.64, stdev=4926.94
    clat (usec): min=5, max=1128.2K, avg=69030.33, stdev=92416.74
     lat (usec): min=357, max=1128.2K, avg=69208.61, stdev=92459.50
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    9], 20.00th=[   14],
     | 30.00th=[   19], 40.00th=[   26], 50.00th=[   37], 60.00th=[   51],
     | 70.00th=[   71], 80.00th=[  105], 90.00th=[  172], 95.00th=[  241],
     | 99.00th=[  416], 99.50th=[  545], 99.90th=[  922], 99.95th=[ 1004],
     | 99.99th=[ 1123]
    bw (KB  /s): min=   63, max= 6876, per=29.66%, avg=3452.75, stdev=1274.21
  write: io=525056KB, bw=3358.2KB/s, iops=52, runt=156355msec
    slat (usec): min=37, max=335316, avg=588.63, stdev=10049.71
    clat (usec): min=326, max=1003.8K, avg=6620.20, stdev=43120.65
     lat (usec): min=413, max=1003.9K, avg=7209.47, stdev=44354.58
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  366], 10.00th=[  406], 20.00th=[  442],
     | 30.00th=[  620], 40.00th=[  756], 50.00th=[ 1176], 60.00th=[ 1272],
     | 70.00th=[ 1320], 80.00th=[ 1480], 90.00th=[ 2640], 95.00th=[15808],
     | 99.00th=[140288], 99.50th=[193536], 99.90th=[864256], 99.95th=[897024],
     | 99.99th=[1003520]
    bw (KB  /s): min=   72, max= 8762, per=29.71%, avg=3468.34, stdev=1603.79
    lat (usec) : 10=0.01%, 250=0.02%, 500=13.07%, 750=7.15%, 1000=3.34%
    lat (msec) : 2=21.17%, 4=1.43%, 10=7.20%, 20=10.63%, 50=14.55%
    lat (msec) : 100=10.03%, 250=9.04%, 500=1.93%, 750=0.23%, 1000=0.15%
    lat (msec) : 2000=0.04%
  cpu          : usr=0.16%, sys=0.68%, ctx=16915, majf=0, minf=24
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=5348: Fri May 30 16:06:21 2014
  read : io=523520KB, bw=3268.2KB/s, iops=51, runt=160195msec
    slat (usec): min=26, max=338078, avg=259.14, stdev=6769.07
    clat (usec): min=4, max=903517, avg=70958.19, stdev=87737.74
     lat (usec): min=375, max=903571, avg=71217.97, stdev=87838.17
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[   10], 20.00th=[   15],
     | 30.00th=[   21], 40.00th=[   29], 50.00th=[   40], 60.00th=[   55],
     | 70.00th=[   76], 80.00th=[  110], 90.00th=[  174], 95.00th=[  243],
     | 99.00th=[  429], 99.50th=[  506], 99.90th=[  725], 99.95th=[  816],
     | 99.99th=[  906]
    bw (KB  /s): min=  173, max= 7153, per=28.77%, avg=3349.59, stdev=1188.82
  write: io=525056KB, bw=3277.7KB/s, iops=51, runt=160195msec
    slat (usec): min=42, max=303703, avg=517.35, stdev=9112.62
    clat (usec): min=340, max=1461.5K, avg=6556.03, stdev=47381.54
     lat (usec): min=411, max=1461.6K, avg=7074.03, stdev=48289.76
    clat percentiles (usec):
     |  1.00th=[  362],  5.00th=[  370], 10.00th=[  398], 20.00th=[  446],
     | 30.00th=[  636], 40.00th=[  780], 50.00th=[ 1192], 60.00th=[ 1288],
     | 70.00th=[ 1336], 80.00th=[ 1496], 90.00th=[ 3600], 95.00th=[15680],
     | 99.00th=[138240], 99.50th=[201728], 99.90th=[733184], 99.95th=[856064],
     | 99.99th=[1466368]
    bw (KB  /s): min=  173, max= 9708, per=28.86%, avg=3369.21, stdev=1468.01
    lat (usec) : 10=0.01%, 100=0.01%, 250=0.03%, 500=12.98%, 750=6.61%
    lat (usec) : 1000=3.67%
    lat (msec) : 2=20.85%, 4=1.40%, 10=6.91%, 20=10.44%, 50=14.89%
    lat (msec) : 100=10.28%, 250=9.41%, 500=2.17%, 750=0.25%, 1000=0.07%
    lat (msec) : 2000=0.02%
  cpu          : usr=0.15%, sys=0.68%, ctx=16814, majf=0, minf=24
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=5349: Fri May 30 16:06:21 2014
  read : io=523520KB, bw=2992.8KB/s, iops=46, runt=174928msec
    slat (usec): min=23, max=311675, avg=171.27, stdev=4974.27
    clat (usec): min=75, max=1114.8K, avg=76585.62, stdev=105112.42
     lat (usec): min=364, max=1114.9K, avg=76757.53, stdev=105149.80
    clat percentiles (usec):
     |  1.00th=[ 1704],  5.00th=[ 6240], 10.00th=[ 8768], 20.00th=[13376],
     | 30.00th=[19328], 40.00th=[27520], 50.00th=[39168], 60.00th=[54528],
     | 70.00th=[77312], 80.00th=[114176], 90.00th=[187392], 95.00th=[272384],
     | 99.00th=[518144], 99.50th=[675840], 99.90th=[913408], 99.95th=[995328],
     | 99.99th=[1122304]
    bw (KB  /s): min=  145, max= 9984, per=26.41%, avg=3074.43, stdev=1438.71
  write: io=525056KB, bw=3001.6KB/s, iops=46, runt=174928msec
    slat (usec): min=38, max=265589, avg=587.60, stdev=9637.20
    clat (usec): min=342, max=906290, avg=8148.18, stdev=44226.22
     lat (usec): min=406, max=906371, avg=8736.42, stdev=45334.93
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  366], 10.00th=[  422], 20.00th=[  446],
     | 30.00th=[  644], 40.00th=[  852], 50.00th=[ 1240], 60.00th=[ 1304],
     | 70.00th=[ 1416], 80.00th=[ 1960], 90.00th=[11200], 95.00th=[21888],
     | 99.00th=[146432], 99.50th=[216064], 99.90th=[815104], 99.95th=[856064],
     | 99.99th=[905216]
    bw (KB  /s): min=   74, max= 9472, per=26.38%, avg=3079.66, stdev=1727.46
    lat (usec) : 100=0.01%, 250=0.01%, 500=12.76%, 750=6.02%, 1000=3.50%
    lat (msec) : 2=18.48%, 4=1.65%, 10=8.47%, 20=11.68%, 50=14.81%
    lat (msec) : 100=10.03%, 250=9.42%, 500=2.51%, 750=0.41%, 1000=0.23%
    lat (msec) : 2000=0.02%
  cpu          : usr=0.12%, sys=0.63%, ctx=16535, majf=0, minf=23
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=2045.0MB, aggrb=11641KB/s, minb=2910KB/s, maxb=3348KB/s, mint=156355msec, maxt=179881msec
  WRITE: io=2051.0MB, aggrb=11675KB/s, minb=2918KB/s, maxb=3358KB/s, mint=156355msec, maxt=179881msec

Disk stats (read/write):
    dm-0: ios=32704/33128, merge=0/0, ticks=2371685/821383, in_queue=3193165, util=100.00%, aggrios=32720/33200, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00%
    md127: ios=32720/33200, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16359/33122, aggrmerge=0/78, aggrticks=1185825/498678, aggrin_queue=1684398, aggrutil=99.75%
  sda: ios=8461/33122, merge=1/78, ticks=393799/195017, in_queue=588764, util=95.85%
  sdb: ios=24258/33122, merge=0/78, ticks=1977851/802340, in_queue=2780032, util=99.75%
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
...
virt: (g=0): rw=randrw, bs=64K-64K/64K-64K/64K-64K, ioengine=libaio, iodepth=4
fio-2.1.2
Starting 4 processes

virt: (groupid=0, jobs=1): err= 0: pid=5531: Fri May 30 16:25:54 2014
  read : io=523520KB, bw=2629.4KB/s, iops=41, runt=199130msec
    slat (usec): min=24, max=197634, avg=143.59, stdev=2991.82
    clat (usec): min=174, max=26698K, avg=67465.64, stdev=365815.35
     lat (usec): min=388, max=26698K, avg=67609.87, stdev=365817.53
    clat percentiles (usec):
     |  1.00th=[  398],  5.00th=[ 5600], 10.00th=[ 7968], 20.00th=[11584],
     | 30.00th=[15552], 40.00th=[21376], 50.00th=[29568], 60.00th=[41216],
     | 70.00th=[60160], 80.00th=[90624], 90.00th=[152576], 95.00th=[226304],
     | 99.00th=[440320], 99.50th=[544768], 99.90th=[880640], 99.95th=[1515520],
     | 99.99th=[16711680]
    bw (KB  /s): min=  320, max=13128, per=25.53%, avg=2685.01, stdev=1713.14
  write: io=525056KB, bw=2636.8KB/s, iops=41, runt=199130msec
    slat (usec): min=33, max=240957, avg=320.30, stdev=5617.33
    clat (usec): min=353, max=65433K, avg=29338.06, stdev=1020379.84
     lat (usec): min=437, max=65433K, avg=29659.01, stdev=1020395.97
    clat percentiles (usec):
     |  1.00th=[  370],  5.00th=[  378], 10.00th=[  398], 20.00th=[  454],
     | 30.00th=[  620], 40.00th=[  900], 50.00th=[ 1240], 60.00th=[ 1320],
     | 70.00th=[ 1608], 80.00th=[ 7584], 90.00th=[19584], 95.00th=[30848],
     | 99.00th=[103936], 99.50th=[175104], 99.90th=[815104], 99.95th=[3063808],
     | 99.99th=[16711680]
    bw (KB  /s): min=  114, max=13254, per=25.43%, avg=2681.93, stdev=1885.06
    lat (usec) : 250=0.01%, 500=13.29%, 750=5.71%, 1000=2.83%
    lat (msec) : 2=15.81%, 4=1.70%, 10=9.86%, 20=14.95%, 50=17.03%
    lat (msec) : 100=9.34%, 250=7.23%, 500=1.78%, 750=0.32%, 1000=0.05%
    lat (msec) : 2000=0.02%, >=2000=0.05%
  cpu          : usr=0.10%, sys=0.77%, ctx=16731, majf=0, minf=24
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=5532: Fri May 30 16:25:54 2014
  read : io=523520KB, bw=3213.1KB/s, iops=50, runt=162892msec
    slat (usec): min=47, max=185115, avg=128.16, stdev=2376.71
    clat (usec): min=4, max=25770K, avg=59285.18, stdev=394418.17
     lat (usec): min=401, max=25770K, avg=59413.99, stdev=394421.00
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    9], 20.00th=[   13],
     | 30.00th=[   17], 40.00th=[   22], 50.00th=[   30], 60.00th=[   41],
     | 70.00th=[   56], 80.00th=[   78], 90.00th=[  126], 95.00th=[  182],
     | 99.00th=[  347], 99.50th=[  420], 99.90th=[  578], 99.95th=[  635],
     | 99.99th=[16712]
    bw (KB  /s): min=  242, max= 6629, per=31.56%, avg=3318.74, stdev=1376.74
  write: io=525056KB, bw=3223.4KB/s, iops=50, runt=162892msec
    slat (usec): min=61, max=269043, avg=299.24, stdev=5817.49
    clat (usec): min=326, max=69958K, avg=19848.94, stdev=886022.82
     lat (usec): min=444, max=69959K, avg=20148.82, stdev=886040.88
    clat percentiles (usec):
     |  1.00th=[  366],  5.00th=[  374], 10.00th=[  390], 20.00th=[  446],
     | 30.00th=[  524], 40.00th=[  700], 50.00th=[ 1112], 60.00th=[ 1256],
     | 70.00th=[ 1304], 80.00th=[ 1448], 90.00th=[ 2024], 95.00th=[17024],
     | 99.00th=[64768], 99.50th=[115200], 99.90th=[346112], 99.95th=[3260416],
     | 99.99th=[16711680]
    bw (KB  /s): min=  121, max= 8796, per=31.72%, avg=3345.35, stdev=1578.99
    lat (usec) : 10=0.01%, 100=0.01%, 500=14.81%, 750=6.41%, 1000=3.04%
    lat (msec) : 2=21.03%, 4=1.18%, 10=7.43%, 20=12.62%, 50=16.28%
    lat (msec) : 100=9.69%, 250=6.25%, 500=1.08%, 750=0.12%, 1000=0.01%
    lat (msec) : >=2000=0.04%
  cpu          : usr=0.13%, sys=0.93%, ctx=17115, majf=0, minf=24
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=5533: Fri May 30 16:25:54 2014
  read : io=523520KB, bw=2713.7KB/s, iops=42, runt=192920msec
    slat (usec): min=35, max=30712, avg=92.16, stdev=338.87
    clat (usec): min=315, max=63712K, avg=73273.62, stdev=983181.94
     lat (usec): min=401, max=63713K, avg=73366.42, stdev=983181.85
    clat percentiles (msec):
     |  1.00th=[    3],  5.00th=[    7], 10.00th=[    9], 20.00th=[   13],
     | 30.00th=[   18], 40.00th=[   24], 50.00th=[   32], 60.00th=[   42],
     | 70.00th=[   58], 80.00th=[   83], 90.00th=[  135], 95.00th=[  202],
     | 99.00th=[  383], 99.50th=[  482], 99.90th=[ 1401], 99.95th=[ 1483],
     | 99.99th=[16712]
    bw (KB  /s): min=  121, max= 9216, per=31.94%, avg=3358.56, stdev=1911.18
  write: io=525056KB, bw=2721.7KB/s, iops=42, runt=192920msec
    slat (usec): min=56, max=258524, avg=400.46, stdev=7012.38
    clat (usec): min=348, max=70388K, avg=20488.66, stdev=849098.66
     lat (usec): min=435, max=70389K, avg=20889.77, stdev=849131.29
    clat percentiles (usec):
     |  1.00th=[  366],  5.00th=[  374], 10.00th=[  394], 20.00th=[  450],
     | 30.00th=[  620], 40.00th=[  876], 50.00th=[ 1224], 60.00th=[ 1288],
     | 70.00th=[ 1464], 80.00th=[ 2960], 90.00th=[15808], 95.00th=[24960],
     | 99.00th=[87552], 99.50th=[218112], 99.90th=[888832], 99.95th=[1400832],
     | 99.99th=[16711680]
    bw (KB  /s): min=    2, max=10112, per=31.98%, avg=3372.91, stdev=2142.52
    lat (usec) : 500=12.87%, 750=5.95%, 1000=2.91%
    lat (msec) : 2=18.21%, 4=1.31%, 10=8.83%, 20=13.82%, 50=17.58%
    lat (msec) : 100=10.40%, 250=6.34%, 500=1.43%, 750=0.20%, 1000=0.04%
    lat (msec) : 2000=0.07%, >=2000=0.04%
  cpu          : usr=0.12%, sys=0.77%, ctx=16939, majf=0, minf=24
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0
virt: (groupid=0, jobs=1): err= 0: pid=5534: Fri May 30 16:25:54 2014
  read : io=523520KB, bw=2857.1KB/s, iops=44, runt=183181msec
    slat (usec): min=44, max=195215, avg=112.54, stdev=2157.49
    clat (usec): min=312, max=43560K, avg=74513.46, stdev=550534.41
     lat (usec): min=375, max=43560K, avg=74626.63, stdev=550535.28
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    9], 20.00th=[   13],
     | 30.00th=[   18], 40.00th=[   25], 50.00th=[   35], 60.00th=[   48],
     | 70.00th=[   67], 80.00th=[   96], 90.00th=[  159], 95.00th=[  233],
     | 99.00th=[  441], 99.50th=[  545], 99.90th=[  979], 99.95th=[ 1205],
     | 99.99th=[16712]
    bw (KB  /s): min=  348, max= 7734, per=27.54%, avg=2895.85, stdev=1213.49
  write: io=525056KB, bw=2866.4KB/s, iops=44, runt=183181msec
    slat (usec): min=54, max=275450, avg=324.36, stdev=5740.29
    clat (usec): min=348, max=47249K, avg=14560.10, stdev=569838.75
     lat (usec): min=441, max=47249K, avg=14885.10, stdev=569878.87
    clat percentiles (usec):
     |  1.00th=[  366],  5.00th=[  374], 10.00th=[  394], 20.00th=[  450],
     | 30.00th=[  564], 40.00th=[  740], 50.00th=[ 1192], 60.00th=[ 1256],
     | 70.00th=[ 1336], 80.00th=[ 1576], 90.00th=[10432], 95.00th=[21888],
     | 99.00th=[99840], 99.50th=[166912], 99.90th=[528384], 99.95th=[692224],
     | 99.99th=[16711680]
    bw (KB  /s): min=  213, max= 7303, per=27.52%, avg=2901.91, stdev=1403.33
    lat (usec) : 500=14.29%, 750=6.23%, 1000=2.95%
    lat (msec) : 2=19.19%, 4=1.25%, 10=8.00%, 20=12.42%, 50=15.55%
    lat (msec) : 100=10.17%, 250=7.70%, 500=1.84%, 750=0.31%, 1000=0.04%
    lat (msec) : 2000=0.03%, >=2000=0.04%
  cpu          : usr=0.13%, sys=0.81%, ctx=16805, majf=0, minf=23
  IO depths    : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=8180/w=8204/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=2045.0MB, aggrb=10516KB/s, minb=2629KB/s, maxb=3213KB/s, mint=162892msec, maxt=199130msec
  WRITE: io=2051.0MB, aggrb=10546KB/s, minb=2636KB/s, maxb=3223KB/s, mint=162892msec, maxt=199130msec

Disk stats (read/write):
    dm-0: ios=65408/67846, merge=0/0, ticks=4160319/11781438, in_queue=15944596, util=100.00%, aggrios=21839/22771, aggrmerge=0/0, aggrticks=1288260/3918688, aggrin_queue=5206991, aggrutil=100.00%
    dm-1: ios=84/117, merge=0/0, ticks=120/182, in_queue=302, util=0.11%, aggrios=96/383, aggrmerge=0/62, aggrticks=124/431, aggrin_queue=555, aggrutil=0.22%
  sdc: ios=96/383, merge=0/62, ticks=124/431, in_queue=555, util=0.22%
  dm-2: ios=12/328, merge=0/0, ticks=3/268, in_queue=271, util=0.12%
    dm-5: ios=65421/67870, merge=0/0, ticks=3864659/11755615, in_queue=15620402, util=100.00%, aggrios=65421/67888, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00%
    md127: ios=65421/67888, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=16422/33219, aggrmerge=16286/34662, aggrticks=970890/852897, aggrin_queue=1823577, aggrutil=99.59%
  sda: ios=9379/33225, merge=9264/34659, ticks=406471/203345, in_queue=609659, util=96.99%
  sdb: ios=23466/33213, merge=23309/34666, ticks=1535310/1502449, in_queue=3037496, util=99.59%

[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]