[Linux-cluster] strange slowness of ls with 1 newly created file on gfs 1 or 2
Pavel Stano
stanojr at blackhole.sk
Tue Jul 10 23:46:57 UTC 2007
Hello,
i am testing gfs and its very slow, please look at this if it is normal
or i miss something
i have 2 node cluster, nodes are connected via SAS to disk array promise
e310s, when i run dd on attached block device i have cca 150MBps
throughput on both nodes
there is debian etch, i compile cluster-2.00.00 with gfs1 module
i create one 475GB logical volume (i dont use clvmd, just normal lvm),
create gfs1 on it
gfs_mkfs -t cluster1:data0 -p lock_dlm -j 2 /dev/vgdata0/lvdata0
mount that lv on both nodes to directory /d/0/, run df on both nodes
and then run touch on node 1:
serpico# touch /d/0/test
and ls on node 2:
dinorscio:~# time ls /d/0/
test
real 0m9.486s
user 0m0.000s
sys 0m0.004s
it took almost 10 seconds to display 1 file on that filesystem
when i again create other file via touch(node1) and run ls (node2) it
took again cca 10 seconds
i monitor activity with dstat and there is 50% iowait on node where run
ls (50% because 2 core cpu on node), but no disk activity
nodes are connected via 1gbps idle ethernet
and when ls is runing, i look at wchan with ps
ps axf -o pid,wchan:20,cmd|grep ls
6387 sync_buffer \_ ls --color=auto /d/0/
i run ps many times there is still sync_buffer, i dont see other kernel
function
this is my cluster.conf
<?xml version="1.0"?>
<cluster name="cluster1" config_version="20">
<cman expected_votes="1" two_node="1" />
<clusternodes>
<clusternode name="dinorscio" votes="1" nodeid="1">
<fence>
</fence>
</clusternode>
<clusternode name="serpico" votes="1" nodeid="2">
<fence>
</fence>
</clusternode>
</clusternodes>
<fencedevices>
</fencedevices>
<rm>
<failoverdomains/>
<resources/>
</rm>
</cluster>
and last thing, i try gfs2, but same result
Thank you
--
Pavel Stano
More information about the Linux-cluster
mailing list