[Linux-cluster] GFS2 cluster node is running very slow

[David Hill]

Hi guys,

I've found this in /sys/kernel/debug/gfs2/fsname/glocks

H: s:EX f:tW e:0 p:22591 [jsvc] gfs2_inplace_reserve_i+0x451/0x69a [gfs2]
H: s:EX f:tW e:0 p:22591 [jsvc] gfs2_inplace_reserve_i+0x451/0x69a [gfs2]
H: s:EX f:W e:0 p:806 [pdflush] gfs2_write_inode+0x57/0x152 [gfs2]

The application running is confluence and has 184 thread.   The other nodes work fine but that specific node is having issues obtaining locks when it's time to write?

Dave




From: linux-cluster-bounces at redhat.com [mailto:linux-cluster-bounces at redhat.com] On Behalf Of David Hill
Sent: 29 mars 2011 21:00
To: linux-cluster at redhat.com
Subject: [Linux-cluster] GFS2 cluster node is running very slow

Hi guys,

                We have a GFS2 cluster consisting of 3 nodes.  At this point, everything is going smooth.  Now, we add a new node with more CPUs with the
exact same configuration but all transactions on the mount run very slow.

Copying a file to the mount is done at about 25kb/s when on the three other nodes, everything goes smooth at about 7MB/s.
CPU on all nodes is idling at some point, all cluster process are kind of sleeping.

We've tried the ping_pong.c from apache and it seems to be able to write/read lock files at a decent rate.

There's other mounts on the system using the same fc card/fibers/switches/san and all these are also working at a decent speed...

I've been reading a good part of the day, and I can't seem to find a solution.




[cid:image001.gif at 01CBEE7A.8E441B40]
David C. Hill
Linux System Administrator - Enterprise
514-490-2000#5655
http://www.ubi.com<http://www.ubi.com/>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/linux-cluster/attachments/20110330/bf50eabb/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.gif
Type: image/gif
Size: 2555 bytes
Desc: image001.gif
URL: <http://listman.redhat.com/archives/linux-cluster/attachments/20110330/bf50eabb/attachment.gif>