[Linux-cluster] problems with clvmd
Christine Caulfield
ccaulfie at redhat.com
Mon Apr 18 08:48:34 UTC 2011
On 17/04/11 21:52, Terry wrote:
> As a result of a strange situation where our licensing for storage
> dropped off, I need to join a centos 5.6 node to a now single node
> cluster. I got it joined to the cluster but I am having issues with
> CLVMD. Any lvm operations on both boxes hang. For example, vgscan.
> I have increased debugging and I don't see any logs. The VGs aren't
> being populated in /dev/mapper. This WAS working right after I joined
> it to the cluster and now it's not for some unknown reason. Not sure
> where to take this at this point. I did find one weird startup log
> that I am not sure what it means yet:
> [root at omadvnfs01a ~]# dmesg | grep dlm
> dlm: no local IP address has been set
> dlm: cannot start dlm lowcomms -107
> dlm: Using TCP for communications
> dlm: connecting to 2
>
That message usually means that dlm_controld has failed to start. Try
starting the cman daemons (groupd, dlm_controld) manually with the -D
switch and read the output which might give some clues to why it's not
working.
Chrissie
> [root at omadvnfs01a ~]# ps xauwwww | grep dlm
> root 5476 0.0 0.0 24736 760 ? Ss 15:34 0:00
> /sbin/dlm_controld
> root 5502 0.0 0.0 0 0 ? S< 15:34 0:00 [dlm_astd]
> root 5503 0.0 0.0 0 0 ? S< 15:34 0:00 [dlm_scand]
> root 5504 0.0 0.0 0 0 ? S< 15:34 0:00 [dlm_recv]
> root 5505 0.0 0.0 0 0 ? S< 15:34 0:00 [dlm_send]
> root 5506 0.0 0.0 0 0 ? S< 15:34 0:00 [dlm_recoverd]
> root 5546 0.0 0.0 0 0 ? S< 15:35 0:00 [dlm_recoverd]
>
> [root at omadvnfs01a ~]# lsmod | grep dlm
> lock_dlm 52065 0
> gfs2 529037 1 lock_dlm
> dlm 160065 17 lock_dlm
> configfs 62045 2 dlm
>
>
> centos server:
> [root at omadvnfs01a ~]# rpm -q cman rgmanager lvm2-cluster
> cman-2.0.115-68.el5
> rgmanager-2.0.52-9.el5.centos
> lvm2-cluster-2.02.74-3.el5_6.1
>
> [root at omadvnfs01a ~]# ls /dev/mapper/ | grep -v mpath
> control
> VolGroup00-LogVol00
> VolGroup00-LogVol01
>
> rhel server:
> [root at omadvnfs01b network-scripts]# rpm -q cman rgmanager lvm2-cluster
> cman-2.0.115-34.el5
> rgmanager-2.0.52-6.el5
> lvm2-cluster-2.02.56-7.el5_5.4
>
> [root at omadvnfs01b network-scripts]# ls /dev/mapper/ | grep -v mpath
> control
> vg_data01a-lv_data01a
> vg_data01b-lv_data01b
> vg_data01c-lv_data01c
> vg_data01d-lv_data01d
> vg_data01e-lv_data01e
> vg_data01h-lv_data01h
> vg_data01i-lv_data01i
> VolGroup00-LogVol00
> VolGroup00-LogVol01
> VolGroup02-lv_data00
>
> [root at omadvnfs01b network-scripts]# clustat
> Cluster Status for omadvnfs01 @ Sun Apr 17 15:44:52 2011
> Member Status: Quorate
>
> Member Name ID Status
> ------ ---- ---- ------
> omadvnfs01a.sec.jel.lc 1
> Online, rgmanager
> omadvnfs01b.sec.jel.lc 2
> Online, Local, rgmanager
>
> Service Name
> Owner (Last) State
> ------- ----
> ----- ------ -----
> service:omadvnfs01-nfs-a
> omadvnfs01b.sec.jel.lc
> started
> service:omadvnfs01-nfs-b
> omadvnfs01b.sec.jel.lc
> started
> service:omadvnfs01-nfs-c
> omadvnfs01b.sec.jel.lc
> started
> service:omadvnfs01-nfs-h
> omadvnfs01b.sec.jel.lc
> started
> service:omadvnfs01-nfs-i
> omadvnfs01b.sec.jel.lc
> started
> service:postgresql
> omadvnfs01b.sec.jel.lc
> started
>
>
> [root at omadvnfs01a ~]# cman_tool nodes
> Node Sts Inc Joined Name
> 1 M 1892 2011-04-17 15:34:24 omadvnfs01a.sec.jel.lc
> 2 M 1896 2011-04-17 15:34:24 omadvnfs01b.sec.jel.lc
>
> --
> Linux-cluster mailing list
> Linux-cluster at redhat.com
> https://www.redhat.com/mailman/listinfo/linux-cluster
More information about the Linux-cluster
mailing list