[Linux-cluster] NFS locks and failing over services
Fabio M. Di Nitto
fdinitto at redhat.com
Tue Sep 4 18:04:49 UTC 2012
On 09/04/2012 05:01 PM, Terry wrote:
> Hello,
>
> I am running an NFS cluster with 3 exports distributed across 2 nodes.
> When I try to relocate an NFS export, it fails. I then have to disable
> and enable it on the other node. Does anyone have any tricks to get
> around this issue? I am sure it is due to file locking. Here's the config:
This is a difficult config to support because of some design limitations
in nfsd and what cluster users expect (exactly your config).
My best guess is that the service fails to relocate because the fs
cannot be unmounted.
If so, you need to add force_unmount="1" to the fs resources.
If that still doesn't fix the problem, you need to upgrade to a version
of the resource-agents that support nfsrestart="1" for fs resource.
This depends on what distro/release you have. nfsrestart does a much
harder (invasive) action to drop the locks holding the fs. Still
requires force_unmount to be set. It can be used together with nfslock
(if nfslock fails, then nfsrestart will kick in).
Fabio
>
> /<?xml version="1.0" ?>/
>
> /<cluster config_version="17" name="omadvnfs01">/
>
> / <cman expected_votes="1" two_node="1"/>/
>
> / <clusternodes>/
>
> / <clusternode name="omadvnfs01a.sec.jel.lc
> <http://omadvnfs01a.sec.jel.lc>" nodeid="1" votes="1">/
>
> / <fence>/
>
> / <method name="drac">/
>
> / <device
> name="omadvnfs01a-drac"/>/
>
> / </method>/
>
> / </fence>/
>
> / </clusternode>/
>
> / <clusternode name="omadvnfs01b.sec.jel.lc
> <http://omadvnfs01b.sec.jel.lc>" nodeid="2" votes="1">/
>
> / <fence>/
>
> / <method name="drac">/
>
> / <device
> name="omadvnfs01b-drac"/>/
>
> / </method>/
>
> / </fence>/
>
> / </clusternode>/
>
> / </clusternodes>/
>
> / <rm>/
>
> / <failoverdomains>/
>
> / <failoverdomain name="fd_omadvnfs01a"
> ordered="1" restricted="0" nofailback="1">/
>
> / <failoverdomainnode
> name="omadvnfs01a.sec.jel.lc <http://omadvnfs01a.sec.jel.lc>"
> priority="1"/>/
>
> / <failoverdomainnode
> name="omadvnfs01b.sec.jel.lc <http://omadvnfs01b.sec.jel.lc>"
> priority="2"/>/
>
> / </failoverdomain>/
>
> / <failoverdomain name="fd_omadvnfs01b"
> ordered="1" restricted="0" nofailback="1">/
>
> / <failoverdomainnode
> name="omadvnfs01b.sec.jel.lc <http://omadvnfs01b.sec.jel.lc>"
> priority="1"/>/
>
> / <failoverdomainnode
> name="omadvnfs01a.sec.jel.lc <http://omadvnfs01a.sec.jel.lc>"
> priority="2"/>/
>
> / </failoverdomain>/
>
> / </failoverdomains>/
>
> / <resources>/
>
> / <ip address="10.198.1.112"
> monitor_link="1"/>/
>
> / <ip address="10.198.1.113"
> monitor_link="1"/>/
>
> / <ip address="10.198.1.114"
> monitor_link="1"/>/
>
> / <ip address="10.198.1.115"
> monitor_link="1"/>/
>
> / <fs device="/dev/vg_data01a/lv_data01a"
> quick_status="0" force_fsck="0" force_unmount="1" fsid="27014"
> fstype="ext4" mountpoint="/data01a" name="omadvnfs01-data01a"
> options="rw,noatime,nodiratime,data=writeback,commit=30,_netdev"
> self_fence="0" nfslock="1"/>/
>
> / <fs device="/dev/vg_data01b/lv_data01b"
> quick_status="0" force_fsck="0" force_unmount="1" fsid="39436"
> fstype="ext4" mountpoint="/data01b" name="omadvnfs01-data01b"
> options="rw,noatime,nodiratime,data=writeback,commit=30,_netdev"
> self_fence="0" nfslock="1"/>/
>
> / <fs device="/dev/vg_data01c/lv_data01c"
> quick_status="0" force_fsck="0" force_unmount="1" fsid="99243"
> fstype="ext4" mountpoint="/data01c" name="omadvnfs01-data01c"
> options="rw,noatime,nodiratime,data=writeback,commit=30,_netdev"
> self_fence="0" nfslock="1"/>/
>
> / <fs device="/dev/vg_data04/lv_data04"
> quick_status="0" force_fsck="0" force_unmount="1" fsid="59016"
> fstype="ext4" mountpoint="/data04" name="omadvnfs01-data04"
> options="defaults,_netdev" self_fence="0"/>/
>
> / <script file="/etc/init.d/postgresql"
> name="postgresql"/>/
>
> / <nfsexport name="data01a"/>/
>
> / <nfsexport name="data01b"/>/
>
> / <nfsexport name="data01c"/>/
>
> / <nfsclient allow_recover="1"
> name="omadvdss01a"
> options="async,no_root_squash,rw,no_subtree_check"
> target="omadvdss01a"/>/
>
> / <nfsclient allow_recover="1"
> name="omadvdss01b"
> options="async,no_root_squash,rw,no_subtree_check"
> target="omadvdss01b"/>/
>
> / <nfsclient allow_recover="1"
> name="omadvdss01c"
> options="async,no_root_squash,rw,no_subtree_check"
> target="omadvdss01c"/>/
>
> / </resources>/
>
> / <service autostart="1" domain="fd_omadvnfs01b"
> name="postgresql">/
>
> / <ip ref="10.198.1.112"/>/
>
> / <fs ref="omadvnfs01-data04"/>/
>
> / <script ref="postgresql"/>/
>
> / </service>/
>
> / <service domain="fd_omadvnfs01a"
> name="omadvnfs01-nfs-data01a" nfslock="1" recovery="relocate">/
>
> / <ip ref="10.198.1.113"/>/
>
> / <fs ref="omadvnfs01-data01a">/
>
> / <nfsexport ref="data01a">/
>
> / <nfsclient
> ref="omadvdss01a"/>/
>
> / <nfsclient
> ref="omadvdss01b"/>/
>
> / <nfsclient
> ref="omadvdss01c"/>/
>
> / </nfsexport>/
>
> / </fs>/
>
> / </service>/
>
> / <service domain="fd_omadvnfs01a"
> name="omadvnfs01-nfs-data01b" nfslock="1" recovery="relocate">/
>
> / <ip ref="10.198.1.114"/>/
>
> / <fs ref="omadvnfs01-data01b">/
>
> / <nfsexport ref="data01b">/
>
> / <nfsclient
> ref="omadvdss01a"/>/
>
> / <nfsclient
> ref="omadvdss01b"/>/
>
> / <nfsclient
> ref="omadvdss01c"/>/
>
> / </nfsexport>/
>
> / </fs>/
>
> / </service>/
>
> / <service domain="fd_omadvnfs01b"
> name="omadvnfs01-nfs-data01c" nfslock="1" recovery="relocate">/
>
> / <ip ref="10.198.1.115"/>/
>
> / <fs ref="omadvnfs01-data01c">/
>
> / <nfsexport ref="data01c">/
>
> / <nfsclient
> ref="omadvdss01a"/>/
>
> / <nfsclient
> ref="omadvdss01b"/>/
>
> / <nfsclient
> ref="omadvdss01c"/>/
>
> / </nfsexport>/
>
> / </fs>/
>
> / </service>/
>
> / </rm>/
>
> /</cluster>/
>
>
>
> --
> Linux-cluster mailing list
> Linux-cluster at redhat.com
> https://www.redhat.com/mailman/listinfo/linux-cluster
>
More information about the Linux-cluster
mailing list