<div class="gmail_quote">On Tue, Sep 4, 2012 at 1:04 PM, Fabio M. Di Nitto <<a href="mailto:fdinitto@redhat.com" target="_blank">fdinitto@redhat.com</a>> wrote: <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div class="im">On 09/04/2012 05:01 PM, Terry wrote: > Hello, > > I am running an NFS cluster with 3 exports distributed across 2 nodes. > When I try to relocate an NFS export, it fails. I then have to disable > and enable it on the other node. Does anyone have any tricks to get > around this issue? I am sure it is due to file locking. Here's the config: </div>This is a difficult config to support because of some design limitations in nfsd and what cluster users expect (exactly your config). My best guess is that the service fails to relocate because the fs cannot be unmounted. If so, you need to add force_unmount="1" to the fs resources. If that still doesn't fix the problem, you need to upgrade to a version of the resource-agents that support nfsrestart="1" for fs resource. This depends on what distro/release you have. nfsrestart does a much harder (invasive) action to drop the locks holding the fs. Still requires force_unmount to be set. It can be used together with nfslock (if nfslock fails, then nfsrestart will kick in). Fabio > > /<?xml version="1.0" ?>/ > > /<cluster config_version="17" name="omadvnfs01">/ > > / <cman expected_votes="1" two_node="1"/>/ > > / <clusternodes>/ > > / <clusternode name="<a href="http://omadvnfs01a.sec.jel.lc" target="_blank">omadvnfs01a.sec.jel.lc</a> > <<a href="http://omadvnfs01a.sec.jel.lc" target="_blank">http://omadvnfs01a.sec.jel.lc</a>>" nodeid="1" votes="1">/ > > / <fence>/ > > / <method name="drac">/ > > / <device > name="omadvnfs01a-drac"/>/ > > / </method>/ > > / </fence>/ > > / </clusternode>/ > > / <clusternode name="<a href="http://omadvnfs01b.sec.jel.lc" target="_blank">omadvnfs01b.sec.jel.lc</a> > <<a href="http://omadvnfs01b.sec.jel.lc" target="_blank">http://omadvnfs01b.sec.jel.lc</a>>" nodeid="2" votes="1">/ > > / <fence>/ > > / <method name="drac">/ > > / <device > name="omadvnfs01b-drac"/>/ > > / </method>/ > > / </fence>/ > > / </clusternode>/ > > / </clusternodes>/ > > / <rm>/ > > / <failoverdomains>/ > > / <failoverdomain name="fd_omadvnfs01a" > ordered="1" restricted="0" nofailback="1">/ > > / <failoverdomainnode > name="<a href="http://omadvnfs01a.sec.jel.lc" target="_blank">omadvnfs01a.sec.jel.lc</a> <<a href="http://omadvnfs01a.sec.jel.lc" target="_blank">http://omadvnfs01a.sec.jel.lc</a>>" > priority="1"/>/ > > / <failoverdomainnode > name="<a href="http://omadvnfs01b.sec.jel.lc" target="_blank">omadvnfs01b.sec.jel.lc</a> <<a href="http://omadvnfs01b.sec.jel.lc" target="_blank">http://omadvnfs01b.sec.jel.lc</a>>" > priority="2"/>/ > > / </failoverdomain>/ > > / <failoverdomain name="fd_omadvnfs01b" > ordered="1" restricted="0" nofailback="1">/ > > / <failoverdomainnode > name="<a href="http://omadvnfs01b.sec.jel.lc" target="_blank">omadvnfs01b.sec.jel.lc</a> <<a href="http://omadvnfs01b.sec.jel.lc" target="_blank">http://omadvnfs01b.sec.jel.lc</a>>" > priority="1"/>/ > > / <failoverdomainnode > name="<a href="http://omadvnfs01a.sec.jel.lc" target="_blank">omadvnfs01a.sec.jel.lc</a> <<a href="http://omadvnfs01a.sec.jel.lc" target="_blank">http://omadvnfs01a.sec.jel.lc</a>>" > priority="2"/>/ > > / </failoverdomain>/ > > / </failoverdomains>/ > > / <resources>/ > > / <ip address="10.198.1.112" > monitor_link="1"/>/ > > / <ip address="10.198.1.113" > monitor_link="1"/>/ > > / <ip address="10.198.1.114" > monitor_link="1"/>/ > > / <ip address="10.198.1.115" > monitor_link="1"/>/ <div class="im">> > / <fs device="/dev/vg_data01a/lv_data01a" > quick_status="0" force_fsck="0" force_unmount="1" fsid="27014" > fstype="ext4" mountpoint="/data01a" name="omadvnfs01-data01a" > options="rw,noatime,nodiratime,data=writeback,commit=30,_netdev" </div>> self_fence="0" nfslock="1"/>/ <div class="im">> > / <fs device="/dev/vg_data01b/lv_data01b" > quick_status="0" force_fsck="0" force_unmount="1" fsid="39436" > fstype="ext4" mountpoint="/data01b" name="omadvnfs01-data01b" > options="rw,noatime,nodiratime,data=writeback,commit=30,_netdev" </div>> self_fence="0" nfslock="1"/>/ <div class="im">> > / <fs device="/dev/vg_data01c/lv_data01c" > quick_status="0" force_fsck="0" force_unmount="1" fsid="99243" > fstype="ext4" mountpoint="/data01c" name="omadvnfs01-data01c" > options="rw,noatime,nodiratime,data=writeback,commit=30,_netdev" </div>> self_fence="0" nfslock="1"/>/ <div class="im">> > / <fs device="/dev/vg_data04/lv_data04" > quick_status="0" force_fsck="0" force_unmount="1" fsid="59016" > fstype="ext4" mountpoint="/data04" name="omadvnfs01-data04" </div>> options="defaults,_netdev" self_fence="0"/>/ > > / <script file="/etc/init.d/postgresql" > name="postgresql"/>/ > > / <nfsexport name="data01a"/>/ > > / <nfsexport name="data01b"/>/ > > / <nfsexport name="data01c"/>/ <div class="im">> > / <nfsclient allow_recover="1" > name="omadvdss01a" > options="async,no_root_squash,rw,no_subtree_check" </div>> target="omadvdss01a"/>/ <div class="im">> > / <nfsclient allow_recover="1" > name="omadvdss01b" > options="async,no_root_squash,rw,no_subtree_check" </div>> target="omadvdss01b"/>/ <div class="im">> > / <nfsclient allow_recover="1" > name="omadvdss01c" > options="async,no_root_squash,rw,no_subtree_check" > target="omadvdss01c"/>/ > </div>> / </resources>/ > > / <service autostart="1" domain="fd_omadvnfs01b" > name="postgresql">/ > > / <ip ref="10.198.1.112"/>/ > > / <fs ref="omadvnfs01-data04"/>/ <div class="im">> > / <script ref="postgresql"/>/ > </div>> / </service>/ > > / <service domain="fd_omadvnfs01a" > name="omadvnfs01-nfs-data01a" nfslock="1" recovery="relocate">/ > > / <ip ref="10.198.1.113"/>/ > > / <fs ref="omadvnfs01-data01a">/ > > / <nfsexport ref="data01a">/ > > / <nfsclient > ref="omadvdss01a"/>/ > > / <nfsclient > ref="omadvdss01b"/>/ <div class="im">> > / <nfsclient > ref="omadvdss01c"/>/ > </div>> / </nfsexport>/ > > / </fs>/ > > / </service>/ > > / <service domain="fd_omadvnfs01a" > name="omadvnfs01-nfs-data01b" nfslock="1" recovery="relocate">/ > > / <ip ref="10.198.1.114"/>/ > > / <fs ref="omadvnfs01-data01b">/ > > / <nfsexport ref="data01b">/ > > / <nfsclient > ref="omadvdss01a"/>/ > > / <nfsclient > ref="omadvdss01b"/>/ <div class="im">> > / <nfsclient > ref="omadvdss01c"/>/ > </div>> / </nfsexport>/ > > / </fs>/ > > / </service>/ > > / <service domain="fd_omadvnfs01b" > name="omadvnfs01-nfs-data01c" nfslock="1" recovery="relocate">/ > > / <ip ref="10.198.1.115"/>/ > > / <fs ref="omadvnfs01-data01c">/ > > / <nfsexport ref="data01c">/ > > / <nfsclient > ref="omadvdss01a"/>/ > > / <nfsclient > ref="omadvdss01b"/>/ <div class="im">> > / <nfsclient > ref="omadvdss01c"/>/ > </div>> / </nfsexport>/ > > / </fs>/ > > / </service>/ > > / </rm>/ > > /</cluster>/ > > > </blockquote><div>I am on ubuntu 12.04. </div></div>