<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
<META NAME="GENERATOR" CONTENT="GtkHTML/3.14.3">
</HEAD>
<BODY>
Unfortunately, we have run into the same issue... but we have found that a small pause before shutting cman down works every time (script snippet below -- sleep 1 was dicey, sleep 2 always worked, sleep3 just because):<BR>
<BR>
<TT>service rgmanager stop</TT><BR>
<TT>[ $? -eq 0 ] || exit</TT><BR>
<BR>
<TT>service gfs stop</TT><BR>
<TT>[ $? -eq 0 ] || exit</TT><BR>
<BR>
<TT>service clvmd stop</TT><BR>
<TT>[ $? -eq 0 ] || exit</TT><BR>
<BR>
<TT>service fenced stop</TT><BR>
<TT>[ $? -eq 0 ] || exit</TT><BR>
<BR>
<TT># invoking cman too early sometimes fails ... -t option too small?</TT><BR>
<TT>sync</TT><BR>
<TT>sleep 3</TT><BR>
<BR>
<TT>[ "$ACTION" = "leave" ] && service cman stop leave || service cman stop</TT><BR>
<TT>[ $? -eq 0 ] || exit</TT><BR>
<BR>
<TT>service ccsd stop</TT><BR>
<TT>[ $? -eq 0 ] || exit</TT><BR>
<BR>
<BR>
On Mon, 2007-10-22 at 14:05 -0600, Josh Gray wrote:
<BLOCKQUOTE TYPE=CITE>
<PRE>
<FONT COLOR="#000000">I see in the FAQ the proper way to leave a cluster is with 'cman_tool leave</FONT>
<FONT COLOR="#000000">remove' I am getting a 'device or resource busy' error when I do that even</FONT>
<FONT COLOR="#000000">with GFS mounts removed and stopped. What am I missing? The only service</FONT>
<FONT COLOR="#000000">I see up is a "fence" type called "default" do I have to stop one more</FONT>
<FONT COLOR="#000000">thing?</FONT>
<FONT COLOR="#000000">Basically doing this:</FONT>
<FONT COLOR="#000000">service nfs stop</FONT>
<FONT COLOR="#000000">umount /export</FONT>
<FONT COLOR="#000000">service gfs stop</FONT>
<FONT COLOR="#000000">service rgmanager stop</FONT>
<FONT COLOR="#000000">service clvmd stop</FONT>
<FONT COLOR="#000000">cman_tool leave remove</FONT>
<FONT COLOR="#000000">Tells me this:</FONT>
<FONT COLOR="#000000">cman_tool: Error leaving cluster: Device or resource busy</FONT>
<FONT COLOR="#000000">Full snip from the server:</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# cman_tool services</FONT>
<FONT COLOR="#000000">type level name id state</FONT>
<FONT COLOR="#000000">fence 0 default 00010003 none</FONT>
<FONT COLOR="#000000">[1 2 3]</FONT>
<FONT COLOR="#000000">dlm 1 clvmd 00020003 none</FONT>
<FONT COLOR="#000000">[1 2 3]</FONT>
<FONT COLOR="#000000">dlm 1 rgmanager 00050003 none</FONT>
<FONT COLOR="#000000">[1 2 3]</FONT>
<FONT COLOR="#000000">dlm 1 nfs_data_vg 00040003 none</FONT>
<FONT COLOR="#000000">[1 2 3]</FONT>
<FONT COLOR="#000000">gfs 2 nfs_data_vg 00030003 none</FONT>
<FONT COLOR="#000000">[1 2 3]</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# service nfs stop</FONT>
<FONT COLOR="#000000">Shutting down NFS mountd: [ OK ]</FONT>
<FONT COLOR="#000000">Shutting down NFS daemon: [ OK ]</FONT>
<FONT COLOR="#000000">Shutting down NFS quotas: [ OK ]</FONT>
<FONT COLOR="#000000">Shutting down NFS services: [ OK ]</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# umount /export</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# service gfs stop</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# service rgmanager stop</FONT>
<FONT COLOR="#000000">Shutting down Cluster Service Manager...</FONT>
<FONT COLOR="#000000">Waiting for services to stop: [ OK ]</FONT>
<FONT COLOR="#000000">Cluster Service Manager is stopped.</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# service clvmd stop</FONT>
<FONT COLOR="#000000">Deactivating VG nfs_data_vg: 0 logical volume(s) in volume group</FONT>
<FONT COLOR="#000000">"nfs_data_vg" now active</FONT>
<FONT COLOR="#000000"> [ OK ]</FONT>
<FONT COLOR="#000000">Stopping clvm: [ OK ]</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# cman_tool leave remove</FONT>
<FONT COLOR="#000000">cman_tool: Error leaving cluster: Device or resource busy</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# cman_tool services</FONT>
<FONT COLOR="#000000">type level name id state</FONT>
<FONT COLOR="#000000">fence 0 default 00010003 none</FONT>
<FONT COLOR="#000000">[1 2 3]</FONT>
<FONT COLOR="#000000">[root@nfs-6 ~]# </FONT>
</PRE>
</BLOCKQUOTE>
<TABLE CELLSPACING="0" CELLPADDING="0" WIDTH="100%">
<TR>
<TD>
<BR>
<B><FONT SIZE="1"><FONT COLOR="#000066">Robert Hurst, Sr. Caché Administrator</FONT></FONT></B><BR>
<B><FONT SIZE="1"><FONT COLOR="#3333ff">Beth Israel Deaconess Medical Center</FONT></FONT></B><BR>
<B><FONT SIZE="1"><FONT COLOR="#6666ff">1135 Tremont Street, REN-7</FONT></FONT></B><BR>
<B><FONT SIZE="1"><FONT COLOR="#6666ff">Boston, Massachusetts 02120-2140</FONT></FONT></B><BR>
<B><FONT SIZE="1"><FONT COLOR="#6666ff">617-754-8754 ∙ Fax: 617-754-8730 ∙ Cell: 401-787-3154</FONT></FONT></B><BR>
<FONT SIZE="1"><FONT COLOR="#9999ff">Any technology distinguishable from magic is insufficiently advanced.</FONT></FONT>
</TD>
</TR>
</TABLE>
</BODY>
</HTML>