<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Sorry, left off a few key details:<div><br></div><div>I'm running the following:</div><div><br></div><div>redhat 5.3 x86_64</div><div>device-mapper-1.02.28-2.el5</div><div>device-mapper-multipath-0.4.7-23.el5_3.4</div><div><br></div><div>Let me know if there are other details that would be helpful.</div><div><br></div><div>-Eli<br><div><div><br></div><div>On Sep 30, 2009, at 10:41 AM, Eli Klein wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">I'm running into an issue where the failback option in multipath.conf is being ignored.  I've tried to set this to a value > 0 to cause dm to pause before reinstating a recovered path, but it reinstates the path immediately.  The same is true when setting the value to "manual", the path is reinstated immediately.  The delay is most useful when a ethernet switch has failed or rebooted.  During the boot of the switch, the interface comes up and drops again multiple times.  I'd love to be able to introduce a delay before DM marks the path as reinstated after a recovery.  This would save me the hassle of running into I/O errors (and occasional filesystem RO) as the path bounces while the switch is booting.  <div><div><br></div><div>Thanks in advance for any help or suggestions!</div><div><br></div><div>-Eli</div><div><br></div><div>I've included my multipath.conf as well as output from multipath -ll below:</div><div><br></div><div><b>multipath.conf</b>:</div><div><br></div></div><blockquote class="webkit-indent-blockquote" style="margin: 0 0 0 40px; border: none; padding: 0px;"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px; ">blacklist {<br>        devnode "sda$"<br>#        devnode "*"<br>}<br><br>## By default, devices with vendor = "IBM" and product = "S/390.*" are<br>## blacklisted. To enable mulitpathing on these devies, uncomment the<br>## following lines.<br>#blacklist_exceptions {<br>#</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">        </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">device {<br>#</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">               </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">vendor</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">    </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">"IBM"<br>#</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">                </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">product</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">   </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">"S/390.*"<br>#</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">    </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">}<br>#}<br><br>## Use user friendly names, instead of using WWIDs as names.<br>defaults {<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">       </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">user_friendly_names yes<br>}<br>##<br>## Here is an example of how to configure some standard options.<br>##<br>#<br>defaults {<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">     </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">udev_dir</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">          </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">/dev<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">    </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">polling_interval </span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;"> </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">10<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">      </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">selector</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">          </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">"round-robin 0"<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">       </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">path_grouping_policy</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">      </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">multibus<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">        </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">getuid_callout</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">            </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">"/sbin/scsi_id -g -u -s /block/%n"<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">    </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">prio_callout</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">              </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">/bin/true<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">       </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">path_checker</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">              </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">readsector0<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">     </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">rr_min_io</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">         </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">10<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">      </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">rr_weight</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">         </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">priorities<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">      </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">failback</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">          </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">120<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">     </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">features</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">          </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">"1 queue_if_no_path"<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">  </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">no_path_retry</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">             </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">1<br></span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">       </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">user_friendly_name</span></font><span class="Apple-tab-span" style="white-space:pre"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">        </span></font></span><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">yes<br>}</span></font></blockquote><div><div><div><br></div><div><b>multipath -ll</b>:</div><div><br></div></div></div><blockquote class="webkit-indent-blockquote" style="margin: 0 0 0 40px; border: none; padding: 0px;"><font class="Apple-style-span" face="'Courier New'" size="3"><span class="Apple-style-span" style="font-size: 12px;">mpath2 (36000eb3945b8703a00000000000000f4) dm-3 LEFTHAND,iSCSIDisk<br>[size=400G][features=1 queue_if_no_path][hwhandler=0][rw]<br>\_ round-robin 0 [prio=0][active]<br> \_ 192:0:0:0 sdl 8:176 [active][ready]<br> \_ 191:0:0:0 sdf 8:80  [active][ready]<br>mpath152 (36000eb3945b8703a0000000000001431) dm-2 LEFTHAND,iSCSIDisk<br>[size=300G][features=1 queue_if_no_path][hwhandler=0][rw]<br>\_ round-robin 0 [prio=0][active]<br> \_ 186:0:0:0 sdh 8:112 [active][ready]<br> \_ 185:0:0:0 sde 8:64  [active][ready]<br>mpath149 (36000eb3945b8703a0000000000001429) dm-5 LEFTHAND,iSCSIDisk<br>[size=300G][features=1 queue_if_no_path][hwhandler=0][rw]<br>\_ round-robin 0 [prio=0][active]<br> \_ 189:0:0:0 sdc 8:32  [active][ready]<br> \_ 190:0:0:0 sdi 8:128 [active][ready]<br>mpath151 (36000eb3945b8703a000000000000142d) dm-6 LEFTHAND,iSCSIDisk<br>[size=300G][features=1 queue_if_no_path][hwhandler=0][rw]<br>\_ round-robin 0 [prio=0][active]<br> \_ 188:0:0:0 sdj 8:144 [active][ready]<br> \_ 187:0:0:0 sdg 8:96  [active][ready]<br>mpath150 (36000eb3945b8703a0000000000001435) dm-4 LEFTHAND,iSCSIDisk<br>[size=200G][features=1 queue_if_no_path][hwhandler=0][rw]<br>\_ round-robin 0 [prio=0][active]<br> \_ 184:0:0:0 sdk 8:160 [active][ready]<br> \_ 183:0:0:0 sdd 8:48  [active][ready]</span></font></blockquote></div></blockquote></div><br></div></body></html>