<div><br></div><div>after a fresh, multipath -F and start of multipathd with -v 2 I see the following messages.</div><div><br></div><div>After starting multipathd I mounted /dev/mapper/vol1 and generated some simple I/O to it using dd</div> <div><br></div><div><br></div><div><div>Aug 13 16:23:14.888 localhost kernel: device-mapper: multipath: Failing path 8:208.</div><div>Aug 13 16:23:14.000 localhost multipathd: 8:208: mark as failed</div><div>Aug 13 16:23:16.000 localhost multipathd: 8:208: reinstated</div> <div>Aug 13 16:23:30.462 localhost kernel: device-mapper: multipath: Failing path 8:208. </div><div>Aug 13 16:23:30.000 localhost multipathd: 8:208: mark as failed</div><div>Aug 13 16:23:39.000 localhost multipathd: 8:208: reinstated</div> <div>Aug 13 16:23:46.430 localhost kernel: device-mapper: multipath: Failing path 8:208. </div><div>Aug 13 16:23:46.000 localhost multipathd: 8:208: mark as failed</div><div>Aug 13 16:23:51.041 localhost kernel: device-mapper: multipath: Failing path 8:208. </div> <div>Aug 13 16:23:51.000 localhost multipathd: 8:208: mark as failed</div><div>Aug 13 16:23:59.000 localhost multipathd: 8:208: reinstated</div><div>Aug 13 16:24:06.465 localhost kernel: device-mapper: multipath: Failing path 8:208.</div> <div>Aug 13 16:24:06.000 localhost multipathd: 8:208: mark as failed</div><div>Aug 13 16:24:09.000 localhost multipathd: 8:208: reinstated</div><div><br></div><div><br></div><div>Thanks,</div><div>--</div><div>Stew</div></div> <div><br></div><div><br></div><br><br><div class="gmail_quote">On Thu, Aug 13, 2009 at 12:42 PM, Moger, Babu <span dir="ltr"><<a href="mailto:Babu.Moger@lsi.com">Babu.Moger@lsi.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"> Do you have /var/log/messages file for this problem?<br> <br> Thanks<br> Babu Moger<br> <div><div></div><div class="h5"><br> > -----Original Message-----<br> > From: <a href="mailto:dm-devel-bounces@redhat.com">dm-devel-bounces@redhat.com</a> [mailto:<a href="mailto:dm-devel-bounces@redhat.com">dm-devel-bounces@redhat.com</a>] On<br> > Behalf Of Stewart Smith<br> > Sent: Thursday, August 13, 2009 1:51 PM<br> > To: <a href="mailto:dm-devel@redhat.com">dm-devel@redhat.com</a><br> > Subject: [dm-devel] rdac path failure - Sun 6140<br> ><br> > Hello All,<br> ><br> > I am seeing many of these messages when my Sun 6140 array is under heavy<br> > I/O<br> > device-mapper: multipath: Failing path 8:208.<br> > device-mapper: multipath: Failing path 8:208.<br> > device-mapper: multipath: Failing path 8:208.<br> > device-mapper: multipath: Failing path 8:208.<br> > device-mapper: multipath: Failing path 8:208.<br> ><br> ><br> > I am running a Fedora 10 server, with two fiber connections to two<br> > different switches. Both controllers on the 6140 have one connection<br> > to each switch as well. The end result is that I see four paths to<br> > each LUN.<br> ><br> > When the volume is mounted and under significant load I see the<br> > messages above every few seconds. They seem to appear every<br> > "no_path_retry" seconds.<br> ><br> > The 6140 controller firmware is up to date at version 07.50.08.10 and<br> > I have installed the latest firmware for my Emulex LPe11002 cards. I<br> > have reproduced the problem using both Cisco MDS and Brocade fiber<br> > channel switches as well.<br> ><br> > Using CAM, I have set the initiator Host Type to "Linux" at the<br> > moment. I have tried other options as well without success.<br> ><br> > I have NOT installed the RDAC drivers from either Sun or LSI -<br> > primarily because they do not seem to build on my Fedora 10 kernel.<br> ><br> > Any ideas would be greatly appreciated!!!<br> ><br> > configs and debugging multipathd output is below.<br> ><br> ><br> ><br> ><br> ><br> > Kernel: 2.6.27.24-170.2.68.fc10.x86_64<br> ><br> > # multipath -lll<br> > vol1 (3600a0b800048335200001e5d48b68a9b) dm-1 SUN,CSM200_R<br> > [size=12T][features=1 queue_if_no_path][hwhandler=1 rdac][rw]<br> > \_ round-robin 0 [prio=6][active]<br> > \_ 5:0:1:2 sdj 8:144 [active][ready]<br> > \_ 2:0:1:2 sdn 8:208 [active][ready]<br> > \_ round-robin 0 [prio=0][enabled]<br> > \_ 2:0:0:2 sdb 8:16 [active][ghost]<br> > \_ 5:0:0:2 sdd 8:48 [active][ghost]<br> ><br> ><br> > # cat /etc/multipath.conf<br> ><br> > blacklist {<br> > devnode "^sd[a-z][[0-9]*]"<br> > devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"<br> > devnode "^hd[a-z][0-9]*"<br> > devnode "^cciss!c[0-9]d[0-9](p[0-9]*)*"<br> > }<br> ><br> > defaults {<br> > udev_dir /dev<br> > polling_interval 10<br> > selector "round-robin 0"<br> > path_grouping_policy multibus<br> > getuid_callout "/sbin/scsi_id --whitelisted /dev/%n"<br> > prio alua<br> > path_checker readsector0<br> > rr_min_io 100<br> > max_fds 8192<br> > rr_weight priorities<br> > failback immediate<br> > no_path_retry fail<br> > user_friendly_names yes<br> > }<br> > devices {<br> > device {<br> > vendor "SUN"<br> > product "CSM200_R"<br> > product_blacklist "Universal Xport"<br> > getuid_callout "/sbin/scsi_id --whitelisted<br> > /dev/%n"<br> > features "0"<br> > hardware_handler "1 rdac"<br> > path_selector "round-robin 0"<br> > path_grouping_policy group_by_prio<br> > failback immediate<br> > rr_weight uniform<br> > no_path_retry queue<br> > rr_min_io 1000<br> > path_checker rdac<br> > prio rdac<br> > }<br> > }<br> ><br> > multipaths {<br> > multipath {<br> > wwid 3600a0b800048335200001e5d48b68a9b<br> > alias vol1<br> > rr_weight priorities<br> > no_path_retry 5<br> > rr_min_io 100<br> > }<br> > }<br> ><br> ><br> ><br> > # multipathd -d v3<br> ><br> ><br> > Aug 13 14:48:53 | sdb: ownership set to vol1<br> > Aug 13 14:48:53 | sdb: not found in pathvec<br> > Aug 13 14:48:53 | sdb: mask = 0xc<br> > Aug 13 14:48:53 | sdb: path checker = rdac (controller setting)<br> > Aug 13 14:48:53 | sdb: state = 4<br> > Aug 13 14:48:53 | sdb: rdac prio = 0<br> > Aug 13 14:48:53 | sdd: ownership set to vol1<br> > Aug 13 14:48:53 | sdd: not found in pathvec<br> > Aug 13 14:48:53 | sdd: mask = 0xc<br> > Aug 13 14:48:53 | sdd: path checker = rdac (controller setting)<br> > Aug 13 14:48:53 | sdd: state = 4<br> > Aug 13 14:48:53 | sdd: rdac prio = 0<br> > Aug 13 14:48:53 | sdj: ownership set to vol1<br> > Aug 13 14:48:53 | sdj: not found in pathvec<br> > Aug 13 14:48:53 | sdj: mask = 0xc<br> > Aug 13 14:48:53 | sdj: path checker = rdac (controller setting)<br> > Aug 13 14:48:53 | sdj: state = 2<br> > Aug 13 14:48:53 | sdj: rdac prio = 3<br> > Aug 13 14:48:53 | sdn: ownership set to vol1<br> > Aug 13 14:48:53 | sdn: not found in pathvec<br> > Aug 13 14:48:53 | sdn: mask = 0xc<br> > Aug 13 14:48:53 | sdn: path checker = rdac (controller setting)<br> > Aug 13 14:48:53 | sdn: state = 2<br> > Aug 13 14:48:53 | sdn: rdac prio = 3<br> > Aug 13 14:48:53 | vol1: pgfailback = -2 (controller setting)<br> > Aug 13 14:48:53 | vol1: pgpolicy = group_by_prio (controller setting)<br> > Aug 13 14:48:53 | vol1: selector = round-robin 0 (controller setting)<br> > Aug 13 14:48:53 | vol1: features = 0 (controller setting)<br> > Aug 13 14:48:53 | vol1: hwhandler = 1 rdac (controller setting)<br> > Aug 13 14:48:53 | vol1: rr_weight = 2 (LUN setting)<br> > Aug 13 14:48:53 | vol1: minio = 100 (LUN setting)<br> > Aug 13 14:48:53 | vol1: no_path_retry = 5 (multipath setting)<br> > Aug 13 14:48:53 | pg_timeout = NONE (internal default)<br> > Aug 13 14:48:53 | vol1: set ACT_CREATE (map does not exist)<br> > create: vol1 (3600a0b800048335200001e5d48b68a9b) n/a SUN,CSM200_R<br> > [size=12T][features=0][hwhandler=1 rdac][n/a]<br> > \_ round-robin 0 [prio=6][undef]<br> > \_ 5:0:1:2 sdj 8:144 [undef][ready]<br> > \_ 2:0:1:2 sdn 8:208 [undef][ready]<br> > \_ round-robin 0 [prio=0][undef]<br> > \_ 2:0:0:2 sdb 8:16 [undef][ghost]<br> > \_ 5:0:0:2 sdd 8:48 [undef][ghost]<br> ><br> </div></div>> --<br> > dm-devel mailing list<br> > <a href="mailto:dm-devel@redhat.com">dm-devel@redhat.com</a><br> > <a href="https://www.redhat.com/mailman/listinfo/dm-devel" target="_blank">https://www.redhat.com/mailman/listinfo/dm-devel</a><br> <font color="#888888"><br> --<br> dm-devel mailing list<br> <a href="mailto:dm-devel@redhat.com">dm-devel@redhat.com</a><br> <a href="https://www.redhat.com/mailman/listinfo/dm-devel" target="_blank">https://www.redhat.com/mailman/listinfo/dm-devel</a><br> </font></blockquote></div><br>