Hello,<br>I have a test server connected to an IBM DS6800 storage.<br>It is a blade bl480c with two qlogic hbas, connected to 2 fc-switches.<br>RH EL 4.6 x86_64 installed (kernel 2.6.9-67.ELsmp)<br>device-mapper-1.02.21-1.el4<br>
device-mapper-multipath-0.4.5-27.RHEL4<br><br>In boot messages I have for the hbas:<br>qla2400 0000:0c:00.0: Found an ISP2432, irq 185, iobase 0xffffff000001c000<br>QLogic Fibre Channel HBA Driver: 8.01.07-d4<br>QLogic QMH2462 - SBUS to 2Gb FC, Dual Channel<br>
ISP2432: PCIe (2.5Gb/s x4) @ 0000:0c:00.0 hdma+, host#=0, fw=4.00.150 [IP]<br>Vendor: IBM Model: 1750500 Rev: .155<br>Type: Direct-Access ANSI SCSI revision: 05<br><br>On the storage I have access to two luns, so that in total I get 8 paths and disks from sda to sdh.<br>
In multipath I'm using default os install config for ds6800 (storage 1750500)<br>so it should be:<br># device {<br># vendor "IBM"<br># product "1750500"<br>
# path_grouping_policy group_by_prio<br># getuid_callout "/sbin/scsi_id -g -u -s"<br># prio_callout "/sbin/mpath_prio_alua %d"<br># features "1 queue_if_no_path"<br>
# path_checker tur<br># }<br><br>In normal operation the command "multipath -ll" gives:<br>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">[root@test-rhel-p ~]# multipath -ll</span></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">mpath1
(3600507630efe05800000000000001700)</span></b></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">[size=20 GB][features="1
queue_if_no_path"][hwhandler="0"]</span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin 0 [prio=100]<b style="">[active]</b><span style=""> </span><b style=""></b></span></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_
0:0:1:1 sdd 8:48<span style=""> </span>[active][ready]</span></b></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_
1:0:1:1 sdh 8:112 [active][ready]</span></b></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin 0 [prio=20][enabled]<span style=""> </span></span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_ 0:0:0:1 sdb 8:16<span style=""> </span>[active][ready]</span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_ 1:0:0:1 sdf 8:80<span style=""> </span>[active][ready]</span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"> </span></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">mpath0
(3600507630efe05800000000000001600)</span></b></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">[size=20 GB][features="1
queue_if_no_path"][hwhandler="0"]</span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin 0 [prio=100]<b style="">[active] </b><span style=""> </span></span></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_
0:0:0:0 sda 8:0<span style=""> </span>[active][ready]</span></b></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_
1:0:0:0 sde 8:64<span style=""> </span>[active][ready]</span></b></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin 0 [prio=20][enabled] <span style=""> </span></span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_ 0:0:1:0 sdc 8:32<span style=""> </span>[active][ready]</span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span>\_ 1:0:1:0 sdg 8:96<span style=""> </span>[active][ready]</span></p>
<br>We had a code update for the storage, and so I wanted to test the multipath behaviour.<br>It was made in concurrent mode.<br>I get a first path-change whithout problems, probably when fisrt controller was updated.<br>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">mpath1:<br></span></p><p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin 0 [enabled]</span></p>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span><span style=""> </span><b style="">\_
0:0:0:1 sdb 8:16<span style=""> </span>[failed]</b></span></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 1:0:0:1 sdf 8:80<span style=""> </span>[failed]</span></b></p>
and<br>mpath0:<br>
<p class="MsoNormal"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin 0 [enabled]</span></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 0:0:0:0 sda 8:0<span style=""> </span>[failed]</span></b></p>
<p class="MsoNormal"><b style=""><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 1:0:0:0 sde 8:64<span style=""> </span>[failed]</span></b></p>
while the other two path group remained active.<br>At the end of upgrade, probably with the second controller update, I get the situation below.<br>while other servers with windows and Linux (using sdd) came back with all paths, this server retains two paths in failed state:<br>
<br>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">[root@test-rhel-p
RPMS]# multipath -l</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">mpath1
(3600507630efe05800000000000001700)</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">[size=20
GB][features="1 queue_if_no_path"][hwhandler="0"]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin
0 [enabled]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><b><span style=""> </span>\_ 0:0:1:1 sdd 8:48<span style=""> </span>[failed][faulty]</b></span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 1:0:1:1 sdh 8:112 [active]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin
0 [enabled]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 0:0:0:1 sdb 8:16<span style=""> </span>[active]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 1:0:0:1 sdf 8:80<span style=""> </span>[active]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"> </span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">mpath0
(3600507630efe05800000000000001600)</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">[size=20
GB][features="1 queue_if_no_path"][hwhandler="0"]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin
0 [active]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 0:0:0:0 sda 8:0<span style=""> </span>[active]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 1:0:0:0 sde 8:64<span style=""> </span>[active]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US">\_ round-robin
0 [enabled]</span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><b><span style=""> </span>\_ 0:0:1:0 sdc 8:32<span style=""> </span>[failed][faulty]</b></span></p>
<p class="MsoNormal" style="margin-bottom: 6pt;"><span style="font-size: 9pt; line-height: 115%;" lang="EN-US"><span style=""> </span>\_ 1:0:1:0 sdg 8:96<span style=""> </span>[active]</span></p>
<br>with messages every 5 seconds of type:<br><br>error calling out /sbin/mpath_prio_alua /dev/sdc<br>error calling out /sbin/mpath_prio_alua /dev/sdd<br><br>Other information:<br>[root@test-rhel-p ]# sg_inq /dev/sdc<br>
sg_inq: error opening file: /dev/sdc: No such device or address<br><br>[root@test-rhel-p RPMS]# ll /dev/sdc<br>brw-rw---- 1 root disk 8, 32 Jun 11 19:03 /dev/sdc<br><br>[root@test-rhel-p RPMS]# sg_inq /dev/sda<br>standard INQUIRY:<br>
PQual=0 Device_type=0 RMB=0 version=0x05 [SPC-3]<br> [AERC=0] [TrmTsk=0] NormACA=1 HiSUP=1 Resp_data_format=2<br> SCCS=0 ACC=0 TGPS=1 3PC=0 Protect=0 BQue=0<br> EncServ=0 MultiP=1 (VS=0) [MChngr=0] [ACKREQQ=0] Addr16=0<br>
[RelAdr=0] WBus16=0 Sync=0 Linked=0 [TranDis=0] CmdQue=1<br> Clocking=0x0 QAS=0 IUS=0<br> length=164 (0xa4) Peripheral device type: disk<br> Vendor identification: IBM<br> Product identification: 1750500<br>
Product revision level: .441<br> Unit serial number: 68778501600<br><br>Any help to get up the paths?<br>Could it help a scsi rescan? What should be the correct command in this case?<br>The system is operational and without interruption on disk acces for the users, but I don't understand why the paths don't come up again...<br>
<br>Thanks in advance for help or suggestions.<br>Gianluca<br><br><br>