Hi<br><br>I have got a couple of MD3000i with dual controllers, <br>and two M600e blades connected two both of them.<br><br>I've setup multipath, and would appreciate if <br>someone could tell me whether the setup described<br>
below looks correct, or if you'd do it any<br>other way. <br>The reason I'm asking, is that I cannot see any <br>reference to 'rdac hardware handler' when <br>I do "multipath -ll". <br><br>However, when I change the module controller<br>
ownership one of the LUNs (while copying files to that<br>particular LUN), the failover seems to work - <br>the gilr copying continues after the controller switch.<br><br>I also see these messages in /var/log/messages when<br>
I change the module controller ownership:<br><br> 494 [RAIDarray.mpp]MD3000i_A:0:1:0 Cmnd-failed try alt ctrl 1. vcmnd SN 351494 <br>pdev H2:C0:T0:L0 0x05/0x94/0x01 0x08000002 mpp_status:1<br><br><br>Q1: What could be the reason that I'm not using the rdac hwhandler ? <br>
(see output from "multipath -ll" below)<br><br>Q2: Is using rdac for this kind of setup preferred ?<br><br>Q3: I've created a GPFS filesystem using the /dev/dm-0, /dev/dm-1, etc<br>device. Is it OK to use the dm-x devices ? I see that there<br>
are other alternatives such as /dev/mapper/mpath<x>.<br>However, /dev/mapper/mpath<x> is not visible in /proc/partitions <br>(see below), but the dm-<x> devices are - and the GPFS filesystem complains when<br>
it cannot see the devices in /proc/partitions.<br><br>Q4: Does my setup described here look OK ?<br><br><br>The blades are running: <br><br> SLES 10 SP2 (x86-64)<br><br>From the MD3000i Dell Resource CD the following rpm was installed:<br>
<br> linuxrdac-09.03.0C06.0030-1dkms<br><br>The following modules are running on my blades:<br><br># lsmod | egrep 'rdac|mpp|multi'<br>dm_rdac 24832 0<br>dm_multipath 42640 3 dm_rdac,dm_round_robin<br>
dm_mod 80528 26 dm_multipath<br>mppVhba 145120 24<br>mppUpper 127436 1 mppVhba<br>scsi_mod 170936 12 dm_rdac,iscsi_tcp,<br> libiscsi,<br>
scsi_transport_iscsi,<br> mptctl,mppVhba,mptsas,<br> mptscsih,<br> scsi_transport_sas,<br> mppUpper,sg,sd_mod<br>
<br><br>My multipath.conf file contains:<br><br>#cat /etc/multipath.conf<br><br>defaults {<br> udev_dir /dev<br> user_friendly_names yes<br>}<br>blacklist {<br> devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"<br>
devnode "^hd[a-z]"<br> devnode "^sda"<br> devnode "^sda[0-9]"<br> device {<br> vendor DELL<br> product "PERC|Universal"<br>
}<br>}<br>devices {<br> device {<br> vendor "DELL"<br> product "MD3000i"<br> product_blacklist "Universal Xport"<br>
features "1 queue_if_no_path"<br> path_grouping_policy group_by_prio<br> hardware_handler "1 rdac"<br> path_checker rdac<br>
prio "rdac"<br> failback immediate<br> }<br>}<br>multipaths {<br> mulitpath {<br> device {<br> vendor DELL<br>
product MD3000i<br> }<br> }<br>}<br><br>After changing the multipath.conf I did:<br><br>multipath -F<br>service multipathd restart<br><br>Now, if I've do:<br> <br># multipath -ll<br>
mpathe (36002219000918b4c00005b6c497e6632) dm-4 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:0:1 sdi 8:128 [active][ready]<br>mpathd (36002219000918b3300002e6e497e6315) dm-3 DELL,MD Virtual Disk<br>
[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:0:2 sdj 8:144 [active][ready]<br>mpathc (36002219000918b4c00005b6f497e6695) dm-2 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>
\_ round-robin 0 [prio=1][active]<br> \_ 9:0:0:3 sdk 8:160 [active][ready]<br>mpathb (36002219000918b3300002e71497e6378) dm-1 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br>
\_ 9:0:0:4 sdl 8:176 [active][ready]<br>mpatha (36002219000918b4c00005b72497e66f3) dm-0 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:0:5 sdm 8:192 [active][ready]<br>
mpathl (36002219000918b3300002e6b497e62a6) dm-11 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:0:0 sdb 8:16 [active][ready]<br>mpathk (36002219000922cdf000004a4497e53f5) dm-10 DELL,MD Virtual Disk<br>
[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:1:10 sdc 8:32 [active][ready]<br>mpathj (36002219000918b2e000004b2497e581c) dm-9 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>
\_ round-robin 0 [prio=1][active]<br> \_ 9:0:1:11 sdd 8:48 [active][ready]<br>mpathi (36002219000922cdf000004a7497e54dd) dm-8 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br>
\_ 9:0:1:12 sde 8:64 [active][ready]<br>mpathh (36002219000918b2e000004b5497e587e) dm-7 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:1:13 sdf 8:80 [active][ready]<br>
mpathg (36002219000922cdf000004aa497e5532) dm-6 DELL,MD Virtual Disk<br>[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:1:14 sdg 8:96 [active][ready]<br>mpathf (36002219000918b2e000004b8497e58dc) dm-5 DELL,MD Virtual Disk<br>
[size=5.5T][features=0][hwhandler=0]<br>\_ round-robin 0 [prio=1][active]<br> \_ 9:0:1:15 sdh 8:112 [active][ready]<br><br><br> cat /proc/partitions<br>major minor #blocks name<br><br> 8 0 71041024 sda<br> 8 1 530113 sda1<br>
8 2 8393962 sda2<br> 8 3 62115322 sda3<br> 8 16 5857419264 sdb<br> 8 32 5857419264 sdc<br> 8 48 5857419264 sdd<br> 8 64 5857419264 sde<br> 8 80 5857419264 sdf<br> 8 96 5857419264 sdg<br>
8 112 5857419264 sdh<br> 8 128 5857419264 sdi<br> 8 144 5857419264 sdj<br> 8 160 5857419264 sdk<br> 8 176 5857419264 sdl<br> 8 192 5857419264 sdm<br> 253 0 5857419264 dm-0<br> 253 1 5857419264 dm-1<br>
253 2 5857419264 dm-2<br> 253 3 5857419264 dm-3<br> 253 4 5857419264 dm-4<br> 253 5 5857419264 dm-5<br> 253 6 5857419264 dm-6<br> 253 7 5857419264 dm-7<br> 253 8 5857419264 dm-8<br> 253 9 5857419264 dm-9<br>
253 10 5857419264 dm-10<br> 253 11 5857419264 dm-11<br><br>Thank you<br><br><br>Christian<br>