<div>Hi </div> <div> </div> <div>We have SAN disk partitions presented to 2 Redhat Linux servers, running Oracle RAC (cluster) ASM. As suggested by Linux "man multipath", I've made the /var/lib/multipath/bindings the same on both servers "to ensure That the multipath devices have the same names on all nodes accessing them" : # Format: # alias wwid mpath0 360a98000567244396334493370345055 mpath1 360a9800056724439633449336c786d69 mpath2 360a980005672443963344933706f536c mpath3 360a9800056724439633449336c514c75 mpath4 360a980005672443963344933706b4770 mpath5 360a9800056724439633449336c4d6b36 However /proc/partition on both servers showed differences on the</div> <div> dm-x devices (but not on the /dev/sdxx devices) : RAC1 server : 253 0 41947136 dm-0 253 1 41947136 dm-1 253 2 41947136 dm-2 253 3 5242880 dm-3 253 4 5242880 dm-4 253 5 41947136 dm-5 RAC2 server : 253 0 5242880 dm-0 253 1 41947136 dm-1 253 2 41947136 dm-2 253 3 5242880 dm-3 253 4 41947136 dm-4 253 5 41947136 dm-5 </div> <div>Appendix A below is the output of "multipath -ll" outputs from both servers :</div> <div> Q1 : Do mpath0, mpath1, ... shown in "multipath -ll" listing refer to /dev/mapper/mpathx or to /dev/mpath/mpathx ? Q2 : How do we make it such that the dm-x devices are accessing the same SAN LUNs across the servers? I believe they are not the same based on the observations of the disk spaces associated with each of the dm-x shown in /proc/partition What's described above so far is to help relate to the main issue below (Oracle ASM on both servers seem to be Not accessing the same underlying physical storage when trying to access the same ASM diskgroup: On Server 1 : ========== [root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm created isk land4 /dev/dm-0 Marking disk "/dev/dm-0" as an ASM disk: OK ] [root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks LAND1 LAND2 LAND4 [root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4 Disk "LAND4" is a valid ASM disk on device [253, 0]On Server 1 : [root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm created ddisk land4 /dev/dm-0 Marking disk "/dev/dm-0" as an ASM disk: OK ] [root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks LAND1 LAND2 LAND4 [root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4 Disk "LAND4" is a valid ASM disk on device [253, 0] <<== note this number Server 2: ======= [root@landnet-rac2-temp dev]# /etc/init.d/oracleasm scandisks Scanning system for ASM disks: OK ] [root@landnet-rac2-temp dev]# /etc/init.d/oracleasm listdisks LAND1 LAND2 LAND4 [root@landnet-rac2-temp dev]# /etc/init.d/oracleasm querydisk land4 Disk "LAND4" is a valid ASM disk on device [8, 32] <<== note the number We logged a call to Oracle who responded : If we are using device mapper and ASMLib then, we need to use disks from /dev/dm-* disks instead of disks from /dev/mapper/mpath* but Redhat Support told us we should use /dev/mapper/mpath* Appreciate if you can give me step by step instruction on how to untangle this whole issue. Basically we want the Oracle RAC ASM diskgroup LAN4 (& other diskgroups which we'll be creating) to be accessing the same underlying storage. I'm inclined to think this has to do with multipathing setup than Oracle ASM setup or SAN setup. One last piece of information (which may be relevant) : On server 2, the dm-x mappings (shown below) differs from that on server 1: [root@landnet-rac2-temp dev]# ls -ld dm-* brw-r----- 1 root root 253, 0 Jun 18 17:49 dm-0 brw-r----- 1 root root 253, 1 Jun 18 17:49 dm-1 brw-r----- 1 root root 253, 2 Jun 18 17:49 dm-2 brw-r----- 1 root root 253, 3 Jun 18 17:49 dm-3 brw-r----- 1 root root 253, 4 Jun 18 17:49 dm-4 brw-r----- 1 root root 253, 5 Jun 18 17:49 dm-5 </div> <div> </div> <div>Appendix A ("multipath -ll" output from the servers) :</div> <div>========================</div> <div> On RAC1 server : [root@landnet-rac1-temp mpath]# multipath -ll mpath2 (360a980005672443963344933706f536c) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:3 sdq 65:0 [active][ready] \_ 8:0:4:3 sdw 65:96 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:3 sde 8:64 [active][ready] \_ 8:0:1:3 sdk 8:160 [active][ready] mpath1 (360a9800056724439633449336c786d69) [size=5 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:4 sdr 65:16 [active][ready] \_ 8:0:4:4 sdx 65:112 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:4 sdf 8:80 [active][ready] \_ 8:0:1:4 sdl 8:176 [active][ready] mpath0 (360a98000567244396334493370345055) [size=5 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:5 sds 65:32 [active][ready] \_ 8:0:4:5 sdy 65:128 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:5 sdg 8:96 [active][ready] \_ 8:0:1:5 sdm 8:192 [active][ready] mpath5 (360a9800056724439633449336c4d6b36) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:1 sdo 8:224 [active][ready] \_ 8:0:4:1 sdu 65:64 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:1 sdc 8:32 [active][ready] \_ 8:0:1:1 sdi 8:128 [active][ready] mpath4 (360a980005672443963344933706b4770) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:2 sdp 8:240 [active][ready] \_ 8:0:4:2 sdv 65:80 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:2 sdd 8:48 [active][ready] \_ 8:0:1:2 sdj 8:144 [active][ready] mpath3 (360a9800056724439633449336c514c75) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:0 sdn 8:208 [active][ready] \_ 8:0:4:0 sdt 65:48 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:1:0 sdh 8:112 [active][ready] \_ 8:0:0:0 sdb 8:16 [active][ready] ================= On RAC 2 server : [root@landnet-rac2-temp ~]# multipath -ll mpath2 (360a980005672443963344933706f536c) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:3 sdq 65:0 [active][ready] \_ 8:0:3:3 sdw 65:96 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:3 sde 8:64 [active][ready] \_ 8:0:1:3 sdk 8:160 [active][ready] mpath1 (360a9800056724439633449336c786d69) [size=5 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:4 sdr 65:16 [active][ready] \_ 8:0:3:4 sdx 65:112 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:4 sdf 8:80 [active][ready] \_ 8:0:1:4 sdl 8:176 [active][ready] mpath0 (360a98000567244396334493370345055) [size=5 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:5 sds 65:32 [active][ready] \_ 8:0:3:5 sdy 65:128 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:5 sdg 8:96 [active][ready] \_ 8:0:1:5 sdm 8:192 [active][ready] mpath5 (360a9800056724439633449336c4d6b36) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:3:1 sdu 65:64 [active][ready] \_ 8:0:2:1 sdo 8:224 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:1 sdc 8:32 [active][ready] \_ 8:0:1:1 sdi 8:128 [active][ready] mpath4 (360a980005672443963344933706b4770) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:2 sdp 8:240 [active][ready] \_ 8:0:3:2 sdv 65:80 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:1:2 sdj 8:144 [active][ready] \_ 8:0:0:2 sdd 8:48 [active][ready] mpath3 (360a9800056724439633449336c514c75) [size=40 GB][features="1 queue_if_no_path"][hwhandler="0"] \_ round-robin 0 [prio=8][active] \_ 8:0:2:0 sdn 8:208 [active][ready] \_ 8:0:3:0 sdt 65:48 [active][ready] \_ round-robin 0 [prio=2][enabled] \_ 8:0:0:0 sdb 8:16 [active][ready] \_ 8:0:1:0 sdh 8:112 [active][ready] Appendix B (rawdevices file) # This file and interface are deprecated. # Applications needing raw device access should open regular # block devices with O_DIRECT. # raw device bindings # format: <rawdev> <major> <minor> # <rawdev> <blockdev> # example: /dev/raw/raw1 /dev/sda1 # /dev/raw/raw2 8 5 /dev/mpath/mpath0 /dev/mpath/mpath1 /dev/mpath/mpath2 /dev/mpath/mpath3 /dev/mpath/mpath4 /dev/mpath/mpath5 Appendix C (/etc/multipath.conf) ======================== Server 1: # This is an example configuration file for device mapper multipath. # For a complete list of the default configuration values, see # /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.defaults # For a list of configuration options with descriptions, see # /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.annotated # Blacklist all devices by default. Remove this to enable multipathing # on the default devices. #devnode_blacklist { # devnode "*" #} ## Use user friendly names, instead of using WWIDs as names. defaults { user_friendly_names yes } ## By default, devices with vendor = "IBM" and product = "S/390.*" are ## blacklisted. To enable mulitpathing on these devies, uncomment the ## following lines. #devices { # device { # vendor "IBM" # product "S/390 DASD ECKD" # path_grouping_policy multibus # getuid_callout "/sbin/dasdview -j /dev/%n" # path_checker directio # } #} ## ## This is a template multipath-tools configuration file ## Uncomment the lines relevent to your environment ## #defaults { # udev_dir /dev # polling_interval 10 # selector "round-robin 0" # path_grouping_policy multibus # getuid_callout "/sbin/scsi_id -g -u -s /block/%n" # prio_callout /bin/true # path_checker readsector0 # rr_min_io 100 # rr_weight priorities # failback immediate # no_path_retry fail # user_friendly_name yes #} ## ## The wwid line in the following blacklist section is shown as an example ## of how to blacklist devices by wwid. The 3 devnode lines are the ## compiled in default blacklist. If you want to blacklist entire types ## of devices, such as all scsi devices, you should use a devnode line. ## However, if you want to blacklist specific devices, you should use ## a wwid line. Since there is no guarantee that a specific device will ## not change names on reboot (from /dev/sda to /dev/sdb for example) ## devnode lines are not recommended for blacklisting specific devices. ## ## insert the sda, sdb or whatever local disks below so tt they're not multipathed devnode_blacklist { # wwid 26353900f02796769 devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*" devnode "^hd[a-z]" devnode "^cciss!c[0-9]d[0-9]*" } #multipaths { # multipath { # wwid 3600508b4000156d700012000000b0000 # alias yellow # path_grouping_policy multibus # path_checker readsector0 # path_selector "round-robin 0" # failback manual # rr_weight priorities # no_path_retry 5 # } # multipath { # wwid 1DEC_____321816758474 # alias red # } #} devices { # device { # vendor "COMPAQ " # product "HSV110 (C)COMPAQ" # path_grouping_policy multibus # getuid_callout "/sbin/scsi_id -g -u -s /block/%n" # path_checker readsector0 # path_selector "round-robin 0" # hardware_handler "0" # failback 15 # rr_weight priorities # no_path_retry queue # } # device { # vendor "COMPAQ " # product "MSA1000 " # path_grouping_policy multibus # } # device { vendor "NETAPP" product "LUN" path_grouping_policy group_by_prio getuid_callout "/sbin/scsi_id -g -u -s /block/%n" prio_callout "/opt/netapp/santools/mpath_prio_ontap /dev/%n" features "1 queue_if_no_path" path_checker readsector0 failback immediate } } Appendix D ("fdisk -l" output) Server 1:<pre>Disk /dev/sda: 146.6 GB, 146685296640 bytes 255 heads, 63 sectors/track, 17833 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 13067 104856255 83 Linux /dev/sda3 13068 15162 16828087+ 82 Linux swap /dev/sda4 15163 17833 21454807+ 5 Extended /dev/sda5 15163 16990 14683378+ 83 Linux Disk /dev/sdb: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdc: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdd: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sde: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdf: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdg: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdg1 1 1018 5238597 5 Extended Disk /dev/sdh: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdi: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdj: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdk: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdl: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdm: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdm1 1 1018 5238597 5 Extended Disk /dev/sdn: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdo: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdp: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdq: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdr: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sds: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sds1 1 1018 5238597 5 Extended Disk /dev/sdt: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdu: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdv: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdw: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdx: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdy: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdy1 1 1018 5238597 5 Extended Disk /dev/dm-0: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-1: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-2: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-3: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/dm-4: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/dm-4p1 1 1018 5238597 5 Extended Disk /dev/dm-5: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes </pre><pre>Server 2's "fdisk -l"</pre><pre><pre>Disk /dev/sda: 146.6 GB, 146685296640 bytes 255 heads, 63 sectors/track, 17833 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 13067 104856255 83 Linux /dev/sda3 13068 15162 16828087+ 82 Linux swap /dev/sda4 15163 17833 21454807+ 5 Extended /dev/sda5 15163 16990 14683378+ 83 Linux Disk /dev/sdb: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdc: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdd: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sde: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdf: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdg: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdg1 1 1018 5238597 5 Extended Disk /dev/sdh: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdi: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdj: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdk: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdl: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdm: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdm1 1 1018 5238597 5 Extended Disk /dev/sdn: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdo: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdp: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdq: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdr: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sds: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sds1 1 1018 5238597 5 Extended Disk /dev/sdt: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdu: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdv: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdw: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdx: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdy: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdy1 1 1018 5238597 5 Extended Disk /dev/dm-0: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/dm-1: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-2: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-3: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/dm-3p1 1 1018 5238597 5 Extended Disk /dev/dm-4: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-5: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes </pre><pre>Server 2 (/etc/multipath.conf)</pre><pre>========================</pre><pre>## Use user friendly names, instead of using WWIDs as names. defaults { user_friendly_names yes } ## By default, devices with vendor = "IBM" and product = "S/390.*" are ## blacklisted. To enable mulitpathing on these devies, uncomment the ## following lines. #devices { # device { # vendor "IBM" # product "S/390 DASD ECKD" # path_grouping_policy multibus # getuid_callout "/sbin/dasdview -j /dev/%n" # path_checker directio # } #} ## ## This is a template multipath-tools configuration file ## Uncomment the lines relevent to your environment ## #defaults { # udev_dir /dev # polling_interval 10 # selector "round-robin 0" # path_grouping_policy multibus # getuid_callout "/sbin/scsi_id -g -u -s /block/%n" # prio_callout /bin/true # path_checker readsector0 # rr_min_io 100 # rr_weight priorities # failback immediate # no_path_retry fail # user_friendly_name yes #} ## ## The wwid line in the following blacklist section is shown as an example ## of how to blacklist devices by wwid. The 3 devnode lines are the ## compiled in default blacklist. If you want to blacklist entire types ## of devices, such as all scsi devices, you should use a devnode line. ## However, if you want to blacklist specific devices, you should use ## a wwid line. Since there is no guarantee that a specific device will ## not change names on reboot (from /dev/sda to /dev/sdb for example) ## devnode lines are not recommended for blacklisting specific devices. ## ## insert the sda, sdb or whatever local disks below so tt they're not multipathed devnode_blacklist { # wwid 26353900f02796769 devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*" devnode "^hd[a-z]" devnode "^cciss!c[0-9]d[0-9]*" } #multipaths { # multipath { # wwid 3600508b4000156d700012000000b0000 # alias yellow # path_grouping_policy multibus # path_checker readsector0 # path_selector "round-robin 0" # failback manual # rr_weight priorities # no_path_retry 5 # } # multipath { # wwid 1DEC_____321816758474 # alias red # } #} devices { # device { # vendor "COMPAQ " # product "HSV110 (C)COMPAQ" # path_grouping_policy multibus # getuid_callout "/sbin/scsi_id -g -u -s /block/%n" # path_checker readsector0 # path_selector "round-robin 0" # hardware_handler "0" # failback 15 # rr_weight priorities # no_path_retry queue # } # device { # vendor "COMPAQ " # product "MSA1000 " # path_grouping_policy multibus # } # device { vendor "NETAPP" product "LUN" path_grouping_policy group_by_prio getuid_callout "/sbin/scsi_id -g -u -s /block/%n" prio_callout "/opt/netapp/santools/mpath_prio_ontap /dev/%n" features "1 queue_if_no_path" path_checker readsector0 failback immediate } } </pre></pre></div>