[Linux-cluster] Multipath or Oracle RAC ASM issue?
sunhux G
sunhux at gmail.com
Wed Jun 18 16:20:03 UTC 2008
Hi
We have SAN disk partitions presented to 2 Redhat Linux servers, running
Oracle RAC (cluster) ASM.
As suggested by Linux "man multipath", I've made the
/var/lib/multipath/bindings the same
on both servers "to ensure That the multipath devices have the same names on
all nodes
accessing them" :
# Format:
# alias wwid
mpath0 360a98000567244396334493370345055
mpath1 360a9800056724439633449336c786d69
mpath2 360a980005672443963344933706f536c
mpath3 360a9800056724439633449336c514c75
mpath4 360a980005672443963344933706b4770
mpath5 360a9800056724439633449336c4d6b36
However /proc/partition on both servers showed differences on the
dm-x devices (but not on the /dev/sdxx devices) :
RAC1 server :
253 0 41947136 dm-0
253 1 41947136 dm-1
253 2 41947136 dm-2
253 3 5242880 dm-3
253 4 5242880 dm-4
253 5 41947136 dm-5
RAC2 server :
253 0 5242880 dm-0
253 1 41947136 dm-1
253 2 41947136 dm-2
253 3 5242880 dm-3
253 4 41947136 dm-4
253 5 41947136 dm-5
Appendix A below is the output of "multipath -ll" outputs from both servers
:
Q1 :
Do mpath0, mpath1, ... shown in "multipath -ll" listing refer to
/dev/mapper/mpathx or to /dev/mpath/mpathx ?
Q2 :
How do we make it such that the dm-x devices are accessing the same
SAN LUNs across the servers? I believe they are not the same based
on the observations of the disk spaces associated with each of the dm-x
shown in /proc/partition
What's described above so far is to help relate to the main issue below
(Oracle ASM on both servers seem to be Not accessing the same underlying
physical storage when trying to access the same ASM diskgroup:
On Server 1 :
==========
[root at landnet-rac1-temp mpath]# /etc/init.d/oracleasm created
isk land4 /dev/dm-0
Marking disk "/dev/dm-0" as an ASM disk: OK ]
[root at landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root at landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [253, 0]On Server 1 :
[root at landnet-rac1-temp mpath]# /etc/init.d/oracleasm created
ddisk land4 /dev/dm-0
Marking disk "/dev/dm-0" as an ASM disk: OK ]
[root at landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root at landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [253, 0] <<== note this number
Server 2:
=======
[root at landnet-rac2-temp dev]# /etc/init.d/oracleasm scandisks
Scanning system for ASM disks: OK ]
[root at landnet-rac2-temp dev]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root at landnet-rac2-temp dev]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [8, 32] <<== note the number
We logged a call to Oracle who responded :
If we are using device mapper and ASMLib then, we need to use disks from
/dev/dm-* disks
instead of disks from /dev/mapper/mpath*
but Redhat Support told us we should use /dev/mapper/mpath*
Appreciate if you can give me step by step instruction on how to untangle
this
whole issue. Basically we want the Oracle RAC ASM diskgroup LAN4 (& other
diskgroups which we'll be creating) to be accessing the same underlying
storage.
I'm inclined to think this has to do with multipathing setup than Oracle ASM
setup
or SAN setup.
One last piece of information (which may be relevant) :
On server 2, the dm-x mappings (shown below) differs from that on server 1:
[root at landnet-rac2-temp dev]# ls -ld dm-*
brw-r----- 1 root root 253, 0 Jun 18 17:49 dm-0
brw-r----- 1 root root 253, 1 Jun 18 17:49 dm-1
brw-r----- 1 root root 253, 2 Jun 18 17:49 dm-2
brw-r----- 1 root root 253, 3 Jun 18 17:49 dm-3
brw-r----- 1 root root 253, 4 Jun 18 17:49 dm-4
brw-r----- 1 root root 253, 5 Jun 18 17:49 dm-5
Appendix A ("multipath -ll" output from the servers) :
========================
On RAC1 server :
[root at landnet-rac1-temp mpath]# multipath -ll
mpath2 (360a980005672443963344933706f536c)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:3 sdq 65:0 [active][ready]
\_ 8:0:4:3 sdw 65:96 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:3 sde 8:64 [active][ready]
\_ 8:0:1:3 sdk 8:160 [active][ready]
mpath1 (360a9800056724439633449336c786d69)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:4 sdr 65:16 [active][ready]
\_ 8:0:4:4 sdx 65:112 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:4 sdf 8:80 [active][ready]
\_ 8:0:1:4 sdl 8:176 [active][ready]
mpath0 (360a98000567244396334493370345055)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:5 sds 65:32 [active][ready]
\_ 8:0:4:5 sdy 65:128 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:5 sdg 8:96 [active][ready]
\_ 8:0:1:5 sdm 8:192 [active][ready]
mpath5 (360a9800056724439633449336c4d6b36)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:1 sdo 8:224 [active][ready]
\_ 8:0:4:1 sdu 65:64 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:1 sdc 8:32 [active][ready]
\_ 8:0:1:1 sdi 8:128 [active][ready]
mpath4 (360a980005672443963344933706b4770)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:2 sdp 8:240 [active][ready]
\_ 8:0:4:2 sdv 65:80 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:2 sdd 8:48 [active][ready]
\_ 8:0:1:2 sdj 8:144 [active][ready]
mpath3 (360a9800056724439633449336c514c75)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:0 sdn 8:208 [active][ready]
\_ 8:0:4:0 sdt 65:48 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:1:0 sdh 8:112 [active][ready]
\_ 8:0:0:0 sdb 8:16 [active][ready]
=================
On RAC 2 server :
[root at landnet-rac2-temp ~]# multipath -ll
mpath2 (360a980005672443963344933706f536c)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:3 sdq 65:0 [active][ready]
\_ 8:0:3:3 sdw 65:96 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:3 sde 8:64 [active][ready]
\_ 8:0:1:3 sdk 8:160 [active][ready]
mpath1 (360a9800056724439633449336c786d69)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:4 sdr 65:16 [active][ready]
\_ 8:0:3:4 sdx 65:112 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:4 sdf 8:80 [active][ready]
\_ 8:0:1:4 sdl 8:176 [active][ready]
mpath0 (360a98000567244396334493370345055)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:5 sds 65:32 [active][ready]
\_ 8:0:3:5 sdy 65:128 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:5 sdg 8:96 [active][ready]
\_ 8:0:1:5 sdm 8:192 [active][ready]
mpath5 (360a9800056724439633449336c4d6b36)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:3:1 sdu 65:64 [active][ready]
\_ 8:0:2:1 sdo 8:224 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:1 sdc 8:32 [active][ready]
\_ 8:0:1:1 sdi 8:128 [active][ready]
mpath4 (360a980005672443963344933706b4770)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:2 sdp 8:240 [active][ready]
\_ 8:0:3:2 sdv 65:80 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:1:2 sdj 8:144 [active][ready]
\_ 8:0:0:2 sdd 8:48 [active][ready]
mpath3 (360a9800056724439633449336c514c75)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:0 sdn 8:208 [active][ready]
\_ 8:0:3:0 sdt 65:48 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:0 sdb 8:16 [active][ready]
\_ 8:0:1:0 sdh 8:112 [active][ready]
Appendix B (rawdevices file)
# This file and interface are deprecated.
# Applications needing raw device access should open regular
# block devices with O_DIRECT.
# raw device bindings
# format: <rawdev> <major> <minor>
# <rawdev> <blockdev>
# example: /dev/raw/raw1 /dev/sda1
# /dev/raw/raw2 8 5
/dev/mpath/mpath0
/dev/mpath/mpath1
/dev/mpath/mpath2
/dev/mpath/mpath3
/dev/mpath/mpath4
/dev/mpath/mpath5
Appendix C (/etc/multipath.conf)
========================
Server 1:
# This is an example configuration file for device mapper multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.annotated
# Blacklist all devices by default. Remove this to enable multipathing
# on the default devices.
#devnode_blacklist {
# devnode "*"
#}
## Use user friendly names, instead of using WWIDs as names.
defaults {
user_friendly_names yes
}
## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
# device {
# vendor "IBM"
# product "S/390 DASD ECKD"
# path_grouping_policy multibus
# getuid_callout "/sbin/dasdview -j /dev/%n"
# path_checker directio
# }
#}
##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
#defaults {
# udev_dir /dev
# polling_interval 10
# selector "round-robin 0"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# prio_callout /bin/true
# path_checker readsector0
# rr_min_io 100
# rr_weight priorities
# failback immediate
# no_path_retry fail
# user_friendly_name yes
#}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid. The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line. Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
## insert the sda, sdb or whatever local disks below so tt they're not
multipathed
devnode_blacklist {
# wwid 26353900f02796769
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*"
devnode "^hd[a-z]"
devnode "^cciss!c[0-9]d[0-9]*"
}
#multipaths {
# multipath {
# wwid 3600508b4000156d700012000000b0000
# alias yellow
# path_grouping_policy multibus
# path_checker readsector0
# path_selector "round-robin 0"
# failback manual
# rr_weight priorities
# no_path_retry 5
# }
# multipath {
# wwid 1DEC_____321816758474
# alias red
# }
#}
devices {
# device {
# vendor "COMPAQ "
# product "HSV110 (C)COMPAQ"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# path_checker readsector0
# path_selector "round-robin 0"
# hardware_handler "0"
# failback 15
# rr_weight priorities
# no_path_retry queue
# }
# device {
# vendor "COMPAQ "
# product "MSA1000 "
# path_grouping_policy multibus
# }
#
device {
vendor "NETAPP"
product "LUN"
path_grouping_policy group_by_prio
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout "/opt/netapp/santools/mpath_prio_ontap
/dev/%n"
features "1 queue_if_no_path"
path_checker readsector0
failback immediate
}
}
Appendix D ("fdisk -l" output)
Server 1:
Disk /dev/sda: 146.6 GB, 146685296640 bytes
255 heads, 63 sectors/track, 17833 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 13067 104856255 83 Linux
/dev/sda3 13068 15162 16828087+ 82 Linux swap
/dev/sda4 15163 17833 21454807+ 5 Extended
/dev/sda5 15163 16990 14683378+ 83 Linux
Disk /dev/sdb: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdc: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdd: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sde: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdf: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdg: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdg1 1 1018 5238597 5 Extended
Disk /dev/sdh: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdi: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdj: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdk: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdl: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdm: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdm1 1 1018 5238597 5 Extended
Disk /dev/sdn: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdo: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdp: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdq: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdr: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sds: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sds1 1 1018 5238597 5 Extended
Disk /dev/sdt: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdu: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdv: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdw: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdx: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdy: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdy1 1 1018 5238597 5 Extended
Disk /dev/dm-0: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-1: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-2: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-3: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/dm-4: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/dm-4p1 1 1018 5238597 5 Extended
Disk /dev/dm-5: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Server 2's "fdisk -l"
Disk /dev/sda: 146.6 GB, 146685296640 bytes
255 heads, 63 sectors/track, 17833 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 13067 104856255 83 Linux
/dev/sda3 13068 15162 16828087+ 82 Linux swap
/dev/sda4 15163 17833 21454807+ 5 Extended
/dev/sda5 15163 16990 14683378+ 83 Linux
Disk /dev/sdb: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdc: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdd: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sde: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdf: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdg: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdg1 1 1018 5238597 5 Extended
Disk /dev/sdh: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdi: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdj: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdk: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdl: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdm: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdm1 1 1018 5238597 5 Extended
Disk /dev/sdn: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdo: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdp: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdq: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdr: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sds: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sds1 1 1018 5238597 5 Extended
Disk /dev/sdt: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdu: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdv: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdw: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdx: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdy: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdy1 1 1018 5238597 5 Extended
Disk /dev/dm-0: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/dm-1: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-2: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-3: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/dm-3p1 1 1018 5238597 5 Extended
Disk /dev/dm-4: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-5: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Server 2 (/etc/multipath.conf)
========================
## Use user friendly names, instead of using WWIDs as names.
defaults {
user_friendly_names yes
}
## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
# device {
# vendor "IBM"
# product "S/390 DASD ECKD"
# path_grouping_policy multibus
# getuid_callout "/sbin/dasdview -j /dev/%n"
# path_checker directio
# }
#}
##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
#defaults {
# udev_dir /dev
# polling_interval 10
# selector "round-robin 0"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# prio_callout /bin/true
# path_checker readsector0
# rr_min_io 100
# rr_weight priorities
# failback immediate
# no_path_retry fail
# user_friendly_name yes
#}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid. The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line. Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
## insert the sda, sdb or whatever local disks below so tt they're not
multipathed
devnode_blacklist {
# wwid 26353900f02796769
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*"
devnode "^hd[a-z]"
devnode "^cciss!c[0-9]d[0-9]*"
}
#multipaths {
# multipath {
# wwid 3600508b4000156d700012000000b0000
# alias yellow
# path_grouping_policy multibus
# path_checker readsector0
# path_selector "round-robin 0"
# failback manual
# rr_weight priorities
# no_path_retry 5
# }
# multipath {
# wwid 1DEC_____321816758474
# alias red
# }
#}
devices {
# device {
# vendor "COMPAQ "
# product "HSV110 (C)COMPAQ"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# path_checker readsector0
# path_selector "round-robin 0"
# hardware_handler "0"
# failback 15
# rr_weight priorities
# no_path_retry queue
# }
# device {
# vendor "COMPAQ "
# product "MSA1000 "
# path_grouping_policy multibus
# }
#
device {
vendor "NETAPP"
product "LUN"
path_grouping_policy group_by_prio
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout
"/opt/netapp/santools/mpath_prio_ontap /dev/%n"
features "1 queue_if_no_path"
path_checker readsector0
failback immediate
}
}
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/linux-cluster/attachments/20080619/69107d58/attachment.htm>
More information about the Linux-cluster
mailing list