Oracle RAC (cluster) ASM.
As suggested by Linux "man multipath", I've made the /var/lib/multipath/bindings the same
on both servers "to ensure That the multipath devices have the same names on all nodes
accessing them" :
# Format:
# alias wwid
mpath0 360a98000567244396334493370345055
mpath1 360a9800056724439633449336c786d69
mpath2 360a980005672443963344933706f536c
mpath3 360a9800056724439633449336c514c75
mpath4 360a980005672443963344933706b4770
mpath5 360a9800056724439633449336c4d6b36
However /proc/partition on both servers showed differences on the
RAC1 server :
253 0 41947136 dm-0
253 1 41947136 dm-1
253 2 41947136 dm-2
253 3 5242880 dm-3
253 4 5242880 dm-4
253 5 41947136 dm-5
RAC2 server :
253 0 5242880 dm-0
253 1 41947136 dm-1
253 2 41947136 dm-2
253 3 5242880 dm-3
253 4 41947136 dm-4
253 5 41947136 dm-5
Q1 :
Do mpath0, mpath1, ... shown in "multipath -ll" listing refer to
/dev/mapper/mpathx or to /dev/mpath/mpathx ?
Q2 :
How do we make it such that the dm-x devices are accessing the same
SAN LUNs across the servers? I believe they are not the same based
on the observations of the disk spaces associated with each of the dm-x
shown in /proc/partition
What's described above so far is to help relate to the main issue below
(Oracle ASM on both servers seem to be Not accessing the same underlying
physical storage when trying to access the same ASM diskgroup:
On Server 1 :
==========
[root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm created
isk land4 /dev/dm-0
Marking disk "/dev/dm-0" as an ASM disk: OK ]
[root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [253, 0]On Server 1 :
[root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm created
ddisk land4 /dev/dm-0
Marking disk "/dev/dm-0" as an ASM disk: OK ]
[root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root@landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [253, 0] <<== note this number
Server 2:
=======
[root@landnet-rac2-temp dev]# /etc/init.d/oracleasm scandisks
Scanning system for ASM disks: OK ]
[root@landnet-rac2-temp dev]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root@landnet-rac2-temp dev]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [8, 32] <<== note the number
We logged a call to Oracle who responded :
If we are using device mapper and ASMLib then, we need to use disks from /dev/dm-* disks
instead of disks from /dev/mapper/mpath*
but Redhat Support told us we should use /dev/mapper/mpath*
Appreciate if you can give me step by step instruction on how to untangle this
whole issue. Basically we want the Oracle RAC ASM diskgroup LAN4 (& other
diskgroups which we'll be creating) to be accessing the same underlying storage.
I'm inclined to think this has to do with multipathing setup than Oracle ASM setup
or SAN setup.
One last piece of information (which may be relevant) :
On server 2, the dm-x mappings (shown below) differs from that on server 1:
[root@landnet-rac2-temp dev]# ls -ld dm-*
brw-r----- 1 root root 253, 0 Jun 18 17:49 dm-0
brw-r----- 1 root root 253, 1 Jun 18 17:49 dm-1
brw-r----- 1 root root 253, 2 Jun 18 17:49 dm-2
brw-r----- 1 root root 253, 3 Jun 18 17:49 dm-3
brw-r----- 1 root root 253, 4 Jun 18 17:49 dm-4
brw-r----- 1 root root 253, 5 Jun 18 17:49 dm-5
On RAC1 server :
[root@landnet-rac1-temp mpath]# multipath -ll
mpath2 (360a980005672443963344933706f536c)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:3 sdq 65:0 [active][ready]
\_ 8:0:4:3 sdw 65:96 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:3 sde 8:64 [active][ready]
\_ 8:0:1:3 sdk 8:160 [active][ready]
mpath1 (360a9800056724439633449336c786d69)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:4 sdr 65:16 [active][ready]
\_ 8:0:4:4 sdx 65:112 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:4 sdf 8:80 [active][ready]
\_ 8:0:1:4 sdl 8:176 [active][ready]
mpath0 (360a98000567244396334493370345055)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:5 sds 65:32 [active][ready]
\_ 8:0:4:5 sdy 65:128 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:5 sdg 8:96 [active][ready]
\_ 8:0:1:5 sdm 8:192 [active][ready]
mpath5 (360a9800056724439633449336c4d6b36)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:1 sdo 8:224 [active][ready]
\_ 8:0:4:1 sdu 65:64 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:1 sdc 8:32 [active][ready]
\_ 8:0:1:1 sdi 8:128 [active][ready]
mpath4 (360a980005672443963344933706b4770)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:2 sdp 8:240 [active][ready]
\_ 8:0:4:2 sdv 65:80 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:2 sdd 8:48 [active][ready]
\_ 8:0:1:2 sdj 8:144 [active][ready]
mpath3 (360a9800056724439633449336c514c75)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:0 sdn 8:208 [active][ready]
\_ 8:0:4:0 sdt 65:48 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:1:0 sdh 8:112 [active][ready]
\_ 8:0:0:0 sdb 8:16 [active][ready]
=================
On RAC 2 server :
[root@landnet-rac2-temp ~]# multipath -ll
mpath2 (360a980005672443963344933706f536c)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:3 sdq 65:0 [active][ready]
\_ 8:0:3:3 sdw 65:96 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:3 sde 8:64 [active][ready]
\_ 8:0:1:3 sdk 8:160 [active][ready]
mpath1 (360a9800056724439633449336c786d69)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:4 sdr 65:16 [active][ready]
\_ 8:0:3:4 sdx 65:112 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:4 sdf 8:80 [active][ready]
\_ 8:0:1:4 sdl 8:176 [active][ready]
mpath0 (360a98000567244396334493370345055)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:5 sds 65:32 [active][ready]
\_ 8:0:3:5 sdy 65:128 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:5 sdg 8:96 [active][ready]
\_ 8:0:1:5 sdm 8:192 [active][ready]
mpath5 (360a9800056724439633449336c4d6b36)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:3:1 sdu 65:64 [active][ready]
\_ 8:0:2:1 sdo 8:224 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:1 sdc 8:32 [active][ready]
\_ 8:0:1:1 sdi 8:128 [active][ready]
mpath4 (360a980005672443963344933706b4770)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:2 sdp 8:240 [active][ready]
\_ 8:0:3:2 sdv 65:80 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:1:2 sdj 8:144 [active][ready]
\_ 8:0:0:2 sdd 8:48 [active][ready]
mpath3 (360a9800056724439633449336c514c75)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
\_ 8:0:2:0 sdn 8:208 [active][ready]
\_ 8:0:3:0 sdt 65:48 [active][ready]
\_ round-robin 0 [prio=2][enabled]
\_ 8:0:0:0 sdb 8:16 [active][ready]
\_ 8:0:1:0 sdh 8:112 [active][ready]
Appendix B (rawdevices file)
# This file and interface are deprecated.
# Applications needing raw device access should open regular
# block devices with O_DIRECT.
# raw device bindings
# format: <rawdev> <major> <minor>
# <rawdev> <blockdev>
# example: /dev/raw/raw1 /dev/sda1
# /dev/raw/raw2 8 5
/dev/mpath/mpath0
/dev/mpath/mpath1
/dev/mpath/mpath2
/dev/mpath/mpath3
/dev/mpath/mpath4
/dev/mpath/mpath5
Appendix C (/etc/multipath.conf)
========================
Server 1:
# This is an example configuration file for device mapper multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.annotated
# Blacklist all devices by default. Remove this to enable multipathing
# on the default devices.
#devnode_blacklist {
# devnode "*"
#}
## Use user friendly names, instead of using WWIDs as names.
defaults {
user_friendly_names yes
}
## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
# device {
# vendor "IBM"
# product "S/390 DASD ECKD"
# path_grouping_policy multibus
# getuid_callout "/sbin/dasdview -j /dev/%n"
# path_checker directio
# }
#}
##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
#defaults {
# udev_dir /dev
# polling_interval 10
# selector "round-robin 0"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# prio_callout /bin/true
# path_checker readsector0
# rr_min_io 100
# rr_weight priorities
# failback immediate
# no_path_retry fail
# user_friendly_name yes
#}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid. The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line. Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
## insert the sda, sdb or whatever local disks below so tt they're not multipathed
devnode_blacklist {
# wwid 26353900f02796769
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*"
devnode "^hd[a-z]"
devnode "^cciss!c[0-9]d[0-9]*"
}
#multipaths {
# multipath {
# wwid 3600508b4000156d700012000000b0000
# alias yellow
# path_grouping_policy multibus
# path_checker readsector0
# path_selector "round-robin 0"
# failback manual
# rr_weight priorities
# no_path_retry 5
# }
# multipath {
# wwid 1DEC_____321816758474
# alias red
# }
#}
devices {
# device {
# vendor "COMPAQ "
# product "HSV110 (C)COMPAQ"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# path_checker readsector0
# path_selector "round-robin 0"
# hardware_handler "0"
# failback 15
# rr_weight priorities
# no_path_retry queue
# }
# device {
# vendor "COMPAQ "
# product "MSA1000 "
# path_grouping_policy multibus
# }
#
device {
vendor "NETAPP"
product "LUN"
path_grouping_policy group_by_prio
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout "/opt/netapp/santools/mpath_prio_ontap /dev/%n"
features "1 queue_if_no_path"
path_checker readsector0
failback immediate
}
}
Appendix D ("fdisk -l" output)
Server 1:
Disk /dev/sda: 146.6 GB, 146685296640 bytes
255 heads, 63 sectors/track, 17833 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 13067 104856255 83 Linux
/dev/sda3 13068 15162 16828087+ 82 Linux swap
/dev/sda4 15163 17833 21454807+ 5 Extended
/dev/sda5 15163 16990 14683378+ 83 Linux
Disk /dev/sdb: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdc: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdd: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sde: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdf: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdg: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdg1 1 1018 5238597 5 Extended
Disk /dev/sdh: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdi: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdj: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdk: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdl: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdm: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdm1 1 1018 5238597 5 Extended
Disk /dev/sdn: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdo: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdp: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdq: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdr: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sds: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sds1 1 1018 5238597 5 Extended
Disk /dev/sdt: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdu: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdv: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdw: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdx: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/sdy: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/sdy1 1 1018 5238597 5 Extended
Disk /dev/dm-0: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-1: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-2: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/dm-3: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Disk /dev/dm-4: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes
Device Boot Start End Blocks Id System
/dev/dm-4p1 1 1018 5238597 5 Extended
Disk /dev/dm-5: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Server 2's "fdisk -l"
Disk /dev/sda: 146.6 GB, 146685296640 bytes 255 heads, 63 sectors/track, 17833 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 13067 104856255 83 Linux /dev/sda3 13068 15162 16828087+ 82 Linux swap /dev/sda4 15163 17833 21454807+ 5 Extended /dev/sda5 15163 16990 14683378+ 83 Linux Disk /dev/sdb: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdc: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdd: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sde: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdf: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdg: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdg1 1 1018 5238597 5 Extended Disk /dev/sdh: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdi: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdj: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdk: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdl: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdm: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdm1 1 1018 5238597 5 Extended Disk /dev/sdn: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdo: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdp: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdq: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdr: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sds: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sds1 1 1018 5238597 5 Extended Disk /dev/sdt: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdu: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdv: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdw: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/sdx: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/sdy: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/sdy1 1 1018 5238597 5 Extended Disk /dev/dm-0: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Disk /dev/dm-1: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-2: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-3: 5368 MB, 5368709120 bytes 166 heads, 62 sectors/track, 1018 cylinders Units = cylinders of 10292 * 512 = 5269504 bytes Device Boot Start End Blocks Id System /dev/dm-3p1 1 1018 5238597 5 Extended Disk /dev/dm-4: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes Disk /dev/dm-5: 42.9 GB, 42953867264 bytes 64 heads, 32 sectors/track, 40964 cylinders Units = cylinders of 2048 * 512 = 1048576 bytesServer 2 (/etc/multipath.conf)========================## Use user friendly names, instead of using WWIDs as names.
defaults {
user_friendly_names yes
}
## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
# device {
# vendor "IBM"
# product "S/390 DASD ECKD"
# path_grouping_policy multibus
# getuid_callout "/sbin/dasdview -j /dev/%n"
# path_checker directio
# }
#}
##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
#defaults {
# udev_dir /dev
# polling_interval 10
# selector "round-robin 0"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# prio_callout /bin/true
# path_checker readsector0
# rr_min_io 100
# rr_weight priorities
# failback immediate
# no_path_retry fail
# user_friendly_name yes
#}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid. The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line. Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
## insert the sda, sdb or whatever local disks below so tt they're not multipathed
devnode_blacklist {
# wwid 26353900f02796769
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*"
devnode "^hd[a-z]"
devnode "^cciss!c[0-9]d[0-9]*"
}
#multipaths {
# multipath {
# wwid 3600508b4000156d700012000000b0000
# alias yellow
# path_grouping_policy multibus
# path_checker readsector0
# path_selector "round-robin 0"
# failback manual
# rr_weight priorities
# no_path_retry 5
# }
# multipath {
# wwid 1DEC_____321816758474
# alias red
# }
#}
devices {
# device {
# vendor "COMPAQ "
# product "HSV110 (C)COMPAQ"
# path_grouping_policy multibus
# getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
# path_checker readsector0
# path_selector "round-robin 0"
# hardware_handler "0"
# failback 15
# rr_weight priorities
# no_path_retry queue
# }
# device {
# vendor "COMPAQ "
# product "MSA1000 "
# path_grouping_policy multibus
# }
#
device {
vendor "NETAPP"
product "LUN"
path_grouping_policy group_by_prio
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout "/opt/netapp/santools/mpath_prio_ontap /dev/%n"
features "1 queue_if_no_path"
path_checker readsector0
failback immediate
}
}
-- Linux-cluster mailing list Linux-cluster@xxxxxxxxxx https://www.redhat.com/mailman/listinfo/linux-cluster
