One last try.... Anybody have any input on why this is happening, and if there is something that I can do about it?? Thanks. Lori > -----Original Message----- > From: Ransegnola, Lori > Sent: Tuesday, March 24, 2009 5:13 PM > To: device-mapper development > Cc: Ransegnola, Lori > Subject: RE: RE: Problem with multipathd and a > blacklisted device > > Here is the 'multipath -ll' output before disk was pulled: > > /root> ls -l /dev/hpdev > total 0 > lrwxrwxrwx 1 root root 7 Mar 24 11:53 sda1 -> ../sdm1 > lrwxrwxrwx 1 root root 7 Mar 24 11:53 sdb1 -> ../sdn1 > /root> multipath -ll > multisde (35000c5000a41e633) dm-2 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:5:0 sde 8:64 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:19:0 sdq 65:0 [active][ready] > 35000c5000a41e44bdm-5 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:8:0 sdh 8:112 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:22:0 sdt 65:48 [active][ready] > multisdc (35000c5000a41f38f) dm-0 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:3:0 sdc 8:32 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:17:0 sdo 8:224 [active][ready] > 35000c5000a41e9bbdm-7 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:10:0 sdj 8:144 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:24:0 sdv 65:80 [active][ready] > 35000c50004acb2cfdm-1 HP,DF0300B8053 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:4:0 sdd 8:48 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:18:0 sdp 8:240 [active][ready] > 35000c5000a41f1b3dm-4 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:7:0 sdg 8:96 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:21:0 sds 65:32 [active][ready] > 35000c5000a41f997dm-9 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:12:0 sdl 8:176 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:26:0 sdx 65:112 [active][ready] > 35000c5000a41f37fdm-6 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:9:0 sdi 8:128 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:23:0 sdu 65:64 [active][ready] > 35000c5000a41e0efdm-8 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:11:0 sdk 8:160 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:25:0 sdw 65:96 [active][ready] > multisdf (35000c5000a41f007) dm-3 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:6:0 sdf 8:80 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:20:0 sdr 65:16 [active][ready] > /root> > > Now once the disk has been pulled and the path to the device is lost: > > /root> ls -l /dev/hpdev > total 0 > lrwxrwxrwx 1 root root 7 Mar 24 11:53 sdb1 -> ../sdn1 > /root> multipath -ll > multisde (35000c5000a41e633) dm-2 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:5:0 sde 8:64 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:19:0 sdq 65:0 [active][ready] > 35000c5000a41e44bdm-5 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:8:0 sdh 8:112 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:22:0 sdt 65:48 [active][ready] > multisdc (35000c5000a41f38f) dm-0 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:3:0 sdc 8:32 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:17:0 sdo 8:224 [active][ready] > 35000c5000a41e9bbdm-7 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:10:0 sdj 8:144 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:24:0 sdv 65:80 [active][ready] > 35000c50004acb2cfdm-1 HP,DF0300B8053 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:4:0 sdd 8:48 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:18:0 sdp 8:240 [active][ready] > 35000c5000a41f1b3dm-4 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:7:0 sdg 8:96 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:21:0 sds 65:32 [active][ready] > 35000c5000a41f997dm-9 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:12:0 sdl 8:176 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:26:0 sdx 65:112 [active][ready] > 35000c5000a41f37fdm-6 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:9:0 sdi 8:128 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:23:0 sdu 65:64 [active][ready] > 35000c5000a41e0efdm-8 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:11:0 sdk 8:160 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:25:0 sdw 65:96 [active][ready] > multisdf (35000c5000a41f007) dm-3 HP,DF300BB6C3 > [size=279G][features=0][hwhandler=0] > \_ round-robin 0 [prio=0][active] > \_ 0:0:6:0 sdf 8:80 [active][ready] > \_ round-robin 0 [prio=0][enabled] > \_ 0:0:20:0 sdr 65:16 [active][ready] > /root> > > Please let me know if there is any other information that you > require from the node. Thank you. > > Lori > > > -----Original Message----- > > From: dm-devel-bounces@xxxxxxxxxx > > [mailto:dm-devel-bounces@xxxxxxxxxx] On Behalf Of malahal@xxxxxxxxxx > > Sent: Tuesday, March 24, 2009 9:42 AM > > To: dm-devel@xxxxxxxxxx > > Subject: Re: RE: Problem with multipathd and a > > blacklisted device > > > > Ransegnola, Lori [Lori.Ransegnola@xxxxxx] wrote: > > > I sent this question last week and have not heard a thing. > > Do you have a suggestion of a better mailing list that I > > should use for this question? > > > > > > Thank you. > > > > > > Lori > > > > > > > -----Original Message----- > > > > From: Ransegnola, Lori > > > > Sent: Thursday, March 19, 2009 3:51 PM > > > > To: dm-devel@xxxxxxxxxx > > > > Cc: Ransegnola, Lori > > > > Subject: Problem with multipathd and a blacklisted device > > > > > > > > Configuration: > > > > -------------- > > > > > > > > I have a multipath configuration set up where 10 disks are > > > > multipathed and 2 disks are blacklisted and are not > multipathed. > > > > Here are the relevant parts of the multipath.conf file: > > > > > > > > defaults { > > > > udev_dir /dev > > > > polling_interval 10 > > > > selector "round-robin 0" > > > > # path_grouping_policy multibus > > > > getuid_callout "/sbin/scsi_id -g -u -s > /block/%n" > > > > prio_callout /bin/true > > > > # path_checker readsector0 > > > > path_checker tur > > > > rr_min_io 100 > > > > rr_weight priorities > > > > failback immediate > > > > no_path_retry fail > > > > user_friendly_name yes > > > > } > > > > > > > > blacklist { > > > > # wwid 26353900f02796769 > > > > # devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*" > > > > # devnode "^hd[a-z]" > > > > wwid 35000c5000a41f72b > > > > wwid 35000c5000a41f98b > > > > devnode "^cciss!c[0-9]d[0-9]*" > > > > } > > > > > > > > > > > > The two disks that are not multipathed have udev rules > > and are part > > > > of a software RAID set. The devices show up as > > > > > > > > /etc/udev/rules.d> ls -l /dev/hpdev > > > > total 0 > > > > lrwxrwxrwx 1 root root 7 Mar 18 10:50 sda1 -> ../sda1 > > lrwxrwxrwx 1 > > > > root root 7 Mar 18 03:32 sdb1 -> ../sdb1 > > > > > > > > /dev/md0 is created with sda and sdb. Here is the > bottom of the > > > > 'mdadm --detail /dev/md0' output: > > > > > > > > /root> mdadm --detail /dev/md0 > > > > /dev/md0: > > > > Version > > > > ... > > > > Failed Devices : 0 > > > > Spare Devices : 0 > > > > > > > > UUID : 94813396:a3e341fc:c5d4b8ba:0617a019 > > > > Events : 0.84 > > > > > > > > Number Major Minor RaidDevice State > > > > 0 8 1 0 active sync /dev/sda1 > > > > 1 8 17 1 active sync /dev/sdb1 > > > > /root> > > > > > > > > I am running on a Linux RHEL5 U2 system. > > > > /etc/udev/rules.d> uname -a > > > > Linux n0 2.6.18-53.el5 #1 SMP Wed Oct 10 16:34:19 EDT 2007 > > > > x86_64 x86_64 x86_64 GNU/Linux /etc/udev/rules.d> multipath -v > > > > Missing option arguement multipath-tools v0.4.7 (03/12, 2006) > > > > ---------------------------- > > > > > > > > Problem: > > > > > > > > This configuration works well until I do some failure > > testing with > > > > one of the 2 blacklisted devs in the software RAID set. > > > > I found that if I temporarily remove disk sda and put it back a > > > > minute later the disk path, /dev/hpdev/sda1, is removed, > > even though > > > > it is blacklisted. > > > > What is 'multipath -ll' output before you remove the > > blacklisted device? > > What is 'multipath -ll' output after you put the device back > > a minute later? > > > > Thanks, Malahal. > > > > -- > > dm-devel mailing list > > dm-devel@xxxxxxxxxx > > https://www.redhat.com/mailman/listinfo/dm-devel > > > -- dm-devel mailing list dm-devel@xxxxxxxxxx https://www.redhat.com/mailman/listinfo/dm-devel
