On Tue, Mar 10, 2009 at 3:35 PM, Konrad Rzeszutek <konrad@xxxxxxxxxxxxxxx> wrote:
> [5078349.903410] scsi 6:0:0:0: rejecting I/O to dead device... snip ..
> scsi 6:0:0:0 not exist at lsscsi:How did it disappear?
Ok. It dissapear when I upgraded my system.
As I have lvm in iscsi volume, I had to patch lvm init.d stop script (see my no-answered question athttp://www.redhat.com/archives/linux-lvm/2009-February/msg00003.html and http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=498616) (else, my reboot hangs).
But this change (add vgchange --available=n $vg || RETVAL=1 at stop function in /etc/init.d/open-iscsi ) made my upgrade hang (I had to manually kill the proccess, umount my partitions on iscsi and follow with the installation)
So in my logs:
First ISCSI start (and tells connection 5-8 are operationals):
Mar 5 15:46:50 sprdom kernel: [4608617.246584] scsi4 : iSCSI Initiator over TCP/IP
Mar 5 15:46:50 sprdom kernel: [4608617.246832] scsi5 : iSCSI Initiator over TCP/IP
Mar 5 15:46:50 sprdom kernel: [4608617.250835] scsi6 : iSCSI Initiator over TCP/IP
Mar 5 15:46:50 sprdom kernel: [4608617.250835] scsi7 : iSCSI Initiator over TCP/IP
....
Mar 5 15:46:50 sprdom kernel: [4608617.552350] sdg:<6>sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:50 sprdom kernel: [4608617.552657] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention required
Mar 5 15:46:50 sprdom kernel: [4608617.552721] end_request: I/O error, dev sdg, sector 0
Mar 5 15:46:50 sprdom kernel: [4608617.552752] __ratelimit: 28 messages suppressed
....
Mar 5 15:46:51 sprdom kernel: [4608617.808252] sd 7:0:0:0: [sdh] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:51 sprdom kernel: [4608617.808318] sd 7:0:0:0: [sdh] Device not ready: Add. Sense: Logical unit not ready, manual intervention
required
Mar 5 15:46:51 sprdom kernel: [4608617.808861] end_request: I/O error, dev sdh, sector 0
Mar 5 15:46:51 sprdom multipathd: mpath0: load table [0 1073741824 multipath 0 0 1 1 round-robin 0 1 1 8:96 1000]
Mar 5 15:46:51 sprdom multipathd: sdh: add path (uevent)
Mar 5 15:46:51 sprdom kernel: [4608617.817256] device-mapper: multipath emc: long trespass command will be send
Mar 5 15:46:51 sprdom kernel: [4608617.817256] device-mapper: multipath emc: honor reservation bit will not be set (default)
Mar 5 15:46:51 sprdom kernel: [4608617.819512] sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:51 sprdom kernel: [4608617.819587] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention
required
Mar 5 15:46:51 sprdom kernel: [4608617.819653] end_request: I/O error, dev sdg, sector 0
Mar 5 15:46:51 sprdom kernel: [4608617.819685] device-mapper: multipath: Failing path 8:96.
Mar 5 15:46:51 sprdom kernel: [4608617.819826] sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:51 sprdom kernel: [4608617.819887] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention required
Mar 5 15:46:51 sprdom kernel: [4608617.819949] end_request: I/O error, dev sdg, sector 0
Mar 5 15:46:51 sprdom kernel: [4608617.829248] device-mapper: multipath emc: long trespass command will be send
Mar 5 15:46:51 sprdom kernel: [4608617.829270] device-mapper: multipath emc: honor reservation bit will not be set (default)
Mar 5 15:46:51 sprdom kernel: [4608617.830657] device-mapper: multipath emc: emc_pg_init: sending switch-over command
Mar 5 15:46:51 sprdom multipathd: mpath0: failed in domap for addition of new path sdh
Mar 5 15:46:51 sprdom multipathd: mpath0: uev_add_path sleep
Mar 5 15:46:51 sprdom kernel: [4608617.861246] device-mapper: table: 254:6: multipath: unknown path selector type
Mar 5 15:46:51 sprdom kernel: [4608617.861246] device-mapper: ioctl: error adding target to table
Mar 5 15:46:51 sprdom iscsid: transport class version 2.0-869. iscsid version 2.0-870
Mar 5 15:46:51 sprdom iscsid: iSCSI daemon with pid=25592 started!
Mar 5 15:46:51 sprdom iscsid: connection5:0 is operational now
Mar 5 15:46:51 sprdom iscsid: connection6:0 is operational now
Mar 5 15:46:51 sprdom iscsid: connection7:0 is operational now
Mar 5 15:46:51 sprdom iscsid: connection8:0 is operational now
Mar 5 15:46:51 sprdom kernel: [4608618.331096] device-mapper: multipath emc: emc_pg_init: sending switch-over command
....
Later (the second upgrade try?) it works, but 6 and 7 are dead:
Mar 5 15:48:53 sprdom kernel: [4608750.038111] scsi8 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom kernel: [4608750.038362] scsi9 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom kernel: [4608750.047191] scsi10 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom kernel: [4608750.049000] scsi11 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom multipathd: sdg: checker msg is "emc_clariion_checker: query command indicates error"
Mar 5 15:48:53 sprdom kernel: [4608750.195239] scsi 6:0:0:0: rejecting I/O to dead device
Mar 5 15:48:53 sprdom kernel: [4608750.195239] scsi 7:0:0:0: rejecting I/O to dead device
Mar 5 15:48:53 sprdom kernel: [4608750.195239] device-mapper: multipath emc: long trespass command will be send
Mar 5 15:48:53 sprdom kernel: [4608750.195239] device-mapper: multipath emc: honor reservation bit will not be set (default)
Mar 5 15:48:53 sprdom kernel: [4608750.229003] device-mapper: table: 254:6: multipath: unknown path selector type
Mar 5 15:48:53 sprdom kernel: [4608750.229559] device-mapper: ioctl: error adding target to table
Mar 5 15:48:53 sprdom multipathd: sdh: checker msg is "emc_clariion_checker: query command indicates error"
Mar 5 15:48:53 sprdom multipathd: mpath0: failed in domap for addition of new path sdh
Mar 5 15:48:53 sprdom multipathd: mpath0: uev_add_path sleep
...
Mar 5 15:48:53 sprdom iscsid: connection9:0 is operational now
Mar 5 15:48:53 sprdom iscsid: connection10:0 is operational now
Mar 5 15:48:53 sprdom iscsid: connection11:0 is operational now
Mar 5 15:48:53 sprdom iscsid: connection12:0 is operational now
As I have lvm in iscsi volume, I had to patch lvm init.d stop script (see my no-answered question athttp://www.redhat.com/archives/linux-lvm/2009-February/msg00003.html and http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=498616) (else, my reboot hangs).
But this change (add vgchange --available=n $vg || RETVAL=1 at stop function in /etc/init.d/open-iscsi ) made my upgrade hang (I had to manually kill the proccess, umount my partitions on iscsi and follow with the installation)
So in my logs:
First ISCSI start (and tells connection 5-8 are operationals):
Mar 5 15:46:50 sprdom kernel: [4608617.246584] scsi4 : iSCSI Initiator over TCP/IP
Mar 5 15:46:50 sprdom kernel: [4608617.246832] scsi5 : iSCSI Initiator over TCP/IP
Mar 5 15:46:50 sprdom kernel: [4608617.250835] scsi6 : iSCSI Initiator over TCP/IP
Mar 5 15:46:50 sprdom kernel: [4608617.250835] scsi7 : iSCSI Initiator over TCP/IP
....
Mar 5 15:46:50 sprdom kernel: [4608617.552350] sdg:<6>sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:50 sprdom kernel: [4608617.552657] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention required
Mar 5 15:46:50 sprdom kernel: [4608617.552721] end_request: I/O error, dev sdg, sector 0
Mar 5 15:46:50 sprdom kernel: [4608617.552752] __ratelimit: 28 messages suppressed
....
Mar 5 15:46:51 sprdom kernel: [4608617.808252] sd 7:0:0:0: [sdh] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:51 sprdom kernel: [4608617.808318] sd 7:0:0:0: [sdh] Device not ready: Add. Sense: Logical unit not ready, manual intervention
required
Mar 5 15:46:51 sprdom kernel: [4608617.808861] end_request: I/O error, dev sdh, sector 0
Mar 5 15:46:51 sprdom multipathd: mpath0: load table [0 1073741824 multipath 0 0 1 1 round-robin 0 1 1 8:96 1000]
Mar 5 15:46:51 sprdom multipathd: sdh: add path (uevent)
Mar 5 15:46:51 sprdom kernel: [4608617.817256] device-mapper: multipath emc: long trespass command will be send
Mar 5 15:46:51 sprdom kernel: [4608617.817256] device-mapper: multipath emc: honor reservation bit will not be set (default)
Mar 5 15:46:51 sprdom kernel: [4608617.819512] sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:51 sprdom kernel: [4608617.819587] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention
required
Mar 5 15:46:51 sprdom kernel: [4608617.819653] end_request: I/O error, dev sdg, sector 0
Mar 5 15:46:51 sprdom kernel: [4608617.819685] device-mapper: multipath: Failing path 8:96.
Mar 5 15:46:51 sprdom kernel: [4608617.819826] sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current]
Mar 5 15:46:51 sprdom kernel: [4608617.819887] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention required
Mar 5 15:46:51 sprdom kernel: [4608617.819949] end_request: I/O error, dev sdg, sector 0
Mar 5 15:46:51 sprdom kernel: [4608617.829248] device-mapper: multipath emc: long trespass command will be send
Mar 5 15:46:51 sprdom kernel: [4608617.829270] device-mapper: multipath emc: honor reservation bit will not be set (default)
Mar 5 15:46:51 sprdom kernel: [4608617.830657] device-mapper: multipath emc: emc_pg_init: sending switch-over command
Mar 5 15:46:51 sprdom multipathd: mpath0: failed in domap for addition of new path sdh
Mar 5 15:46:51 sprdom multipathd: mpath0: uev_add_path sleep
Mar 5 15:46:51 sprdom kernel: [4608617.861246] device-mapper: table: 254:6: multipath: unknown path selector type
Mar 5 15:46:51 sprdom kernel: [4608617.861246] device-mapper: ioctl: error adding target to table
Mar 5 15:46:51 sprdom iscsid: transport class version 2.0-869. iscsid version 2.0-870
Mar 5 15:46:51 sprdom iscsid: iSCSI daemon with pid=25592 started!
Mar 5 15:46:51 sprdom iscsid: connection5:0 is operational now
Mar 5 15:46:51 sprdom iscsid: connection6:0 is operational now
Mar 5 15:46:51 sprdom iscsid: connection7:0 is operational now
Mar 5 15:46:51 sprdom iscsid: connection8:0 is operational now
Mar 5 15:46:51 sprdom kernel: [4608618.331096] device-mapper: multipath emc: emc_pg_init: sending switch-over command
....
Later (the second upgrade try?) it works, but 6 and 7 are dead:
Mar 5 15:48:53 sprdom kernel: [4608750.038111] scsi8 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom kernel: [4608750.038362] scsi9 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom kernel: [4608750.047191] scsi10 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom kernel: [4608750.049000] scsi11 : iSCSI Initiator over TCP/IP
Mar 5 15:48:53 sprdom multipathd: sdg: checker msg is "emc_clariion_checker: query command indicates error"
Mar 5 15:48:53 sprdom kernel: [4608750.195239] scsi 6:0:0:0: rejecting I/O to dead device
Mar 5 15:48:53 sprdom kernel: [4608750.195239] scsi 7:0:0:0: rejecting I/O to dead device
Mar 5 15:48:53 sprdom kernel: [4608750.195239] device-mapper: multipath emc: long trespass command will be send
Mar 5 15:48:53 sprdom kernel: [4608750.195239] device-mapper: multipath emc: honor reservation bit will not be set (default)
Mar 5 15:48:53 sprdom kernel: [4608750.229003] device-mapper: table: 254:6: multipath: unknown path selector type
Mar 5 15:48:53 sprdom kernel: [4608750.229559] device-mapper: ioctl: error adding target to table
Mar 5 15:48:53 sprdom multipathd: sdh: checker msg is "emc_clariion_checker: query command indicates error"
Mar 5 15:48:53 sprdom multipathd: mpath0: failed in domap for addition of new path sdh
Mar 5 15:48:53 sprdom multipathd: mpath0: uev_add_path sleep
...
Mar 5 15:48:53 sprdom iscsid: connection9:0 is operational now
Mar 5 15:48:53 sprdom iscsid: connection10:0 is operational now
Mar 5 15:48:53 sprdom iscsid: connection11:0 is operational now
Mar 5 15:48:53 sprdom iscsid: connection12:0 is operational now
> How could can I stop scsi system / multipath from this messages ?Try: multipathd -k'reconfigure'
I tried,
# multipathd -k'reconfigure'
OK
But syslog is growing like before
Should I ask to iscsi list then ?
Thank you very much
OK
But syslog is growing like before
Should I ask to iscsi list then ?
Thank you very much
-- dm-devel mailing list dm-devel@xxxxxxxxxx https://www.redhat.com/mailman/listinfo/dm-devel
