<div class="gmail_quote">On Tue, Mar 10, 2009 at 3:35 PM, Konrad Rzeszutek <<a href="mailto:konrad@virtualiron.com">konrad@virtualiron.com</a>> wrote: <blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> <div class="im">> [5078349.903410] scsi 6:0:0:0: rejecting I/O to dead device </div>... snip .. <div class="im">> scsi 6:0:0:0 not exist at lsscsi: </div>How did it disappear?</blockquote><div>Ok. It dissapear when I upgraded my system. As I have lvm in iscsi volume, I had to patch lvm init.d stop script (see my no-answered question athttp://<a href="http://www.redhat.com/archives/linux-lvm/2009-February/msg00003.html">www.redhat.com/archives/linux-lvm/2009-February/msg00003.html</a> and <a href="http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=498616">http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=498616</a>) (else, my reboot hangs). But this change (add vgchange --available=n $vg || RETVAL=1 at stop function in /etc/init.d/open-iscsi ) made my upgrade hang (I had to manually kill the proccess, umount my partitions on iscsi and follow with the installation) So in my logs: First ISCSI start (and tells connection 5-8 are operationals): Mar 5 15:46:50 sprdom kernel: [4608617.246584] scsi4 : iSCSI Initiator over TCP/IP Mar 5 15:46:50 sprdom kernel: [4608617.246832] scsi5 : iSCSI Initiator over TCP/IP Mar 5 15:46:50 sprdom kernel: [4608617.250835] scsi6 : iSCSI Initiator over TCP/IP Mar 5 15:46:50 sprdom kernel: [4608617.250835] scsi7 : iSCSI Initiator over TCP/IP .... Mar 5 15:46:50 sprdom kernel: [4608617.552350] sdg:<6>sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current] Mar 5 15:46:50 sprdom kernel: [4608617.552657] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention required Mar 5 15:46:50 sprdom kernel: [4608617.552721] end_request: I/O error, dev sdg, sector 0 Mar 5 15:46:50 sprdom kernel: [4608617.552752] __ratelimit: 28 messages suppressed .... Mar 5 15:46:51 sprdom kernel: [4608617.808252] sd 7:0:0:0: [sdh] Device not ready: Sense Key : Not Ready [current] Mar 5 15:46:51 sprdom kernel: [4608617.808318] sd 7:0:0:0: [sdh] Device not ready: Add. Sense: Logical unit not ready, manual intervention required Mar 5 15:46:51 sprdom kernel: [4608617.808861] end_request: I/O error, dev sdh, sector 0 Mar 5 15:46:51 sprdom multipathd: mpath0: load table [0 1073741824 multipath 0 0 1 1 round-robin 0 1 1 8:96 1000] Mar 5 15:46:51 sprdom multipathd: sdh: add path (uevent) Mar 5 15:46:51 sprdom kernel: [4608617.817256] device-mapper: multipath emc: long trespass command will be send Mar 5 15:46:51 sprdom kernel: [4608617.817256] device-mapper: multipath emc: honor reservation bit will not be set (default) Mar 5 15:46:51 sprdom kernel: [4608617.819512] sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current] Mar 5 15:46:51 sprdom kernel: [4608617.819587] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention required Mar 5 15:46:51 sprdom kernel: [4608617.819653] end_request: I/O error, dev sdg, sector 0 Mar 5 15:46:51 sprdom kernel: [4608617.819685] device-mapper: multipath: Failing path 8:96. Mar 5 15:46:51 sprdom kernel: [4608617.819826] sd 6:0:0:0: [sdg] Device not ready: Sense Key : Not Ready [current] Mar 5 15:46:51 sprdom kernel: [4608617.819887] sd 6:0:0:0: [sdg] Device not ready: Add. Sense: Logical unit not ready, manual intervention required Mar 5 15:46:51 sprdom kernel: [4608617.819949] end_request: I/O error, dev sdg, sector 0 Mar 5 15:46:51 sprdom kernel: [4608617.829248] device-mapper: multipath emc: long trespass command will be send Mar 5 15:46:51 sprdom kernel: [4608617.829270] device-mapper: multipath emc: honor reservation bit will not be set (default) Mar 5 15:46:51 sprdom kernel: [4608617.830657] device-mapper: multipath emc: emc_pg_init: sending switch-over command Mar 5 15:46:51 sprdom multipathd: mpath0: failed in domap for addition of new path sdh Mar 5 15:46:51 sprdom multipathd: mpath0: uev_add_path sleep Mar 5 15:46:51 sprdom kernel: [4608617.861246] device-mapper: table: 254:6: multipath: unknown path selector type Mar 5 15:46:51 sprdom kernel: [4608617.861246] device-mapper: ioctl: error adding target to table Mar 5 15:46:51 sprdom iscsid: transport class version 2.0-869. iscsid version 2.0-870 Mar 5 15:46:51 sprdom iscsid: iSCSI daemon with pid=25592 started! Mar 5 15:46:51 sprdom iscsid: connection5:0 is operational now Mar 5 15:46:51 sprdom iscsid: connection6:0 is operational now Mar 5 15:46:51 sprdom iscsid: connection7:0 is operational now Mar 5 15:46:51 sprdom iscsid: connection8:0 is operational now Mar 5 15:46:51 sprdom kernel: [4608618.331096] device-mapper: multipath emc: emc_pg_init: sending switch-over command .... Later (the second upgrade try?) it works, but 6 and 7 are dead: Mar 5 15:48:53 sprdom kernel: [4608750.038111] scsi8 : iSCSI Initiator over TCP/IP Mar 5 15:48:53 sprdom kernel: [4608750.038362] scsi9 : iSCSI Initiator over TCP/IP Mar 5 15:48:53 sprdom kernel: [4608750.047191] scsi10 : iSCSI Initiator over TCP/IP Mar 5 15:48:53 sprdom kernel: [4608750.049000] scsi11 : iSCSI Initiator over TCP/IP Mar 5 15:48:53 sprdom multipathd: sdg: checker msg is "emc_clariion_checker: query command indicates error" Mar 5 15:48:53 sprdom kernel: [4608750.195239] scsi 6:0:0:0: rejecting I/O to dead device Mar 5 15:48:53 sprdom kernel: [4608750.195239] scsi 7:0:0:0: rejecting I/O to dead device Mar 5 15:48:53 sprdom kernel: [4608750.195239] device-mapper: multipath emc: long trespass command will be send Mar 5 15:48:53 sprdom kernel: [4608750.195239] device-mapper: multipath emc: honor reservation bit will not be set (default) Mar 5 15:48:53 sprdom kernel: [4608750.229003] device-mapper: table: 254:6: multipath: unknown path selector type Mar 5 15:48:53 sprdom kernel: [4608750.229559] device-mapper: ioctl: error adding target to table Mar 5 15:48:53 sprdom multipathd: sdh: checker msg is "emc_clariion_checker: query command indicates error" Mar 5 15:48:53 sprdom multipathd: mpath0: failed in domap for addition of new path sdh Mar 5 15:48:53 sprdom multipathd: mpath0: uev_add_path sleep ... Mar 5 15:48:53 sprdom iscsid: connection9:0 is operational now Mar 5 15:48:53 sprdom iscsid: connection10:0 is operational now Mar 5 15:48:53 sprdom iscsid: connection11:0 is operational now Mar 5 15:48:53 sprdom iscsid: connection12:0 is operational now </div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> <div class="im">> How could can I stop scsi system / multipath from this messages ? </div>Try: multipathd -k'reconfigure'</blockquote><div>I tried, </div><div># multipathd -k'reconfigure' OK But syslog is growing like before Should I ask to iscsi list then ? Thank you very much </div></div>