Hello While I have for the longest time used 4.5 as a base for my F/C jammer that I use every day here in our lab I recently added more jammer code so I decided to test this all on latest upstream. Booting the target server on my 4.5 kernel with jammer code is flawless and serves LUNS with no issues and handles the jamming also fine. However just building a 4.19.0_rc7+-1 (I left the jammer stuff out) its pretty broken. So: Has anybody used this recently on the later kernels, if so when was it last stable before I go starting to figure this out. Some supporting Data ----------------------- The server The have seen the nacks below before and its seemed to work (been a while though) [ 189.631036] qla2xxx [0000:07:00.1]-00af:7: Performing ISP error recovery - ha=00000000d1cfbc6b. [ 190.667982] qla2xxx [0000:07:00.1]-500a:7: LOOP UP detected (4 Gbps). [ 191.787048] qla2xxx [0000:07:00.0]-00af:1: Performing ISP error recovery - ha=00000000d30e7010. [ 192.824963] qla2xxx [0000:07:00.0]-500a:1: LOOP UP detected (4 Gbps). [ 389.510040] qla2xxx [0000:07:00.1]-d034:7: qla24xx_do_nack_work create sess success 000000005c90391f [ 389.530212] qla2xxx [0000:07:00.0]-d034:1: qla24xx_do_nack_work create sess success 0000000083b2759c [ 389.987400] qla2xxx [0000:07:00.1]-d034:7: qla24xx_do_nack_work create sess success 000000008498cfdd [ 390.068025] qla2xxx [0000:07:00.0]-d034:1: qla24xx_do_nack_work create sess success 000000009af322af Client however is badly broken (Its running RHEL 7.5 right now) 24.884271] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:0:0 -- 1 2002. [ 24.899968] qla2xxx [0000:03:00.0]-801c:12: Abort command issued nexus=12:0:0 -- 1 2002. [ 24.915903] qla2xxx [0000:03:00.0]-801c:12: Abort command issued nexus=12:0:10 -- 1 2002. [ 25.004912] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:0:10 -- 1 2002. [ **] (7 of 10) A start job is running fo...on device 8:112 (17s / no limit)[ 35.955940] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:0:8 -- 1 2002. [ 35.994432] sd 14:0:0:0: Unexpected response from lun 8 while scanning, scan aborted [ 36.031970] scsi 14:0:1:0: Direct-Access LIO- ORG sanboot69 4.0 PQ: 0 ANSI: 5 [ 36.095961] scsi 14:0:1:0: alua: supports implicit and explicit TPGS [ 36.127023] scsi 14:0:1:0: alua: device naa.60014055bfcdb7e1a7349c38126475e2 port group 0 rel port 2 [ 36.170336] scsi 14:0:1:0: alua: Attached [ 36.189777] sd 14:0:1:0: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical [ 36.189905] sd 14:0:1:0: Attached scsi generic sg15 type 0 [ 36.283640] sd 14:0:1:0: alua: port group 00 state A non-preferred supports TOlUSNA [ 36.283641] sd 14:0:1:0: [sdo] 209715200 512-byte logical blocks: (107 GB/100 GiB) [ 36.283644] sd 14:0:1:0: [sdo] 4096-byte physical blocks [ 36.283664] scsi 14:0:1:10: Direct-Access LIO-ORG block- 10 4.0 PQ: 0 ANSI: 5 [ 36.284305] sd 14:0:1:0: [sdo] Write Protect is off [ 36.284454] sd 14:0:1:0: [sdo] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 36.331321] sd 14:0:1:0: [sdo] Attached SCSI disk [ *] (8 of 10) A start job is running fo...k in the kernel (19s / no limit)[ 36.524843] scsi 14:0:1:10: alua: supports implicit and explicit TPGS [ 36.555474] scsi 14:0:1:10: alua: device naa.60014052fedf4c41aeb439494ee641fe port group 0 rel port 2 [ 36.599498] scsi 14:0:1:10: alua: Attached [ 36.619278] sd 14:0:1:10: alua: port group 00 state A non-preferred supports TOlUSNA [ 36.619286] sd 14:0:1:10: Attached scsi generic sg16 type 0 [ 36.684444] sd 14:0:1:10: [sdp] 41943040 512-byte logical blocks: (21.4 GB/20.0 GiB) [ 36.684447] sd 14:0:1:10: [sdp] 4096-byte physical blocks [ 36.684448] scsi 14:0:1:9: Direct-Access LIO-ORG block- 9 4.0 PQ: 0 ANSI: 5 [ 36.786318] sd 14:0:1:10: [sdp] Write Protect is off [ 36.810070] sd 14:0:1:10: [sdp] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ **] (8 of 10) A start job is running fo...k in the kernel (20s / no limit)[ 36.868799] scsi 14:0:1:9: alua: supports implicit and explicit TPGS [ 36.899505] scsi 14:0:1:9: alua: device naa.6001405b39403fdc0004075a9c1bfc7b port group 0 rel port 2 [ 36.901649] sd 14:0:1:10: [sdp] Attached SCSI disk [ 36.967102] scsi 14:0:1:9: alua: Attached [ 36.986518] sd 14:0:1:9: Attached scsi generic sg17 type 0 [ 36.986579] sd 14:0:1:9: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical [ 37.078486] sd 14:0:1:9: [sdq] 41943040 512-byte logical blocks: (21.4 GB/20.0 GiB) [ 37.115268] sd 14:0:1:9: [sdq] 4096-byte physical blocks [ 37.141405] scsi 14:0:1:8: Direct-Access LIO-ORG block- 8 4.0 PQ: 0 ANSI: 5 [ *] (2 of 10) A start job is running fo... on device 8:48 (26s / no limit)[ 44.979937] qla2xxx [0000:03:00.0]-801c:12: Abort command issued nexus=12:0:8 -- 1 2002. [ 44.979940] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:0:9 -- 1 2002. [ 45.059246] scsi 12:0:0:8: alua: supports implicit and explicit TPGS [ 45.059250] qla2xxx [0000:03:00.0]-801c:12: Abort command issued nexus=12:0:9 -- 1 2002. [ 45.127807] scsi 12:0:0:8: alua: No target port descriptors found [ 45.156584] scsi 12:0:0:8: alua: not attached [ **] (3 [ 45.177058] sd 12:0:0:8: Attached scsi generic sg18 type 0 [ *** ] (4 of 10) A start job is running fo...a\x2dvm1.device (31s / 1min 30s)[ 46.899890] qla2xxx [0000:03:00.0]-801c:12: Abort command issued nexus=12:0:0 -- 1 2002. [** ] (4 of 10) A start job is running fo...a\x2dvm1.device (32s / 1min 30s)[ 47.923948] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:0:0 -- 1 2002. [** ] (10 of 10) A start job is running f...on device 259:3 (39s / no limit)[ 55.859890] qla2xxx [0000:03:00.0]-801c:12: Abort command issued nexus=12:0:0 -- 1 2002. [ 55.898941] qla2xxx [0000:03:00.0]-801c:12: Abort command issued nexus=12:0:10 -- 1 2002. [ 55.987889] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:0:10 -- 1 2002. [ *** ] (8 of 10) A start job is running fo...k in the kernel (51s / no limit)[ 67.892155] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:1:9 -- 1 2002. [ 67.930710] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:1:8 -- 1 2002. [ 67.969860] scsi 14:0:1:8: alua: supports implicit and explicit TPGS [ 68.000027] scsi 14:0:1:8: alua: No target port descriptors found [ 68.028510] scsi 14:0:1:8: alua: not attached [ 68.050110] sd 14:0:1:8: Attached scsi generic sg19 type 0 [ *** ] (2 of 10) A start job is running fo...evice 8:48 (1min 11s / no limit)[ 88.947929] qla2xxx [0000:03:00.1]-801c:14: Abort command issued nexus=14:1:7 -- 1 2002. ... ... [ 88.987781] sd 14:0:1:0: Unexpected response from lun 7 while scanning, scan aborted .. .. [ 110.377800] rport-14:0-1: blocked FC remote port time out: removing target and saving binding [ 110.419106] rport-12:0-0: blocked FC remote port time out: removing target and saving binding [ 110.459722] sd 14:0:0:0: rejecting I/O to offline device [ 110.485985] sd 14:0:0:0: rejecting I/O to offline device [ 110.511721] sd 14:0:0:0: [sdi] killing request [ 110.533121] sd 14:0:0:0: rejecting I/O to offline device [ 110.533153] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.533156] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 00 00 00 00 00 00 08 00 [ 110.533158] blk_update_request: I/O error, dev sdi, sector 0 [ 110.660890] sd 14:0:0:0: [sdi] killing request [ 110.682516] sd 14:0:0:0: rejecting I/O to offline device [ 110.682544] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.682546] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 00 00 00 00 00 00 08 00 [ 110.682547] blk_update_request: I/O error, dev sdi, sector 0 [ 110.809893] sd 14:0:0:0: [sdi] killing request [ 110.809895] sd 14:0:0:0: rejecting I/O to offline device [ 110.809896] sd 14:0:0:0: [sdi] killing request [ 110.809901] sd 14:0:0:0: rejecting I/O to offline device [ 110.809902] sd 14:0:0:0: [sdi] killing request [ 110.809904] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.809905] sd 14:0:0:0: rejecting I/O to offline device [ 110.809906] sd 14:0:0:0: [sdi] killing request [ 110.809908] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 00 00 00 00 00 00 08 00 [ 110.809921] blk_update_request: I/O error, dev sdi, sector 0 [ 110.809922] sd 14:0:0:0: rejecting I/O to offline device [ 110.809923] sd 14:0:0:0: [sdi] killing request [ 110.809924] sd 14:0:0:0: rejecting I/O to offline device [ 110.809925] sd 14:0:0:0: [sdi] killing request [ 110.809950] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.809952] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 00 00 00 00 00 00 08 00 [ 110.809953] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.809954] blk_update_request: I/O error, dev sdi, sector 0 [ 110.809955] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 00 00 00 00 00 00 08 00 [ 110.809957] blk_update_request: I/O error, dev sdi, sector 0 [ 110.809961] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.809964] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 00 00 00 00 00 00 08 00 [ 110.809965] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.809978] blk_update_request: I/O error, dev sdi, sector 0 [ 110.809995] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 0c 7f ff 80 00 00 08 00 [ 110.809997] blk_update_request: I/O error, dev sdi, sector 209715072 [ 110.810003] sd 14:0:0:0: [sdi] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.810005] sd 14:0:0:0: [sdi] CDB: Read(10) 28 00 00 00 00 00 00 00 08 00 [ 110.810005] blk_update_request: I/O error, dev sdi, sector 0 [ 110.810029] sd 14:0:0:10: rejecting I/O to offline device [ 110.810031] sd 14:0:0:10: [sdl] killing request [ 110.810049] sd 14:0:0:9: rejecting I/O to offline device [ 110.810050] sd 14:0:0:9: killing request [ 110.810051] sd 14:0:0:9: rejecting I/O to offline device [ 110.810052] sd 14:0:0:9: killing request [ 110.810086] sd 14:0:0:0: rejecting I/O to offline device [ 110.810095] sd 14:0:0:10: [sdl] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.810096] sd 14:0:0:10: [sdl] CDB: Read(10) 28 00 02 7f ff 80 00 00 08 00 [ 110.810097] blk_update_request: I/O error, dev sdl, sector 41942912 [ 110.810152] sd 14:0:0:9: alua: rtpg failed, result 65536 [ 110.810171] sd 14:0:0:10: rejecting I/O to offline device [ 110.810177] sd 14:0:0:9: rejecting I/O to offline device [ 110.810182] sd 14:0:0:9: rejecting I/O to offline device [ 110.810199] sd 14:0:0:9: rejecting I/O to offline device [ 110.810202] sd 14:0:0:9: alua: rtpg failed, result 65536 [ 110.810205] sd 14:0:0:9: [sdn] Read Capacity(16) failed: Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.810207] sd 14:0:0:9: [sdn] Sense not available. [ 110.810220] sd 14:0:0:9: rejecting I/O to offline device [ 110.810223] sd 14:0:0:9: rejecting I/O to offline device [ 110.810226] sd 14:0:0:9: rejecting I/O to offline device [ 110.810230] sd 14:0:0:9: [sdn] Read Capacity(10) failed: Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.810231] sd 14:0:0:9: [sdn] Sense not available. [ 110.810234] sd 14:0:0:9: rejecting I/O to offline device [ 110.810238] sd 14:0:0:9: rejecting I/O to offline device [ 110.810241] sd 14:0:0:9: rejecting I/O to offline device [ 110.810245] sd 14:0:0:9: [sdn] Write Protect is off [ 110.810251] sd 14:0:0:9: rejecting I/O to offline device [ 110.810254] sd 14:0:0:9: [sdn] Asking for cache data failed [ 110.810256] sd 14:0:0:9: [sdn] Assuming drive cache: write through [ 110.810259] sd 14:0:0:9: rejecting I/O to offline device [ 110.810262] sd 14:0:0:9: rejecting I/O to offline device [ 110.810265] sd 14:0:0:9: rejecting I/O to offline device [ 110.810649] sd 14:0:0:0: alua: Detached [ 110.811002] sd 12:0:0:0: rejecting I/O to offline device [ 110.811004] sd 12:0:0:0: [sdj] killing request [ 110.811006] sd 12:0:0:0: rejecting I/O to offline device [ 110.811196] sd 12:0:0:0: [sdj] killing request [ 110.811200] sd 12:0:0:0: rejecting I/O to offline device [ 110.811205] sd 12:0:0:0: rejecting I/O to offline device [ 110.811208] sd 12:0:0:0: rejecting I/O to offline device [ 110.811211] sd 12:0:0:0: rejecting I/O to offline device [ 110.811215] sd 12:0:0:0: rejecting I/O to offline device [ 110.811218] sd 12:0:0:0: rejecting I/O to offline device [ 110.811221] sd 12:0:0:0: rejecting I/O to offline device [ 110.811224] sd 12:0:0:0: rejecting I/O to offline device [ 110.811229] sd 12:0:0:10: rejecting I/O to offline device [ 110.811231] sd 12:0:0:10: [sdk] killing request [ 110.811234] sd 12:0:0:9: rejecting I/O to offline device [ 110.811235] sd 12:0:0:9: killing request [ 110.811239] sd 12:0:0:8: rejecting I/O to offline device [ 110.811240] sd 12:0:0:8: killing request [ 110.811242] scsi 12:0:0:7: rejecting I/O to offline device [ 110.811244] scsi 12:0:0:7: killing request [ 110.811252] sd 12:0:0:0: [sdj] FAILED Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.811254] sd 12:0:0:0: [sdj] CDB: Read(10) 28 00 0c 7f ff 80 00 00 08 00 [ 110.811255] blk_update_request: I/O error, dev sdj, sector 209715072 [ 110.811266] sd 12:0:0:0: rejecting I/O to offline device [ 110.811275] sd 12:0:0:9: rejecting I/O to offline device [ 110.811279] sd 12:0:0:9: rejecting I/O to offline device [ 110.811291] sd 12:0:0:8: rejecting I/O to offline device [ 110.811294] sd 12:0:0:9: [sdm] Read Capacity(16) failed: Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.811295] sd 12:0:0:8: rejecting I/O to offline device [ 110.811297] sd 12:0:0:10: rejecting I/O to offline device [ 110.811299] sd 12:0:0:9: [sdm] Sense not available. [ 110.811301] sd 12:0:0:8: rejecting I/O to offline device [ 110.811302] sd 12:0:0:9: rejecting I/O to offline device [ 110.811305] sd 12:0:0:8: [sdr] Read Capacity(16) failed: Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.811306] sd 12:0:0:9: rejecting I/O to offline device [ 110.811307] sd 12:0:0:8: [sdr] Sense not available. [ 110.811309] sd 12:0:0:9: rejecting I/O to offline device [ 110.811310] sd 12:0:0:8: rejecting I/O to offline device [ 110.811312] sd 14:0:0:9: [sdn] Attached SCSI disk [ 110.811313] sd 12:0:0:9: [sdm] Read Capacity(10) failed: Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.811314] sd 12:0:0:8: rejecting I/O to offline device [ 110.811315] sd 12:0:0:9: [sdm] Sense not available. [ 110.811316] sd 12:0:0:0: Unexpected response from lun 7 while scanning, scan aborted [ 110.811317] sd 12:0:0:8: rejecting I/O to offline device [ 110.811317] sd 12:0:0:9: rejecting I/O to offline device [ 110.811320] sd 12:0:0:8: [sdr] Read Capacity(10) failed: Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK [ 110.811321] sd 12:0:0:9: rejecting I/O to offline device [ 110.811322] sd 12:0:0:8: [sdr] Sense not available. [ 110.811325] sd 12:0:0:9: rejecting I/O to offline device [ 110.811326] sd 12:0:0:8: rejecting I/O to offline device [ 110.811328] sd 12:0:0:9: [sdm] Write Protect is off [ 110.811329] sd 12:0:0:8: rejecting I/O to offline device [ 110.811332] sd 12:0:0:8: rejecting I/O to offline device [ 110.811333] sd 12:0:0:9: rejecting I/O to offline device [ 110.811335] sd 12:0:0:8: [sdr] Write Protect is off [ 110.811336] sd 12:0:0:9: [sdm] Asking for cache data failed [ 110.811338] sd 12:0:0:9: [sdm] Assuming drive cache: write through [ 110.811340] sd 12:0:0:8: rejecting I/O to offline device [ 110.811341] sd 12:0:0:9: rejecting I/O to offline device [ 110.811342] sd 12:0:0:8: [sdr] Asking for cache data failed [ 110.811344] sd 12:0:0:9: rejecting I/O to offline device [ 110.811345] sd 12:0:0:8: [sdr] Assuming drive cache: write through [ 110.811347] sd 12:0:0:9: rejecting I/O to offline device [ 110.811348] sd 12:0:0:8: rejecting I/O to offline device [ 110.811352] sd 12:0:0:8: rejecting I/O to offline device [ 110.811354] sd 12:0:0:8: rejecting I/O to offline device