Hi Ram & Co, (Adding Potnuri CC') On Wed, 2017-06-28 at 11:32 +0000, Amrani, Ram wrote: > > > We are hitting SQ overflow on iSER target side with high block sizes over RoCE > > > (see dmesg output below). > > > > > > We are using Q-Logic/Cavium NIC with a capability of 4 sges. > > > > That's somewhat expected if the device has low max_sge. It was decided > > that queue_full mechanism is not something that iser-target should > > handle but rather the iscsi-target core on top. > > > > You probably should not get into aborts though... Does the I/O complete? > > or does it fail? > > The IOs complete > > > > > Is this upstream? is [1] applied? > > > > I could come up with some queue-full handling in isert that will be more > > lightweight, but I'd let Nic make a judgment call before I do anything. > > > > [1]: > > commit a4467018c2a7228f4ef58051f0511bd037bff264 > > Author: Nicholas Bellinger <nab@xxxxxxxxxxxxxxx> > > Date: Sun Oct 30 17:30:08 2016 -0700 > > > > iscsi-target: Propigate queue_data_in + queue_status errors > > > > Yes, the patch is applied. > Just to confirm, the following four patches where required to get Potnuri up and running on iser-target + iw_cxgb4 with a similarly small number of hw SGEs: 7a56dc8 iser-target: avoid posting a recv buffer twice 555a65f iser-target: Fix queue-full response handling a446701 iscsi-target: Propigate queue_data_in + queue_status errors fa7e25c target: Fix unknown fabric callback queue-full errors So Did you test with Q-Logic/Cavium with RoCE using these four patches, or just with commit a4467018..? Note these have not been CC'ed to stable yet, as I was reluctant since they didn't have much mileage on them at the time.. Now however, they should be OK to consider for stable, especially if they get you unblocked as well. -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
