On Tue, May 2, 2017 at 1:14 AM, Nicholas A. Bellinger <nab@xxxxxxxxxxxxxxx> wrote: >> but when i start up multiple initiators as few as 50, i start to get >> errors in syslog >> >> Exiting Time2Retain handler because session_reinstatement=1 >> tcp_sendpage() failure: .... >> >> the tcp_sendpage() error has various numbers after it, the top two >> highest count of numbers are "-512" and "3720" >> > > Btw, this means that TCP connections are being reset. > > Without more information it's hard to know which side (eg: initiator or > target) is forcing the TCP reset. > > Can we see some logs for both target + initiator side when this > occurs..? > Because the machines are in an enclave, copy-paste logs are going to be hard to come by. Is there something specific in the logs i should look for? > One thing that comes to mind is the per target endpoint (eg: TPG > attribute in targetcli) is 'default_cmdsn_depth', which by default is > set to 64. This controls how many I/Os can be in flight for a single > iscsi session. > > I"m not sure what the default is for tgtd in rhel6, but with enough > initiators connected you might want to consider setting this to > something like 16, 8, or lower. I'm pretty sure i tried tweaking that parameter (as it was suggested elsewhere on the internet), but it didn't make a difference. But i'll recheck my notes and re-run the tests to be sure. -- To unsubscribe from this list: send the line "unsubscribe target-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html