Chuck Lever wrote on 07/14/2018 07:37 AM:
On Jul 13, 2018, at 6:32 PM, admin@xxxxxxxxxxxxxxxxxx wrote:
Chuck Lever wrote on 07/13/2018 07:36 AM:
You should be able to mount using "proto=tcp" with your mlx4 cards.
That avoids the use of NFS/RDMA but would enable the use of the
higher bandwidth network fabric.
Thanks I could definitely try that. IPoIB has it's own set of issues though but can cross that bridge when I get to it....
Stick with connected mode and keep rsize and wsize smaller
than the IPoIB MTU, which can be set as high as 65KB.
We are running in this setup, so far so good... however the rsize/wsize
were much greater than the IPoIB MTU, and it is probably causing these
"page allocation failures" which fortunately have not been fatal; our
computation is still running. In the ifcfg file for the IPoIB
interface, the MTU is set to 65520, which was the recommended maximum
from the Red Hat manual. So should rsize/wsize be set to 65519? or is
it better to pick another value that is a multiple 1024 or something?
Thanks
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
