You just doubled the number of resources (mrs+page_vectors) allocated
for a performance optimization (25% in large writes). I'm asking myself
if that is that acceptable? We tend to allocate a lot of those (not to
mention the target side).
We're using same amount of mkey's as before (sig + data + meta mkeys vs.
sig + internal_klm + internal_mtt mkey).
But each mkey has twice of mtt/klm space..
And we save their invalidations (of the internal mkeys).
Those are not resources.
I'm not sure what is the correct answer here, I'm just wandering if this
is what we want to do. We have seen people bound by the max_mrs
limitation before, and this is making it worse (at least for the pi
case).
it's not (see above). The limitation of mkeys is mostly with older HCA's
that are not signature capable.
Its also sw mr page_vec/sgl... But that is less of a concern as well I
guess.