On Fri, Mar 19, 2021 at 08:56:26AM -0400, kaike.wan@xxxxxxxxx wrote: > - Basic mode of operations (PSM3 is used as an example for user > applications): > - A middleware (like MPI) has out-of-band communication channels > between any two nodes, which are used to establish high performance > communications for providers such as PSM3. Huh? Doesn't PSM3 already use it's own special non-verbs char devices that already have memory caches and other stuff? Now you want to throw that all away and do yet another char dev just for HFI? Why? I also don't know why you picked the name rv, this looks like it has little to do with the usual MPI rendezvous protocol. This is all about bulk transfers. It is actually a lot like RDS. Maybe you should be using RDS? Jason
