On Wed, 25 Nov 2020, Honggang LI wrote: > > How do I figure out why ibacm is not talking to the subnet manager? > > No, you can't talking to subnet manager, if you resolve IPoIB IP address > or hostname to PathRecord. The query MAD packets will be send to one > multicast group all ibacm service attached. Huh? When does it talk to a subnet manager (or the SA)? If its get an IP address of an IB node that does not have ibacm then it fails with a timeout ..... ? And leaves hanging kernel threads around by design? So it only populates the cache from its local node information? > To resolve IPoIB address to PathRecord, you must: > 1) The IPoIB interface must UP and RUNNING on the client and target > side. > 2) The ibacm service must RUNNING on the client and target. That is working if you want to resolve only the IP addresses of the IB interfaces on the client and target. None else. Here is the description of ibacms function from the sources: "Conceptually, the ibacm service implements an ARP like protocol and either uses IB multicast records to construct path record data or queries the SA directly, depending on the selected route protocol. By default, the ibacm services uses and caches SA path record queries." SA queries dont work. So its broken and cannot talk to the SM.
