Hi Vladimir, Thanks. I found it. Is this opensm closed source? I apparently wrongly assumed that this opensm would be in the source drop of MLNX OFED. Dave On Mon, May 25, 2020, at 8:41 AM, Vladimir Koushnir wrote: > Hello, > > "virt_enabled 2" is supported by MLNX subnet manager that is available > via UFM/MLNX OFED/MLNX Infiniband switch OS (MLNX OS). > > Regards, > Vladimir > -----Original Message----- > From: linux-rdma-owner@xxxxxxxxxxxxxxx > <linux-rdma-owner@xxxxxxxxxxxxxxx> On Behalf Of David Zarzycki > Sent: Monday, May 25, 2020 3:30 PM > To: linux-rdma@xxxxxxxxxxxxxxx > Subject: opensm and virt_enabled? > > Hello, > > I'm trying to track how to enable "virt_enabled 2" in opensm. Various > Mellanox docs refer to this change in opensm behavior in order to > support their socket direct cards. That being said, when I search the > opensm source and source history, I cannot find any reference this flag > ever existing. What am I missing? > > For reference, I've connected two ConnectX-6 cards point to point. One > of the cards is "socket direct" but the aux card stays "down" despite > the link being up (see below). > > Thanks for any help, > Dave > > > CA 'ibp2s0f0' > CA type: MT4123 > Number of ports: 1 > Firmware version: 20.27.2008 > Hardware version: 0 > Node GUID: 0x0c42a10300609810 > System image GUID: 0x0c42a10300609810 > Port 1: > State: Active > Physical state: LinkUp > Rate: 100 > Base lid: 2 > LMC: 0 > SM lid: 1 > Capability mask: 0x2659e848 > Port GUID: 0x0c42a10300609810 > Link layer: InfiniBand > CA 'ibp3s0f0' > CA type: MT4123 > Number of ports: 1 > Firmware version: 20.27.2008 > Hardware version: 0 > Node GUID: 0x0c42a10300609814 > System image GUID: 0x0c42a10300609810 > Port 1: > State: Down > Physical state: LinkUp > Rate: 100 > Base lid: 65535 > LMC: 0 > SM lid: 1 > Capability mask: 0x2649e848 > Port GUID: 0x0c42a10300609814 > Link layer: InfiniBand > CA 'ibp2s0f1' > CA type: MT4123 > Number of ports: 1 > Firmware version: 20.27.2008 > Hardware version: 0 > Node GUID: 0x0c42a10300609811 > System image GUID: 0x0c42a10300609810 > Port 1: > State: Down > Physical state: Disabled > Rate: 10 > Base lid: 65535 > LMC: 0 > SM lid: 0 > Capability mask: 0x2659e848 > Port GUID: 0x0c42a10300609811 > Link layer: InfiniBand > CA 'ibp3s0f1' > CA type: MT4123 > Number of ports: 1 > Firmware version: 20.27.2008 > Hardware version: 0 > Node GUID: 0x0c42a10300609815 > System image GUID: 0x0c42a10300609810 > Port 1: > State: Down > Physical state: Disabled > Rate: 10 > Base lid: 65535 > LMC: 0 > SM lid: 0 > Capability mask: 0x2649e848 > Port GUID: 0x0c42a10300609815 > Link layer: InfiniBand >