Hello, "virt_enabled 2" is supported by MLNX subnet manager that is available via UFM/MLNX OFED/MLNX Infiniband switch OS (MLNX OS). Regards, Vladimir -----Original Message----- From: linux-rdma-owner@xxxxxxxxxxxxxxx <linux-rdma-owner@xxxxxxxxxxxxxxx> On Behalf Of David Zarzycki Sent: Monday, May 25, 2020 3:30 PM To: linux-rdma@xxxxxxxxxxxxxxx Subject: opensm and virt_enabled? Hello, I'm trying to track how to enable "virt_enabled 2" in opensm. Various Mellanox docs refer to this change in opensm behavior in order to support their socket direct cards. That being said, when I search the opensm source and source history, I cannot find any reference this flag ever existing. What am I missing? For reference, I've connected two ConnectX-6 cards point to point. One of the cards is "socket direct" but the aux card stays "down" despite the link being up (see below). Thanks for any help, Dave CA 'ibp2s0f0' CA type: MT4123 Number of ports: 1 Firmware version: 20.27.2008 Hardware version: 0 Node GUID: 0x0c42a10300609810 System image GUID: 0x0c42a10300609810 Port 1: State: Active Physical state: LinkUp Rate: 100 Base lid: 2 LMC: 0 SM lid: 1 Capability mask: 0x2659e848 Port GUID: 0x0c42a10300609810 Link layer: InfiniBand CA 'ibp3s0f0' CA type: MT4123 Number of ports: 1 Firmware version: 20.27.2008 Hardware version: 0 Node GUID: 0x0c42a10300609814 System image GUID: 0x0c42a10300609810 Port 1: State: Down Physical state: LinkUp Rate: 100 Base lid: 65535 LMC: 0 SM lid: 1 Capability mask: 0x2649e848 Port GUID: 0x0c42a10300609814 Link layer: InfiniBand CA 'ibp2s0f1' CA type: MT4123 Number of ports: 1 Firmware version: 20.27.2008 Hardware version: 0 Node GUID: 0x0c42a10300609811 System image GUID: 0x0c42a10300609810 Port 1: State: Down Physical state: Disabled Rate: 10 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0x2659e848 Port GUID: 0x0c42a10300609811 Link layer: InfiniBand CA 'ibp3s0f1' CA type: MT4123 Number of ports: 1 Firmware version: 20.27.2008 Hardware version: 0 Node GUID: 0x0c42a10300609815 System image GUID: 0x0c42a10300609810 Port 1: State: Down Physical state: Disabled Rate: 10 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0x2649e848 Port GUID: 0x0c42a10300609815 Link layer: InfiniBand