On Tue, Jan 10, 2017 at 03:57:52PM -0800, Tadeusz Struk wrote: > Some hardware have multiple HFIs within the same ASIC. In some devices the > numbers labeled on the faceplate of the device don't match the PCI bus > order, and the result is that the devices (ports) are probed in the opposite > order of their port numbers. The result is IB device unit numbers are in > reverse order from the faceplate numbering. This leads to confusion, and > errors. Can't you recognize such device at the initialization phase? This is definitely specific HW implementation bug/issue/limitation. > We can fix this by enforcing the correct port order at module load time. > To reorder the ports to match the numbering labels on the back of the > device we need to delay registering devices with the ib_core until we > receive a probe for the affected devices, reorder them and start > initialization in the correct order later. We use a timer with 1 second > timeout. On hfi1 probes devices are ordered and stored in a list. > Each hfi1 probe updates the timer. When the timer timeouts all devices are > initialized and registered with ib_core in the right order. > When there will more than one second time gap between hfi1 probes, > the timer will be update in each call so there is no danger that a device > will be "missed". > > A new module param called port_reorder is introduced to cover users, who > already prewired their clusters in the 'invalid' order. The default > behavior does not change and results in devices ordered in the PCI bus > order. Port_reorder=1 is used to apply special reordering to these devices. I always had an impression that module parameters are rarely beneficial in upstream kernel for driver modules and adding them for new driver code should be explicitly prohibited in CodingStyle guide. You are adding new module parameter which will be with us forever to fix special HW bug/implementation in some legacy installations. It will be insane to add such thing to upstream kernel, errata and out-of-tree implementations are best places for such things. Thanks
Attachment:
signature.asc
Description: PGP signature
