Hi Martin, From your diff info, maybe we can analyze this problem step by step. 1、According to your diff info about first eject and first hot add, the pci device 11:00.0 Mass storage controller was removed and was added ok at pci device level; 2、The main problem is 11:00.0 Mass storage controller can not bind its driver normally, right? 3、According to diff info about first hotadd and coldplug, the mainly diff is > + Region 0: Memory at f6c84000 (64-bit, non-prefetchable) [disabled] [size=128] > + Region 2: Memory at f6c80000 (64-bit, non-prefetchable) [disabled] [size=16K] > + Region 4: I/O ports at c000 [disabled] [size=128] and MaxReadReq 4096 bytes ----> MaxReadReq 512 bytes So maybe we can try to find why the memory range was disabled after hot add. Martin, can you provide /proc/iomem info when the system bootup, after first eject and first hot-add? I suspect the driver release its MMIO successfully after first eject. Thanks! Yijing. On 2013/3/12 9:00, Martin Mokrejs wrote: > Hi, > I cold-booted a computer with the card inserted before power-on and collected > lspci output and express card slot status every second. Then I tried eject and > hotplug inserts and it appearts the card is not detected, actually maybe pciehp > is not even suppoosed to work in this case as the slot was occupied during boot. > But let me come to it later. > > I noted the following on the very first eject of the so far cold-plugged card > that lspci properly reports PresDet change on the Changed: line. The only time > I ever saw it. ;-) > However, for any following inserts and ejects the value is not updated but slot > status bits are updated. I had BIOS defaults loaded and additionally, disabled > MediaCardReader. > > The slot status bits read by setpci were changing in this path: > card in slot and cold boot 0040 -> eject 0100 hotplug insert -> 0140 eject -> 0100 hotplug insert -> 0140 eject -> 0100 > > > > --- lspci_loop.23:58:50 2013-03-11 23:58:50.000000000 +0100 > +++ lspci_loop.23:58:51 2013-03-11 23:58:51.000000000 +0100 > @@ -439,7 +439,7 @@ > I/O behind bridge: 0000c000-0000dfff > Memory behind bridge: f6c00000-f7cfffff > Prefetchable memory behind bridge: 00000000f0000000-00000000f10fffff > - Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR- > + Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR- > BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B- > PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn- > Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00 > @@ -453,13 +453,13 @@ > ClockPM- Surprise- LLActRep+ BwNot- > LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+ > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > - LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt- > + LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt+ ABWMgmt- > SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ > Slot #7, PowerLimit 10.000W; Interlock- NoCompl+ > SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg- > Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock- > - SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock- > - Changed: MRL- PresDet- LinkState- > + SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock- > + Changed: MRL- PresDet+ LinkState+ > RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible- > RootCap: CRSVisible- > RootSta: PME ReqID 0000, PMEStatus- PMEPending- > @@ -478,11 +478,11 @@ > Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- > Kernel driver in use: pcieport > 00: 86 80 1e 1c 07 00 10 00 b5 00 04 06 10 00 81 00 > -10: 00 00 00 00 00 00 00 00 00 11 16 00 c0 d0 00 00 > +10: 00 00 00 00 00 00 00 00 00 11 16 00 c0 d0 00 20 > 20: c0 f6 c0 f7 01 f0 01 f1 00 00 00 00 00 00 00 00 > 30: 00 00 00 00 40 00 00 00 00 00 00 00 0a 04 10 00 > 40: 10 80 42 01 00 80 00 00 00 00 10 00 12 3c 12 08 > -50: 40 00 11 70 60 b2 3c 00 00 00 40 00 00 00 00 00 > +50: 40 00 11 50 60 b2 3c 00 00 00 08 01 00 00 00 00 > 60: 00 00 00 00 16 00 00 00 00 00 00 00 00 00 00 00 > 70: 01 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 > 80: 05 90 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > @@ -490,7 +490,7 @@ > a0: 01 00 02 c8 00 00 00 00 00 00 00 00 00 00 00 00 > b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -d0: 00 00 00 01 02 0b 00 00 02 80 11 c1 00 00 00 00 > +d0: 00 00 00 01 02 0b 00 00 02 80 11 c1 00 00 00 40 > e0: 00 03 00 00 00 00 00 00 01 00 00 00 00 00 00 00 > f0: 00 00 00 00 00 00 00 00 87 0f 05 08 00 00 00 00 > > @@ -797,55 +797,23 @@ > e0: 00 00 40 63 00 00 00 00 00 00 00 00 00 00 00 00 > f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > > -11:00.0 Mass storage controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev 01) > - Subsystem: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller > - Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- > - Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- > - Latency: 0, Cache Line Size: 64 bytes > - Interrupt: pin A routed to IRQ 19 > - Region 0: Memory at f6c84000 (64-bit, non-prefetchable) [size=128] > - Region 2: Memory at f6c80000 (64-bit, non-prefetchable) [size=16K] > - Region 4: I/O ports at c000 [size=128] > - Expansion ROM at f6c00000 [disabled] [size=512K] > - Capabilities: [54] Power Management version 2 > - Flags: PMEClk- DSI+ D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) > - Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME- > - Capabilities: [5c] MSI: Enable- Count=1/1 Maskable- 64bit+ > - Address: 0000000000000000 Data: 0000 > - Capabilities: [70] Express (v1) Legacy Endpoint, MSI 00 > - DevCap: MaxPayload 1024 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us > - ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset- > - DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported- > - RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- > - MaxPayload 128 bytes, MaxReadReq 4096 bytes > - DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr- TransPend- > - LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s, Latency L0 unlimited, L1 unlimited > - ClockPM- Surprise- LLActRep- BwNot- > - LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+ > - ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > - LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- > - Capabilities: [100 v1] Advanced Error Reporting > - UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol- > - UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > - UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- > - CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- > - CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- > - AERCap: First Error Pointer: 14, GenCap+ CGenEn- ChkCap+ ChkEn- > +11:00.0 Mass storage controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev ff) (prog-if ff) > + !!! Unknown header type 7f > Kernel driver in use: sata_sil24 > -00: 95 10 32 31 07 00 10 00 01 00 80 01 10 00 00 00 > -10: 04 40 c8 f6 00 00 00 00 04 00 c8 f6 00 00 00 00 > -20: 01 c0 00 00 00 00 00 00 00 00 00 00 95 10 32 31 > -30: 00 00 c0 f6 54 00 00 00 00 00 00 00 0a 01 00 00 > -40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -50: 00 00 00 00 01 5c 22 06 00 20 00 0c 05 70 80 00 > -60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -70: 10 00 11 00 03 00 00 00 00 50 0a 00 11 f4 03 00 > -80: 40 00 11 10 00 00 00 00 00 00 00 00 00 00 00 00 > -90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +00: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +10: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +20: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +30: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +40: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +50: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +60: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +70: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +80: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +90: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +a0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +b0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +c0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +d0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +e0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +f0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > --- lspci_loop.23:58:51 2013-03-11 23:58:51.000000000 +0100 > +++ lspci_loop.23:58:52 2013-03-11 23:58:52.000000000 +0100 > @@ -459,7 +459,7 @@ > SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg- > Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock- > SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock- > - Changed: MRL- PresDet+ LinkState+ > + Changed: MRL- PresDet- LinkState+ > RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible- > RootCap: CRSVisible- > RootSta: PME ReqID 0000, PMEStatus- PMEPending- > @@ -482,7 +482,7 @@ > 20: c0 f6 c0 f7 01 f0 01 f1 00 00 00 00 00 00 00 00 > 30: 00 00 00 00 40 00 00 00 00 00 00 00 0a 04 10 00 > 40: 10 80 42 01 00 80 00 00 00 00 10 00 12 3c 12 08 > -50: 40 00 11 50 60 b2 3c 00 00 00 08 01 00 00 00 00 > +50: 40 00 11 50 60 b2 3c 00 00 00 00 01 00 00 00 00 > 60: 00 00 00 00 16 00 00 00 00 00 00 00 00 00 00 00 > 70: 01 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 > 80: 05 90 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > @@ -490,7 +490,7 @@ > a0: 01 00 02 c8 00 00 00 00 00 00 00 00 00 00 00 00 > b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -d0: 00 00 00 01 02 0b 00 00 02 80 11 c1 00 00 00 40 > +d0: 00 00 00 01 02 0b 00 00 02 80 11 c1 00 00 00 00 > e0: 00 03 00 00 00 00 00 00 01 00 00 00 00 00 00 00 > f0: 00 00 00 00 00 00 00 00 87 0f 05 08 00 00 00 00 > --- lspci_loop.23:58:58 2013-03-11 23:58:58.000000000 +0100 > +++ lspci_loop.23:58:59 2013-03-11 23:58:59.000000000 +0100 > @@ -101,7 +101,7 @@ > Capabilities: [98] PCI Advanced Features > AFCap: TP+ FLR+ > AFCtrl: FLR- > - AFStatus: TP- > + AFStatus: TP+ > Kernel driver in use: ehci-pci > 00: 86 80 2d 1c 06 00 90 02 05 20 03 0c 00 00 00 00 > 10: 00 80 f0 f7 00 00 00 00 00 00 00 00 00 00 00 00 > --- lspci_loop.23:58:59 2013-03-11 23:58:59.000000000 +0100 > +++ lspci_loop.23:59:00 2013-03-11 23:59:00.000000000 +0100 > @@ -101,7 +101,7 @@ > Capabilities: [98] PCI Advanced Features > AFCap: TP+ FLR+ > AFCtrl: FLR- > - AFStatus: TP+ > + AFStatus: TP- > Kernel driver in use: ehci-pci > 00: 86 80 2d 1c 06 00 90 02 05 20 03 0c 00 00 00 00 > 10: 00 80 f0 f7 00 00 00 00 00 00 00 00 00 00 00 00 > > > > Below is the first hotplug of the card. > > --- lspci_loop.23:59:09 2013-03-11 23:59:09.000000000 +0100 > +++ lspci_loop.23:59:10 2013-03-11 23:59:10.000000000 +0100 > @@ -453,12 +453,12 @@ > ClockPM- Surprise- LLActRep+ BwNot- > LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+ > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > - LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt+ ABWMgmt- > + LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt- > SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ > Slot #7, PowerLimit 10.000W; Interlock- NoCompl+ > SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg- > Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock- > - SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock- > + SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock- > Changed: MRL- PresDet- LinkState+ > RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible- > RootCap: CRSVisible- > @@ -482,7 +482,7 @@ > 20: c0 f6 c0 f7 01 f0 01 f1 00 00 00 00 00 00 00 00 > 30: 00 00 00 00 40 00 00 00 00 00 00 00 0a 04 10 00 > 40: 10 80 42 01 00 80 00 00 00 00 10 00 12 3c 12 08 > -50: 40 00 11 50 60 b2 3c 00 00 00 00 01 00 00 00 00 > +50: 40 00 11 70 60 b2 3c 00 00 00 40 01 00 00 00 00 > 60: 00 00 00 00 16 00 00 00 00 00 00 00 00 00 00 00 > 70: 01 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 > 80: 05 90 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > @@ -797,23 +797,54 @@ > e0: 00 00 40 63 00 00 00 00 00 00 00 00 00 00 00 00 > f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > > -11:00.0 Mass storage controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev ff) (prog-if ff) > - !!! Unknown header type 7f > +11:00.0 Mass storage controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev 01) > + Subsystem: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller > + Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- > + Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- > + Interrupt: pin A routed to IRQ 19 > + Region 0: Memory at f6c84000 (64-bit, non-prefetchable) [disabled] [size=128] > + Region 2: Memory at f6c80000 (64-bit, non-prefetchable) [disabled] [size=16K] > + Region 4: I/O ports at c000 [disabled] [size=128] > + [virtual] Expansion ROM at f6c00000 [disabled] [size=512K] > + Capabilities: [54] Power Management version 2 > + Flags: PMEClk- DSI+ D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) > + Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME- > + Capabilities: [5c] MSI: Enable- Count=1/1 Maskable- 64bit+ > + Address: 0000000000000000 Data: 0000 > + Capabilities: [70] Express (v1) Legacy Endpoint, MSI 00 > + DevCap: MaxPayload 1024 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us > + ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset- > + DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported- > + RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- > + MaxPayload 128 bytes, MaxReadReq 512 bytes > + DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr- TransPend- > + LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s, Latency L0 unlimited, L1 unlimited > + ClockPM- Surprise- LLActRep- BwNot- > + LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+ > + ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > + LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- > + Capabilities: [100 v1] Advanced Error Reporting > + UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol- > + UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > + UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- > + CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- > + CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- > + AERCap: First Error Pointer: 14, GenCap+ CGenEn- ChkCap+ ChkEn- > Kernel driver in use: sata_sil24 > -00: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -10: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -20: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -30: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -40: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -50: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -60: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -70: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -80: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -90: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -a0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -b0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -c0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -d0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -e0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > -f0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +00: 95 10 32 31 00 00 10 00 01 00 80 01 00 00 00 00 > +10: 04 00 00 00 00 00 00 00 04 00 00 00 00 00 00 00 > +20: 01 00 00 00 00 00 00 00 00 00 00 00 95 10 32 31 > +30: 00 00 00 00 54 00 00 00 00 00 00 00 00 01 00 00 > +40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +50: 00 00 00 00 01 5c 22 06 00 20 00 0c 05 70 80 00 > +60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +70: 10 00 11 00 03 00 00 00 00 20 0a 00 11 f4 03 00 > +80: 40 00 11 10 00 00 00 00 00 00 00 00 00 00 00 00 > +90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > --- lspci_loop.23:59:15 2013-03-11 23:59:15.000000000 +0100 > +++ lspci_loop.23:59:16 2013-03-11 23:59:16.000000000 +0100 > @@ -519,7 +519,7 @@ > 60: 20 20 ff 07 00 00 00 00 01 00 00 01 00 00 08 40 > 70: 00 00 df 3f 00 00 00 00 00 00 00 00 00 00 00 00 > 80: 00 00 80 00 11 88 0c 93 30 0d 00 24 00 00 00 00 > -90: 00 00 00 00 00 00 00 00 13 00 06 03 00 00 00 00 > +90: 00 00 00 00 00 00 00 00 13 00 06 03 00 01 00 00 > a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > --- lspci_loop.23:59:16 2013-03-11 23:59:16.000000000 +0100 > +++ lspci_loop.23:59:17 2013-03-11 23:59:17.000000000 +0100 > @@ -519,7 +519,7 @@ > 60: 20 20 ff 07 00 00 00 00 01 00 00 01 00 00 08 40 > 70: 00 00 df 3f 00 00 00 00 00 00 00 00 00 00 00 00 > 80: 00 00 80 00 11 88 0c 93 30 0d 00 24 00 00 00 00 > -90: 00 00 00 00 00 00 00 00 13 00 06 03 00 01 00 00 > +90: 00 00 00 00 00 00 00 00 13 00 06 03 00 00 00 00 > a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > > > And later unplug of the hotplugged device: > > --- lspci_loop.23:59:18 2013-03-11 23:59:18.000000000 +0100 > +++ lspci_loop.23:59:19 2013-03-11 23:59:19.000000000 +0100 > @@ -453,12 +453,12 @@ > ClockPM- Surprise- LLActRep+ BwNot- > LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+ > ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > - LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt- > + LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt+ ABWMgmt- > SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ > Slot #7, PowerLimit 10.000W; Interlock- NoCompl+ > SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg- > Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock- > - SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock- > + SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock- > Changed: MRL- PresDet- LinkState+ > RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible- > RootCap: CRSVisible- > @@ -482,7 +482,7 @@ > 20: c0 f6 c0 f7 01 f0 01 f1 00 00 00 00 00 00 00 00 > 30: 00 00 00 00 40 00 00 00 00 00 00 00 0a 04 10 00 > 40: 10 80 42 01 00 80 00 00 00 00 10 00 12 3c 12 08 > -50: 40 00 11 70 60 b2 3c 00 00 00 40 01 00 00 00 00 > +50: 40 00 11 50 60 b2 3c 00 00 00 00 01 00 00 00 00 > 60: 00 00 00 00 16 00 00 00 00 00 00 00 00 00 00 00 > 70: 01 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 > 80: 05 90 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > @@ -797,54 +797,23 @@ > e0: 00 00 40 63 00 00 00 00 00 00 00 00 00 00 00 00 > f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > > -11:00.0 Mass storage controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev 01) > - Subsystem: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller > - Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- > - Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- > - Interrupt: pin A routed to IRQ 19 > - Region 0: Memory at f6c84000 (64-bit, non-prefetchable) [disabled] [size=128] > - Region 2: Memory at f6c80000 (64-bit, non-prefetchable) [disabled] [size=16K] > - Region 4: I/O ports at c000 [disabled] [size=128] > - [virtual] Expansion ROM at f6c00000 [disabled] [size=512K] > - Capabilities: [54] Power Management version 2 > - Flags: PMEClk- DSI+ D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) > - Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME- > - Capabilities: [5c] MSI: Enable- Count=1/1 Maskable- 64bit+ > - Address: 0000000000000000 Data: 0000 > - Capabilities: [70] Express (v1) Legacy Endpoint, MSI 00 > - DevCap: MaxPayload 1024 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us > - ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset- > - DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported- > - RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- > - MaxPayload 128 bytes, MaxReadReq 512 bytes > - DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr- TransPend- > - LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s, Latency L0 unlimited, L1 unlimited > - ClockPM- Surprise- LLActRep- BwNot- > - LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+ > - ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- > - LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- > - Capabilities: [100 v1] Advanced Error Reporting > - UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol- > - UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- > - UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- > - CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- > - CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- > - AERCap: First Error Pointer: 14, GenCap+ CGenEn- ChkCap+ ChkEn- > +11:00.0 Mass storage controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev ff) (prog-if ff) > + !!! Unknown header type 7f > Kernel driver in use: sata_sil24 > -00: 95 10 32 31 00 00 10 00 01 00 80 01 00 00 00 00 > -10: 04 00 00 00 00 00 00 00 04 00 00 00 00 00 00 00 > -20: 01 00 00 00 00 00 00 00 00 00 00 00 95 10 32 31 > -30: 00 00 00 00 54 00 00 00 00 00 00 00 00 01 00 00 > -40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -50: 00 00 00 00 01 5c 22 06 00 20 00 0c 05 70 80 00 > -60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -70: 10 00 11 00 03 00 00 00 00 20 0a 00 11 f4 03 00 > -80: 40 00 11 10 00 00 00 00 00 00 00 00 00 00 00 00 > -90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > +00: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +10: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +20: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +30: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +40: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +50: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +60: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +70: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +80: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +90: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +a0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +b0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +c0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +d0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +e0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > +f0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff > > > > > > Already from other tests I realized a hotplugged eSATA has some "[virtual] > Expansion ROM". Here is a reasonably complete diff between a coldplugged > state of the same card and after a hotplug. In dmesg pciehp complained > upon its loading that Cache Line Size 64 is not supported so maybe the below > difference is a direct result of that? Similarly, MaxReadReq is different > and I bet the lines > > + Region 0: Memory at f6c84000 (64-bit, non-prefetchable) [disabled] [size=128] > + Region 2: Memory at f6c80000 (64-bit, non-prefetchable) [disabled] [size=16K] > + Region 4: I/O ports at c000 [disabled] [size=128] > > actually mean the card is left disabled. Then, I am not surprised nothing > is shown upon its hotplug insert/eject in dmesg. ;-) In this particular setup > I don't think we are facing a PresDet issue. Either, the value is overwritten > by some other process, or the bug is somewhere else. > > > --- lspci_loop.23:58:26 2013-03-11 23:58:26.000000000 +0100 > +++ lspci_loop.23:59:10 2013-03-11 23:59:10.000000000 +0100 > @@ -439,7 +439,7 @@ > I/O behind bridge: 0000c000-0000dfff > Memory behind bridge: f6c00000-f7cfffff > Prefetchable memory behind bridge: 00000000f0000000-00000000f10fffff > - Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR- > + Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR- > BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B- > PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn- > Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00 > @@ -459,7 +459,7 @@ > SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg- > Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock- > SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock- > - Changed: MRL- PresDet- LinkState- > + Changed: MRL- PresDet- LinkState+ > RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible- > RootCap: CRSVisible- > RootSta: PME ReqID 0000, PMEStatus- PMEPending- > @@ -478,11 +478,11 @@ > Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- > Kernel driver in use: pcieport > 00: 86 80 1e 1c 07 00 10 00 b5 00 04 06 10 00 81 00 > -10: 00 00 00 00 00 00 00 00 00 11 16 00 c0 d0 00 00 > +10: 00 00 00 00 00 00 00 00 00 11 16 00 c0 d0 00 20 > 20: c0 f6 c0 f7 01 f0 01 f1 00 00 00 00 00 00 00 00 > 30: 00 00 00 00 40 00 00 00 00 00 00 00 0a 04 10 00 > 40: 10 80 42 01 00 80 00 00 00 00 10 00 12 3c 12 08 > -50: 40 00 11 70 60 b2 3c 00 00 00 40 00 00 00 00 00 > +50: 40 00 11 70 60 b2 3c 00 00 00 40 01 00 00 00 00 > 60: 00 00 00 00 16 00 00 00 00 00 00 00 00 00 00 00 > 70: 01 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 > 80: 05 90 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > @@ -799,14 +799,13 @@ > > 11:00.0 Mass storage controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev 01) > Subsystem: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller > - Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- > + Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- > - Latency: 0, Cache Line Size: 64 bytes > Interrupt: pin A routed to IRQ 19 > - Region 0: Memory at f6c84000 (64-bit, non-prefetchable) [size=128] > - Region 2: Memory at f6c80000 (64-bit, non-prefetchable) [size=16K] > - Region 4: I/O ports at c000 [size=128] > - Expansion ROM at f6c00000 [disabled] [size=512K] > + Region 0: Memory at f6c84000 (64-bit, non-prefetchable) [disabled] [size=128] > + Region 2: Memory at f6c80000 (64-bit, non-prefetchable) [disabled] [size=16K] > + Region 4: I/O ports at c000 [disabled] [size=128] > + [virtual] Expansion ROM at f6c00000 [disabled] [size=512K] > Capabilities: [54] Power Management version 2 > Flags: PMEClk- DSI+ D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) > Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME- > @@ -817,7 +816,7 @@ > ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset- > DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported- > RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- > - MaxPayload 128 bytes, MaxReadReq 4096 bytes > + MaxPayload 128 bytes, MaxReadReq 512 bytes > DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr- TransPend- > LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s, Latency L0 unlimited, L1 unlimited > ClockPM- Surprise- LLActRep- BwNot- > @@ -832,14 +831,14 @@ > CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr- > AERCap: First Error Pointer: 14, GenCap+ CGenEn- ChkCap+ ChkEn- > Kernel driver in use: sata_sil24 > -00: 95 10 32 31 07 00 10 00 01 00 80 01 10 00 00 00 > -10: 04 40 c8 f6 00 00 00 00 04 00 c8 f6 00 00 00 00 > -20: 01 c0 00 00 00 00 00 00 00 00 00 00 95 10 32 31 > -30: 00 00 c0 f6 54 00 00 00 00 00 00 00 0a 01 00 00 > +00: 95 10 32 31 00 00 10 00 01 00 80 01 00 00 00 00 > +10: 04 00 00 00 00 00 00 00 04 00 00 00 00 00 00 00 > +20: 01 00 00 00 00 00 00 00 00 00 00 00 95 10 32 31 > +30: 00 00 00 00 54 00 00 00 00 00 00 00 00 01 00 00 > 40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > 50: 00 00 00 00 01 5c 22 06 00 20 00 0c 05 70 80 00 > 60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > -70: 10 00 11 00 03 00 00 00 00 50 0a 00 11 f4 03 00 > +70: 10 00 11 00 03 00 00 00 00 20 0a 00 11 f4 03 00 > 80: 40 00 11 10 00 00 00 00 00 00 00 00 00 00 00 00 > 90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 > > > > Sadly, although the very first eject was notified the sata_sila24 neither > did "release" the device nor did it complain that it suddenly disappeared. > That was so far always in dmesg output (like for example): > > [ 251.632928] sata_sil24 0000:11:00.0: PME# disabled > [ 251.636498] sata_sil24: IRQ status == 0xffffffff, PCI fault or device removal? > > > I re-plugged the card and ejected several times while the while loops > collecting lspci and slot_status via the setpci shell command harvested > data. Still, in dmesg there was nothing logged regarding card insert/eject. > Eventually, I tried rmmod sata_sil24 (did NOT need 'rmmod -f') and that > did log something new. > > [ 529.571040] ata8.00: disabled > [ 529.576365] sd 7:0:0:0: [sdb] Synchronizing SCSI cache > [ 529.577202] sd 7:0:0:0: [sdb] > [ 529.577204] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 529.577205] sd 7:0:0:0: [sdb] Stopping disk > [ 529.577251] sd 7:0:0:0: [sdb] START_STOP FAILED > [ 529.577253] sd 7:0:0:0: [sdb] > [ 529.577254] Result: hostbyte=DID_BAD_TARGET driverbyte=DRIVER_OK > [ 529.578309] sata_sil24: IRQ status == 0xffffffff, PCI fault or device removal? > [ 605.818905] sata_sil24 0000:11:00.0: version 1.1 > [ 605.818923] sata_sil24 0000:11:00.0: enabling device (0000 -> 0003) > [ 605.914722] sata_sil24 0000:11:00.0: failed to clear port RST > [ 606.014860] sata_sil24 0000:11:00.0: failed to clear port RST > [ 606.014882] sata_sil24 0000:11:00.0: enabling bus mastering > [ 606.017741] scsi8 : sata_sil24 > [ 606.019388] scsi9 : sata_sil24 > [ 606.019898] ata9: SATA max UDMA/100 host m128@0xf6c84000 port 0xf6c80000 irq 19 > [ 606.019902] ata10: SATA max UDMA/100 host m128@0xf6c84000 port 0xf6c82000 irq 19 > [ 606.115003] ata9: controller in dubious state, performing PORT_RST > [ 608.327747] ata9: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF) > [ 608.427847] ata10: controller in dubious state, performing PORT_RST > [ 610.640619] ata10: SATA link down (SStatus FFFFFFFF SControl FFFFFFFF) > > > > > Finally, I am tempted to say that pciehp does not work at all under 3.9-rc1 > if the slot was occupied during boot. It does NOT contain the usual debug > info spanning several lines and it only said: > > [ 2.109629] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 > [ 2.110225] pciehp: pcie_port_service_register = 0 > [ 2.110226] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 > > If that is intentional the driver should complain loudly. Please educate me > what those "[virtual] Expansion ROM's" were in lspci above and whether those > "[disabled]" memory ranges relate to that as well. If the card is not thought > to be present or just not recognized ... why is that printed in lspci at all? > Similarly, what can you tell me if lspci output shows only: > > Latency: 0 > > or even lacks the whole "Latency" line altoghether, is that also a disabled device? > > I believe in working cases there is "Latency: 0, Cache Line Size: 64 bytes" instead. > > > > Details and raw files at: http://195.113.57.32/~mmokrejs/tmp/3.9-rc1_disabled_MediaCard_reader_eSATA_coldplugged.tar.bz2 > > To inspect the incremental diffs of lspci output I used: > > prev='/dev/null'; ls -latr lspci_* | awk '{print $9}' | while read cur; do diff -u -w $prev $cur | less; prev=$cur; done > > Thank you, > Martin > -- > To unsubscribe from this list: send the line "unsubscribe linux-pci" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html > > . > -- Thanks! Yijing -- To unsubscribe from this list: send the line "unsubscribe linux-pci" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
