On Thu, 2009-09-17 at 18:39 +0000, James Bottomley wrote: > On Thu, 2009-09-17 at 09:09 -0700, Eddie wrote: > > James Bottomley wrote: > > > On Wed, 2009-09-16 at 19:59 -0700, Eddie wrote: > > > > > >>>> How much memory does your system have? > > >>>> > > >>>> Best guess in the 64 bit case is that the physical memory the kernel is > > >>>> doing DMA to isn't within the range of the card. You might be able to > > >>>> test this by booting with the max_addr=4G parameter in the 64 bit case. > > >>>> > > >>>> If it is, we'll have to get the DMA mask for this thing set up > > >>>> correctly. > > >>>> > > >>>> James > > >>>> > > >>>> > > >>> James, > > >>> > > >>> It's got 8Gig. > > >>> > > >>> I'll try your suggestion tonight, when I get home. > > >>> > > >>> Cheers, > > >>> Eddie > > >>> > > >>> > > >> OK, adding addappend = " max_addr=4G" to my lilo.conf made no > > >> difference. It still booted with all 8G. :( > > >> > > >> But, changing it to addappend = " mem=4G" seemed to do the trick. > > >> > > >> And, your guess might be correct. I now see the correct messages for > > >> the MegaRAID: > > >> > > >> scsi 4:4:0:0: Direct-Access MegaRAID LD 0 RAID5 1430G N661 PQ: 0 ANSI: 2 > > >> sd 4:4:0:0: [sda] 2930307072 512-byte hardware sectors: (1.50 TB/1.36 TiB) > > >> sd 4:4:0:0: [sda] Write Protect is off > > >> sd 4:4:0:0: [sda] Mode Sense: 00 00 00 00 > > >> sd 4:4:0:0: [sda] Asking for cache data failed > > >> sd 4:4:0:0: [sda] Assuming drive cache: write through > > >> sd 4:4:0:0: [sda] 2930307072 512-byte hardware sectors: (1.50 TB/1.36 TiB) > > >> sd 4:4:0:0: [sda] Write Protect is off > > >> sd 4:4:0:0: [sda] Mode Sense: 00 00 00 00 > > >> sd 4:4:0:0: [sda] Asking for cache data failed > > >> sd 4:4:0:0: [sda] Assuming drive cache: write through > > >> sda: sda1 > > >> sd 4:4:0:0: [sda] Attached SCSI disk > > >> sd 4:4:0:0: Attached scsi generic sg1 type 0 > > >> > > > > > > Hmm, so the driver looks to do this correctly. By default it sets a 32 > > > bit DMA mask but it raises it to 64 bits for certain boards which can > > > support that (based on the PCI ids). Can you do an lspci -n -v and send > > > the output? That will tell me whether the board got a 64 bit mask. > > > > > > Thanks, > > > > > > James > > > > > > > > James, > > > > This is when booted with the "mem=4G" override still in place. If you > > need it without that, when it fails to "see" the device, let me know, > > and I'll re-boot tonight to gather it: > > > > 01:04.0 0104: 101e:1960 (rev 02) > > Subsystem: 101e:0511 > > This is sufficient. That's an AMI Megaraid3. They're not 64 bit > capable and they should only have a 32 bit DMA mask. The block layer > should be doing the right thing, so there must be something from a >4GB > pool leaking into the driver somewhere: probably a stray kmalloc of a > DMA buffer without the right flags ... I'll run over the driver and see > if I can spot it. OK, I analysed the code paths; I'm nearly certain the dma_map_sg() is returning addresses greater than the 32 bits allowable, which would point to some type of pci gart DMA failure (cc'ing Tomo for input). James -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html