Hi! I have a nasty bug with ‘sym53c8xx_2’ SCSI driver. I’m trying to attach a large (>2Tb) storage to this controller but it does not work. Seems nobody tested such combination before... My SCSI controller is noname OEM for Intel, PCI-X card with SYN53C1010 chip. Storage: Infortrend A24U-G2421-1 (upto 24 SATA disks to Ulra-320 SCSI channel). I have 11x1Tb RAID5 as one large disk with 10Tb in size. My Linux is RHEL 6, kernel "kernel-2.6.32-696.1.1.el6.x86_64". Physical SCSI link is OK, full Ultra-160, no physical/parity errors e.t.c. BUT IT DOES NOT WORK due to a software error. As it is known, Linux’s ‘sd’ uses CDB-16 command set for large SCSI disks. On the other hand ‘sym53c8xx_2’ driver “Utilizes SCRIPTS Load/Store command” and “Handles Phase Mismatch from SCRIPTS”. Seems there is a software error between driver and “sd”. As a result ALL disk operations are damn slow and gives a phase error in the “dmesg”: sd 4:0:0:0: phase change 2-7 16@37a9af60 resid=10. sd 4:0:0:0: phase change 2-7 16@37a9af60 resid=10. sd 4:0:0:0: phase change 2-7 16@37a9af60 resid=10. e.t.c. Another problem: “sd” incorrectly determines a disk size. Note a “phase change” errors after and before “capacity change”. As a result “sd” switches to CDB-10 and maximum disk size limited by 2Tb sym53c8xx 0000: 05:01.0: PCI INT A disabled sym53c8xx 0000: 05:01.0: PCI INT A -> GSI 24 (level, low) -> IRQ 24 sym0: <1010-66> rev 0x1 at pci 0000: 05:01.0 irq 24 sym0: Symbios NVRAM, ID 7, Fast-80, LVD, parity checking sym0: open drain IRQ line driver, using on-chip SRAM sym0: using LOAD/STORE-based firmware. sym0: handling phase mismatch from SCRIPTS. sym0: SCSI BUS has been reset. scsi4 : sym-2.2.3 scsi 4:0:0:0: Direct-Access IFT A24U-G2421-1 347R PQ: 0 ANSI: 5 scsi target4:0:0: tagged command queuing enabled, command queue depth 16. scsi target4:0:0: Beginning Domain Validation scsi target4:0:0: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 62) scsi target4:0:0: Ending Domain Validation sd 4:0:0:0: phase change 2-7 16@37a9af60 resid=10. sd 4:0:0:0: [sde] 4294967296 512-byte logical blocks: (2.19 TB/2.00 TiB) sd 4:0:0:0: [sde] Write Protect is off sd 4:0:0:0: [sde] Mode Sense: 9b 00 00 08 sd 4:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA sd 4:0:0:0: phase change 2-7 16@37a9af60 resid=10. sd 4:0:0:0: Attached scsi generic sg5 type 0 sd 4:0:0:0: [sde] 19529912320 512-byte logical blocks: (9.99 TB/9.09 TiB) sde: detected capacity change from 2199023255552 to 9999315107840 sde: unknown partition table sd 4:0:0:0: phase change 2-7 16@37a9af60 resid=10. sd 4:0:0:0: [sde] 4294967296 512-byte logical blocks: (2.19 TB/2.00 TiB) sd 4:0:0:0: [sde] Attached SCSI disk As a result ‘parted’ does not work too, it hangs on “mklabel gpt” and kernel log filled with tons of “phase change” errors. Interestingly, most of “sg_*” utilities works fine even with --16 option. [root@stora ~]# sg_readcap -v /dev/sg5 read capacity (10) cdb: 25 00 00 00 00 00 00 00 00 00 READ CAPACITY (10) indicates device capacity too large now trying 16 byte cdb variant read capacity (16) cdb: 9e 10 00 00 00 00 00 00 00 00 00 00 00 20 00 00 read capacity (16): requested 32 bytes but got 12 bytes Read Capacity results: Protection: prot_en=1, p_type=7, p_i_exponent=15 Thin provisioning: tpe=1, tprz=1 Last logical block address=19529912319 (0x48c12cfff), Number of logical blocks=19529912320 Logical block length=512 bytes Logical blocks per physical block exponent=15 Lowest aligned logical block address=16383 Hence: Device size: 9999315107840 bytes, 9536090.0 MiB, 9999.32 GB UPD: I’ve found another PCI-X card from the old SUN server on the NCR53C897 (it has no PC-style BIOS but recognized). IT DOES NOT WORK TOO with the SAME error. sym53c8xx 0000:06:02.0: PCI INT A disabled sym53c8xx 0000:06:02.0: PCI INT A -> GSI 26 (level, low) -> IRQ 26 sym0: <896> rev 0x7 at pci 0000:06:02.0 irq 26 sym0: No NVRAM, ID 7, Fast-40, LVD, parity checking sym0: SCSI BUS has been reset. scsi9 : sym-2.2.3 sym53c8xx 0000:06:02.1: PCI INT B -> GSI 27 (level, low) -> IRQ 27 sym1: <896> rev 0x7 at pci 0000:06:02.1 irq 27 sym1: No NVRAM, ID 7, Fast-40, LVD, parity checking sym1: SCSI BUS has been reset. scsi10 : sym-2.2.3 scsi 9:0:0:0: Direct-Access IFT A24U-G2421-1 347R PQ: 0 ANSI: 5 scsi target9:0:0: tagged command queuing enabled, command queue depth 16. scsi target9:0:0: Beginning Domain Validation scsi target9:0:0: FAST-40 WIDE SCSI 80.0 MB/s ST (25 ns, offset 31) scsi target9:0:0: Domain Validation skipping write tests scsi target9:0:0: Ending Domain Validation sd 9:0:0:0: phase change 2-7 16@37aaff60 resid=10. sd 9:0:0:0: [sde] 4294967296 512-byte logical blocks: (2.19 TB/2.00 TiB) sd 9:0:0:0: Attached scsi generic sg5 type 0 sd 9:0:0:0: [sde] Write Protect is off sd 9:0:0:0: [sde] Mode Sense: 9b 00 00 08 sd 9:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA sd 9:0:0:0: phase change 2-7 16@37aaff60 resid=10. sd 9:0:0:0: [sde] 19529912320 512-byte logical blocks: (9.99 TB/9.09 TiB) sde: detected capacity change from 2199023255552 to 9999315107840 sde: unknown partition table sd 9:0:0:0: phase change 2-7 16@37aaff60 resid=10. sd 9:0:0:0: [sde] 4294967296 512-byte logical blocks: (2.19 TB/2.00 TiB) sd 9:0:0:0: [sde] Attached SCSI disk -- -=AV=-
