Hi Joe, Thanks for reporting the issue. We have noticed this during the netapp/oracal ovm test to include bfa driver as part of ovm distro. As a workaround, we suggested to set num_sgpg=512 and num_ios=512. We are working on a fix and it will be available in our 2.3 driver. Regards, Jing >-----Original Message----- >From: Joe Jin [mailto:joe.jin@xxxxxxxxxx] >Sent: Friday, April 30, 2010 2:34 AM >To: Jing Huang; linux-scsi@xxxxxxxxxxxxxxx >Cc: soeren.binner@xxxxxxxxxx; haobo.zhou@xxxxxxxxxx; joe.jin@xxxxxxxxxx >Subject: bfa driver on xen > >Hi Jing Huang, > >I'm Joe Jin from Oracle Linux team, recently we tried brocade device >on HP DL385 with OracleVM and found the device could not worked for >driver could not applied enough memory with below error message: > >bfad[0]: memory allocation failed with num_sgpgs: 2048 >bfad[0]: trying to allocate memory with num_sgpgs: 1024 >bfad[0]: memory allocation failed with num_sgpgs: 1024 >bfad[0]: trying to allocate memory with num_sgpgs: 512 >bfad0 bfad_hal_mem_alloc failure >Not enough memory to attach all Brocade HBA ports, System may need more > >I have did some investigated, here are some information: >OracleVM xen it 64bit and Dom0 is 32bit, the root cause is when 32bit Dom0 >running on 64bit hypervisor(xen), it on compat mode and xen just allowed >to allocate 1M(order = 8) contiguous memory, if not of compat mode, >Dom0 would successed applied 2M(order=9) contiguous memory. > >To let it the device works, we have to decrease driver config params >like num_sgpgs, reqq_size, rspq_size and so on, I'm not sure if >there are some releations among them, also did not known what values >is good enough for performance, woule you like give me some advices >for those? we have to reduce bfa driver DMA memory no more than 1M. > >Thanks, >Joe > -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html