Correction: I just ran a creation-task that actually did verify. But again, the tester crashed: UltraBitch CC-testing # ISCSI_DEVICE=/dev/dm-0 SIZE=2 fio cc-create.fio iSCSI: (g=0): rw=randwrite, bs=4K-4M/4K-4M, ioengine=libaio, iodepth=16 fio 2.0.3 Starting 1 process Jobs: 1 (f=1): [V] [100.0% done] [214.2M/0K /s] [578 /0 iops] [eta 00m:00s] iSCSI: (groupid=0, jobs=1): err= 0: pid=5804 read : io=2048.0MB, bw=131681KB/s, iops=148 , runt= 15926msec write: io=2048.0MB, bw=32172KB/s, iops=36 , runt= 65185msec bw (KB/s) : min= 254, max=433540, per=100.00%, avg=74235.85, stdev=109695.51 cpu : usr=1.69%, sys=1.66%, ctx=9617, majf=0, minf=87 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.3%, 16=99.4%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=2371/w=2371/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): READ: io=2048.0MB, aggrb=131681KB/s, minb=134841KB/s, maxb=134841KB/s, mint=15926msec, maxt=15926msec WRITE: io=2048.0MB, aggrb=32172KB/s, minb=32944KB/s, maxb=32944KB/s, mint=65185msec, maxt=65185msec Disk stats (read/write): dm-0: ios=5591/5424, merge=0/0, ticks=636318/2466335, in_queue=3102700, util=99.90%, aggrios=1401/1356, aggrmerge=0/0, aggrticks=151832/606765, aggrin_queue=758597, aggrutil=99.16% sdb: ios=1408/1352, merge=0/0, ticks=143015/448578, in_queue=591592, util=88.79% sdc: ios=1405/1355, merge=0/0, ticks=152818/656222, in_queue=809040, util=98.63% sdd: ios=1394/1360, merge=0/0, ticks=142123/850511, in_queue=992635, util=99.16% sde: ios=1398/1357, merge=0/0, ticks=169372/471751, in_queue=641123, util=98.71% UltraBitch CC-testing # ISCSI_DEVICE=/dev/dm-0 SIZE=2 RUN=0 fio cc-test.fio iSCSI: (g=0): rw=read, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=32 fio 2.0.3 Starting 1 process fio: ioengines.c:371: td_io_open_file: Assertion `!fio_file_open(f)' failed. fio: pid=5823, got signal=6 iSCSI: (groupid=0, jobs=1): err= 0: pid=5823 cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.3%, 16=0.7%, 32=98.7%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=2371/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): fio: file hash not empty on exit Mit freundlichen Grüßen Stefan Hübner, OECE - open-e certified engineer xtivate Service-Team WWWgroup GbR Michael Sänger, Jens Walter, Jörg Weißmantel Ziegelhüttenweg 4 98693 Ilmenau ________________________________________________________________ Telefon: 0800 XTIVATE (0800 9848283, gratis aus deutschem Fest- und Mobilnetz) Telefon: +49 (0)3677 46 99 440 Fax: +49 (0)3677 46 99 449 eMail: shu@xxxxxxxxxx Hi List, I'm trying to get numbers for LSI's CacheCade2.0 feature in block mode. I do record a fio run with this job-file: UltraBitch CC-testing # cat cc-create.fio [global] disable_lat=1 disable_clat=1 disable_slat=1 clat_percentiles=0 size=${SIZE}G nice=10 prio=5 ioengine=libaio iodepth=16 direct=1 iomem_align=4M verify=crc32c-intel verify_async=2 do_verify=1 verify_dump=1 [iSCSI] rw=randwrite bsrange=4k-4M filename=${ISCSI_DEVICE} write_iolog=iolog_${SIZE}.log write_bw_log=creator_${SIZE} The variables SIZE are properly set ISCSI-DEVICE. fio records a _bw.log and an iolog.log as one would think. BUT: it does never verify written data - is that intended? I'm trying to replay this test after enabling CC2 with this jobfile: UltraBitch CC-testing # cat cc-test.fio [global] disable_lat=1 disable_clat=1 disable_slat=1 clat_percentiles=0 #size=${SIZE} nice=10 prio=5 ioengine=libaio iodepth=16 direct=1 iomem_align=4M verify=crc32c-intel verify_async=2 do_verify=1 #verify_dump=1 [iSCSI] read_iolog=iolog_${SIZE}.log replay_no_stall=1 replay_redirect=${ISCSI_DEVICE} write_bw_log=testor_${RUN}_${SIZE} But those tests fail with the following error and I do not understand the reason. iSCSI: (g=0): rw=read, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=16 fio 2.0.3 Starting 1 process fio: ioengines.c:371: td_io_open_file: Assertion `!fio_file_open(f)' failed. fio: pid=5420, got signal=6 iSCSI: (groupid=0, jobs=1): err= 0: pid=5420 cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=151602/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): fio: file hash not empty on exit What might be the problem, how can I get a few figures? P.S.: the array is attached via iSCSI, with a proper MPIO setup. Mit freundlichen Grüßen Stefan Hübner, OECE - open-e certified engineer xtivate Service-Team WWWgroup GbR Michael Sänger, Jens Walter, Jörg Weißmantel Ziegelhüttenweg 4 98693 Ilmenau ________________________________________________________________ Telefon: 0800 XTIVATE (0800 9848283, gratis aus deutschem Fest- und Mobilnetz) Telefon: +49 (0)3677 46 99 440 Fax: +49 (0)3677 46 99 449 eMail: shu@xxxxxxxxxx ��.n��������+%������w��{.n�������^n�r������&��z�ޗ�zf���h���~����������_��+v���)ߣ�