On 26 November 2017 at 05:30, Gavriliuk, Anton (HPS Ukraine) <anton.gavriliuk@xxxxxxx> wrote: > OK, I rebuild 3.2 with libaio & libpmem libraries, > > dl560g10spmem01:/var/work/fio-3.2 # rpm -qa|grep libpmem > libpmemblk-1.3-3.fc27.x86_64 > libpmempool-devel-1.3-3.fc27. [snip] > libpmem yes > libpmemblk yes > NVML pmemblk engine yes > NVML dev-dax engine yes OK so fio has been built with pmem support. [...] > dl560g10spmem01:/var/work/fio-3.2 # /usr/local/bin/fio --filename=/dev/dax0.0 --rw=randrw --refill_buffers --norandommap --randrepeat=0 --ioengine=dev-dax --bssplit=4k/4:8k/7:16k/7:32k/15:64k/65:128k/1:256k/1 --rwmixread=5 --iodepth=1 --numjobs=1 --runtime=1800 --group_reporting --name=4-rand-rw-3xx --size=300Gb --name=4-rand-rw-3xx > 4-rand-rw-3xx: (g=0): rw=randrw, bs=(R) 4096B-256KiB, (W) 4096B-256KiB, (T) 4096B-256KiB, ioengine=dev-dax, iodepth=1 > 4-rand-rw-3xx: (g=0): rw=randrw, bs=(R) 4096B-256KiB, (W) 4096B-256KiB, (T) 4096B-256KiB, ioengine=dev-dax, iodepth=1 > fio-3.2 > Starting 2 processes > > Run status group 0 (all jobs): Where's the output of this job? Did it work? > dl560g10spmem01:/var/work/fio-3.2 # > > /dev/pmem1 on /pmem type xfs (rw,relatime,attr2,dax,inode64,noquota) ^^^ So your dax filesystem appears at /pmem ... > dl560g10spmem01:/var/work/fio-3.2 # /usr/local/bin/fio --filename=/dev/pmem1 --rw=randrw --refill_buffers --norandommap --randrepeat=0 --ioengine=pmemblk --bssplit=4k/4:8k/7:16k/7:32k/15:64k/65:128k/1:256k/1 --rwmixread=5 --iodepth=1 --numjobs=1 --runtime=1800 --group_reporting --name=4-rand-rw-3xx --allow_mounted_write=1 --thread=1 --direct=1 > 4-rand-rw-3xx: (g=0): rw=randrw, bs=(R) 4096B-256KiB, (W) 4096B-256KiB, (T) 4096B-256KiB, ioengine=pmemblk, iodepth=1 > fio-3.2 > Starting 1 thread > pmemblk: unable to open pmemblk pool file /dev/pmem1 (Invalid argument) ...but you're using filename=/dev/pmem1 with pmemblk? At least the filename option you used looks incorrect for this ioengine - have you seen the comments and filenames in the example over on https://github.com/axboe/fio/blob/fio-3.2/examples/pmemblk.fio ? Also are you sure you want to be setting allow_mounted_write=1 in this case - what should be mounted where the I/O happens - won't pmemblk create the "device" itself? -- Sitsofe | http://sucs.org/~sits/ -- To unsubscribe from this list: send the line "unsubscribe fio" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html