I'm trying to test PMEM using DAX/mmap(), but there're no outputs & errors,
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ll /dev|grep pmem
brw-rw---- 1 root disk 259, 0 Nov 27 05:50 pmem1
brw-rw---- 1 root disk 259, 1 Nov 27 05:50 pmem2
brw-rw---- 1 root disk 259, 2 Nov 27 05:50 pmem3
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ll /dev|grep dax
crw------- 1 root root 243, 0 Nov 27 05:50 dax0.0
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ll
total 36
-rwxrwxrwx 1 root root 110 Nov 23 20:44 cleanupDAX.sh
-rwxrwxrwx 1 root root 381 Nov 27 05:55 run-fio-db-64krw.sh
-rwxr-xr-x 1 root root 361 Nov 23 20:51 run-fio-db-64ksw-numaopt.sh
-rwxrwxrwx 1 root root 361 Nov 23 20:47 run-fio-db-64ksw.sh
-rwxrwxrwx 1 root root 375 Nov 23 20:49 run-fio-db-8krr.sh
-rwxrwxrwx 1 root root 636 Nov 23 20:49 run-fio-db-8krrw.sh
-rwxrwxrwx 1 root root 339 Nov 23 20:45 run-itDAX.sh
-rwxrwxrwx 1 root root 132 Nov 23 20:46 setupDAX.sh
-rw-r--r-- 1 root root 117 Nov 23 20:16 testDAX.out
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX #
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # cat run-fio-db-64krw.sh
#! /bin/sh
echo "Running random write 64k 32 IO 1024m file 8 threads on DAX PMEM"
result=$(fio --name=random-writers --ioengine=mmap --iodepth=32 --rw=randwrite --bs=64k --size=1024m --numjobs=8 --group_reporting=1 --eta=never --time_based --runtime=60 --filename=/dev/dax0.0 | grep WRITE)
agg=$(echo $result|cut -d',' -f2)
speed="${agg/aggrb=/Write Speed:}"
echo $speed
echo ""
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ./run-fio-db-64krw.sh
Running random write 64k 32 IO 1024m file 8 threads on DAX PMEM
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ./run-fio-db-64ksw-numaopt.sh
Running seq write 64k 1 IO 3g file 4 threads on DAX PMEM
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ./run-fio-db-64ksw.sh
Running seq write 64k 1 IO 3g file 4 threads on DAX PMEM
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ./run-fio-db-8krr.sh
Running random read 8k 32 IO 1024m file 8 threads on DAX PMEM
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX # ./run-fio-db-8krrw.sh
Running random read/write 60/40 8k 32 IO 1024m file 8 threads on DAX PMEM
dl560g10spmem01:~/FIO-PMEM_TestScripts/DAX #
-----Original Message-----
From: Sitsofe Wheeler [mailto:sitsofe@xxxxxxxxx]
Sent: Sunday, November 26, 2017 5:28 PM
To: Gavriliuk, Anton (HPS Ukraine) <anton.gavriliuk@xxxxxxx>
Cc: fio@xxxxxxxxxxxxxxx
Subject: Re: fio 3.2
On 26 November 2017 at 05:30, Gavriliuk, Anton (HPS Ukraine) <anton.gavriliuk@xxxxxxx> wrote:
> OK, I rebuild 3.2 with libaio & libpmem libraries,
>
> dl560g10spmem01:/var/work/fio-3.2 # rpm -qa|grep libpmem
> libpmemblk-1.3-3.fc27.x86_64
> libpmempool-devel-1.3-3.fc27.
[snip]
> libpmem yes
> libpmemblk yes
> NVML pmemblk engine yes
> NVML dev-dax engine yes
OK so fio has been built with pmem support.
[...]
> dl560g10spmem01:/var/work/fio-3.2 # /usr/local/bin/fio
> --filename=/dev/dax0.0 --rw=randrw --refill_buffers --norandommap
> --randrepeat=0 --ioengine=dev-dax
> --bssplit=4k/4:8k/7:16k/7:32k/15:64k/65:128k/1:256k/1 --rwmixread=5
> --iodepth=1 --numjobs=1 --runtime=1800 --group_reporting
> --name=4-rand-rw-3xx --size=300Gb --name=4-rand-rw-3xx
> 4-rand-rw-3xx: (g=0): rw=randrw, bs=(R) 4096B-256KiB, (W)
> 4096B-256KiB, (T) 4096B-256KiB, ioengine=dev-dax, iodepth=1
> 4-rand-rw-3xx: (g=0): rw=randrw, bs=(R) 4096B-256KiB, (W)
> 4096B-256KiB, (T) 4096B-256KiB, ioengine=dev-dax, iodepth=1
> fio-3.2
> Starting 2 processes
>
> Run status group 0 (all jobs):
Where's the output of this job? Did it work?
> dl560g10spmem01:/var/work/fio-3.2 #
>
> /dev/pmem1 on /pmem type xfs (rw,relatime,attr2,dax,inode64,noquota)
^^^ So your dax filesystem appears at /pmem ...
> dl560g10spmem01:/var/work/fio-3.2 # /usr/local/bin/fio
> --filename=/dev/pmem1 --rw=randrw --refill_buffers --norandommap
> --randrepeat=0 --ioengine=pmemblk
> --bssplit=4k/4:8k/7:16k/7:32k/15:64k/65:128k/1:256k/1 --rwmixread=5
> --iodepth=1 --numjobs=1 --runtime=1800 --group_reporting
> --name=4-rand-rw-3xx --allow_mounted_write=1 --thread=1 --direct=1
> 4-rand-rw-3xx: (g=0): rw=randrw, bs=(R) 4096B-256KiB, (W)
> 4096B-256KiB, (T) 4096B-256KiB, ioengine=pmemblk, iodepth=1
> fio-3.2
> Starting 1 thread
> pmemblk: unable to open pmemblk pool file /dev/pmem1 (Invalid
> argument)
...but you're using filename=/dev/pmem1 with pmemblk? At least the filename option you used looks incorrect for this ioengine - have you seen the comments and filenames in the example over on https://github.com/axboe/fio/blob/fio-3.2/examples/pmemblk.fio ? Also are you sure you want to be setting allow_mounted_write=1 in this case
- what should be mounted where the I/O happens - won't pmemblk create the "device" itself?
--
Sitsofe | http://sucs.org/~sits/
��.n��������+%������w��{.n�������^n�r������&��z�ޗ�zf���h���~����������_��+v���)ߣ�
