Hi, On Wed, 2 Dec 2020 at 14:36, David Pineau <david.pineau@xxxxxxxxxxxxxxx> wrote: > <snip> > With this information in mind, I build the following FIO configuration file: > > >>>> > [global] > # File-related config > directory=/mnt/test-mountpoint > nrfiles=3000 > file_service_type=random > create_on_open=1 > allow_file_create=1 > filesize=16k-10m > > # Io type config > rw=randrw > unified_rw_reporting=0 > randrepeat=0 > fallocate=none > end_fsync=0 > overwrite=0 > fsync_on_close=1 > rwmixread=90 > # In an attempt to reproduce a similar usage skew as our service... > # Spread IOs unevenly, skewed toward a part of the dataset: > # - 60% of IOs on 20% of data, > # - 20% of IOs on 30% of data, > # - 20% of IOs on 50% of data > random_distribution=zoned:60/20:20/30:20/50 > # 100% Random reads, 0% Random writes (thus sequential) > percentage_random=100,0 > # Likewise, configure different blocksizes for seq (write) & random (read) ops > bs_is_seq_rand=1 > blocksize_range=128k-10m, > # Here's the blocksizes repartitions retrieved from our metrics during 3 hours > # Normally, it should be random within ranges, but this mode > # only uses fixed-size blocks, so we'll consider it good enough. > bssplit=,8k/10:16k/7:32k/9:64k/22:128k/21:256k/12:512k/14:1m/3:10m/2 > > # Threads/processes/job sync settings > thread=1 > > # IO/data Verify options > verify=null # Don't consume CPU please ! > > # Measurements and reporting settings > #per_job_logs=1 > disk_util=1 > > # Io Engine config > ioengine=libaio > > > [cache-layer2] > # Jobs settings > time_based=1 > runtime=60 > numjobs=175 > size=200M > <<<<< > > With this configuration, I'm obligated to use the CLI option > "--alloc-size=256M" otherwise the preparatory memory allocation fails > and aborts. <snip> > Do you have any advice on the configuration parameters I'm using to > push my hardware further towards its limits ? > Is there any mechanism within FIO that I'm misunderstanding, which is > causing me difficulty to do that ? > > In advance, thank you for your kind advice and help, Just to check, are you using the latest version of fio (https://github.com/axboe/fio/releases ) and if not could you try the latest one? Also could you remove any/every option from your jobfile that doesn't prevent the problem from happening and post the cut down version? Thanks. -- Sitsofe | http://sucs.org/~sits/
