> -----Original Message----- > From: Jeff Furlong [mailto:jeff.furlong@xxxxxxx] > Sent: Tuesday, October 30, 2018 11:21 AM > To: Elliott, Robert (Persistent Memory) <elliott@xxxxxxx>; 'Sitsofe Wheeler' <sitsofe@xxxxxxxxx> > Cc: fio <fio@xxxxxxxxxxxxxxx> > Subject: RE: fio win affinity broken > > Robert, > Agreed split is better. In trying to trim down the parameter list I left the policy to shared, which > is default. I haven't constrained the fio process, so not sure why the resulting clock threads fail. > Is the mask shifted the correct number of bits? > > Sitsofe, > On a x64 version of Win2016, with dual Intel(R) Xeon(R) CPU E5-2623 v3 @ 3.00GHz, running > > fio --name=test --ioengine=windowsaio --direct=1 --rw=write --overwrite=1 -- > filename=\\.\PHYSICALDRIVE1 --runtime=1s --thread --cpus_allowed=0-1 --debug=process > All of your threads fail starting with the 17th (mask 10000) (see below). Is that how many CPU cores you really have? cpus_online() is calling GetMaximumProcessorCount() which is returning the count of 64: process 4788 group=0 group_start=0 group_size=64 search_cpu=0 In linux, that would return only 16 for a system with 16 online CPUs. GetActiveProcessorCount() might be a better function to call. fio_setaffinity: failed to set thread affinity (mask 10000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 100000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 1000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 10000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 100000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 1000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 10000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 100000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 1000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 10000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 100000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 1000000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 20000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 200000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 2000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 20000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 200000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 2000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 20000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 200000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 2000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 20000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 200000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 2000000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 40000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 400000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 4000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 40000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 400000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 4000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 40000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 400000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 4000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 40000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 400000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 4000000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 80000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 800000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 8000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 80000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 800000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 8000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 80000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 800000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 8000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 80000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 800000000000000, GetLastError=87) fio_setaffinity: failed to set thread affinity (mask 8000000000000000, GetLastError=87) --- Robert Elliott, HPE Persistent Memory