I agree with the assessment that Robert and yourself have made - it should have been a call to GetActiveProcessorCount() and I'm not sure why I didn't use that... On Wed, 31 Oct 2018 at 04:06, Jeff Furlong <jeff.furlong@xxxxxxx> wrote: > > Each socket has 8 logical cores, so 16 total cores. Agreed GetMaximumProcessorCount() returns the max possible cores, and GetActiveProcessorCount() returns the current active cores. I can try to see if that change resolves it. Thanks. > > Regards, > Jeff > > -----Original Message----- > From: fio-owner@xxxxxxxxxxxxxxx [mailto:fio-owner@xxxxxxxxxxxxxxx] On Behalf Of Elliott, Robert (Persistent Memory) > Sent: Tuesday, October 30, 2018 7:21 PM > To: Jeff Furlong <jeff.furlong@xxxxxxx>; 'Sitsofe Wheeler' <sitsofe@xxxxxxxxx> > Cc: fio <fio@xxxxxxxxxxxxxxx> > Subject: RE: fio win affinity broken > > > > > -----Original Message----- > > From: Jeff Furlong [mailto:jeff.furlong@xxxxxxx] > > Sent: Tuesday, October 30, 2018 11:21 AM > > To: Elliott, Robert (Persistent Memory) <elliott@xxxxxxx>; 'Sitsofe > > Wheeler' <sitsofe@xxxxxxxxx> > > Cc: fio <fio@xxxxxxxxxxxxxxx> > > Subject: RE: fio win affinity broken > > > > Robert, > > Agreed split is better. In trying to trim down the parameter list I > > left the policy to shared, which is default. I haven't constrained the fio process, so not sure why the resulting clock threads fail. > > Is the mask shifted the correct number of bits? > > > > Sitsofe, > > On a x64 version of Win2016, with dual Intel(R) Xeon(R) CPU E5-2623 v3 > > @ 3.00GHz, running > > > > fio --name=test --ioengine=windowsaio --direct=1 --rw=write > > --overwrite=1 -- > > filename=\\.\PHYSICALDRIVE1 --runtime=1s --thread --cpus_allowed=0-1 > > --debug=process > > > > All of your threads fail starting with the 17th (mask 10000) (see below). > Is that how many CPU cores you really have? > > cpus_online() is calling GetMaximumProcessorCount() which is returning the count of 64: > process 4788 group=0 group_start=0 group_size=64 search_cpu=0 > > In linux, that would return only 16 for a system with 16 online CPUs. > GetActiveProcessorCount() might be a better function to call. > > > fio_setaffinity: failed to set thread affinity (mask 10000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 100000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 1000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 10000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 100000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 1000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 10000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 100000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 1000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 10000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 100000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 1000000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 20000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 200000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 2000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 20000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 200000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 2000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 20000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 200000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 2000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 20000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 200000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 2000000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 40000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 400000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 4000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 40000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 400000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 4000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 40000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 400000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 4000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 40000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 400000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 4000000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 80000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 800000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 8000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 80000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 800000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 8000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 80000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 800000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 8000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 80000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 800000000000000, GetLastError=87) > fio_setaffinity: failed to set thread affinity (mask 8000000000000000, GetLastError=87) > > > --- > Robert Elliott, HPE Persistent Memory > > > > -- Sitsofe | http://sucs.org/~sits/