Hello Steven, are you sure that the systems are exact the same? Sometimes vendors place extension cards into different PCIe slots. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.verges@xxxxxxxx Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247 Munich CEO: Martin Verges - VAT-ID: DE310638492 Com. register: Amtsgericht Munich HRB 231263 Web: https://croit.io YouTube: https://goo.gl/PGE1Bx 2018-10-25 17:46 GMT+02:00 Steven Vacaroaia <stef97@xxxxxxxxx>: > Hi, > I have 4 x DELL R630 servers with exact same specs > I installed Intel Optane SSDPED1K375GA in all > > When comparing fio performance ( both read and write), when is lower than > the other 3 > ( see below - just read) > > Any suggestions as to what to check/fix ? > > BAD server > [root@osd04 ~]# fio --filename=/dev/nvme0n1 --direct=1 --sync=1 --rw=read > --bs=4k --numjobs=100 --iodepth=1 --runtime=60 --time_based > --group_reporting --name=journal-test > journal-test: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) > 4096B-4096B, ioengine=psync, iodepth=1 > ... > fio-3.1 > Starting 100 processes > Jobs: 100 (f=100): [R(100)][100.0%][r=2166MiB/s,w=0KiB/s][r=554k,w=0 > IOPS][eta 00m:00s] > > > GOOD server > [root@osd02 ~]# fio --filename=/dev/nvme0n1 --direct=1 --sync=1 --rw=read > --bs=4k --numjobs=100 --iodepth=1 --runtime=60 --time_based > --group_reporting --name=journal-test > journal-test: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) > 4096B-4096B, ioengine=psync, iodepth=1 > ... > fio-3.1 > Starting 100 processes > Jobs: 100 (f=100): [R(100)][100.0%][r=2278MiB/s,w=0KiB/s][r=583k,w=0 > IOPS][eta 00m:00s] > > > many thanks > steven > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com