Hi,
Any idea why same type of disks, on same server using same configuration will have different bench performance ( by 50% ) ?
testing them with fio show similar performance
fio --filename=/dev/sdd --direct=1 --sync=1 --rw=write --bs=4k --numjobs=10 --iodepth=1 --runtime=60 --time_based --group_reporting --name=journal-test
journal-test: (g=0): rw=write, bs=4K-4K/4K-4K/4K-4K, ioengine=sync, iodepth=1
...
/dev/sdc results
Jobs: 10 (f=10): [W(10)] [100.0% done] [0KB/113.1MB/0KB /s] [0/29.2K/0 iops] [eta 00m:00s]
/dev/sdd results
Jobs: 10 (f=10): [W(10)] [100.0% done] [0KB/114.7MB/0KB /s] [0/29.4K/0 iops] [eta 00m:00s]
OSD created as follows
ceph-volume lvm prepare --bluestore --data /dev/sdd
ceph-volume lvm activate 1 CORRECT_FS_ID
[root@osd05 ~]# ceph tell osd.1 bench
{
"bytes_written": 1073741824,
"blocksize": 4194304,
"bytes_per_sec": 238942459
}
[root@osd05 ~]# ceph tell osd.2 bench
{
"bytes_written": 1073741824,
"blocksize": 4194304,
"bytes_per_sec": 495815187
}
Connector : 00<Internal><Encl Pos 1 >: Slot 2
Vendor Id : TOSHIBA
Product Id : AL13SEB600
State : Online
Disk Type : SAS,Hard Disk Device
Capacity : 558.375 GB
Power State : Active
Connector : 00<Internal><Encl Pos 1 >: Slot 3
Vendor Id : SEAGATE
Product Id : ST300MM0006
State : Online
Disk Type : SAS,Hard Disk Device
Capacity : 278.875 GB
Power State : Active
megacli -LDInfo -L2 -a0
Adapter 0 -- Virtual Drive Information:
Virtual Drive: 2 (Target Id: 2)
Name :
RAID Level : Primary-0, Secondary-0, RAID Level Qualifier-0
Size : 558.375 GB
Sector Size : 512
Parity Size : 0
State : Optimal
Strip Size : 64 KB
Number Of Drives : 1
Span Depth : 1
Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU
Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU
Default Access Policy: Read/Write
Current Access Policy: Read/Write
Disk Cache Policy : Disk's Default
Encryption Type : None
Default Power Savings Policy: Controller Defined
Current Power Savings Policy: None
Can spin up in 1 minute: Yes
LD has drives that support T10 power conditions: Yes
LD's IO profile supports MAX power savings with cached writes: No
Bad Blocks Exist: No
Is VD Cached: Yes
Cache Cade Type : Read Only
megacli -LDInfo -L3 -a0
Adapter 0 -- Virtual Drive Information:
Virtual Drive: 3 (Target Id: 3)
Name :
RAID Level : Primary-0, Secondary-0, RAID Level Qualifier-0
Size : 278.875 GB
Sector Size : 512
Parity Size : 0
State : Optimal
Strip Size : 64 KB
Number Of Drives : 1
Span Depth : 1
Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU
Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU
Default Access Policy: Read/Write
Current Access Policy: Read/Write
Disk Cache Policy : Disk's Default
Encryption Type : None
Default Power Savings Policy: Controller Defined
Current Power Savings Policy: None
Can spin up in 1 minute: Yes
LD has drives that support T10 power conditions: Yes
LD's IO profile supports MAX power savings with cached writes: No
Bad Blocks Exist: No
Is VD Cached: Yes
Cache Cade Type : Read Only
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
