Just to circle back to this: Drives: Seagate ST8000NM0065 Controller: LSI 3108 RAID-on-Chip At the time, no BBU on RoC controller. Each OSD drive was configured as a single RAID0 VD. What I believe to be the snake that bit us was the Seagate drives’ on-board caching. Using storcli to manage the controller/drive, the pdcache value for /cx/vx was set to default, which in this case is on. So now all of the VD’s have the pdcache value set to off. At the time the controller’s write-cache setting was also set to write back, and has since been set to write-through until BBU’s are installed. Below is an example of our current settings in use post power-event:
Hopefully this configuration is a much safer configuration, and can help anyone else before incurring any destructive issues. The only less than great part of this configuration is the hit to write I/O due to less than optimal write scheduling compared to cached writes. Hope to enable write-back at the controller level after BBU installation. Thanks, Reed
|
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
