Hi - I'm trying to set up our first Ceph deployment with a small set of
3 servers, using an SSD boot drive each and 2x Micron 5200 SSDs per
server for OSD drives. It appears that Ceph under Docker gives us an
allowable production config using 3 servers rather than 6. We are using
CentOS 7.4 as the host operating system.
I was able to get the cluster up and running using ceph-ansible with one
OSD per drive, using Bluestore, but 4k block and MySQL performance was
below the performance of a single SSD. One possible tuning step appears
to be running 4-6 OSDs per SSD rather than 1, but I'm having trouble
getting ceph-ansible to provision that. My impression is that I should
preconfigure LVM volumes for the OSDs, and I've done that (this is a
test on a clean VM install to eliminate any leftovers from my previous
cluster):
osda1 vg3 -wi-a----- 13.50g
osda2 vg3 -wi-a----- 13.50g
osda3 vg3 -wi-a----- 13.50g
osda4 vg3 -wi-a----- 13.50g
I configured osd.yml to include:
osd_scenario: lvm
osd_objectstore: bluestore
lvm_volumes:
- data: osda1
data_vg: vg3
- data: osda2
data_vg: vg3
- data: osda3
data_vg: vg3
- data: osda4
data_vg: vg3
and I see some OSD tasks being run by ansible, but there doesn't seem to
be a startup script enabled for OSDs, and no OSD containers are running:
[root@ceph1 jacob]# systemctl | grep ceph
ceph-mgr@ceph1.service loaded active running Ceph Manager
ceph-mon@ceph1.service loaded active running Ceph Monitor
system-ceph\x2dmgr.slice loaded active active system-ceph\x2dmgr.slice
system-ceph\x2dmon.slice loaded active active system-ceph\x2dmon.slice
[root@ceph1 jacob]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS
PORTS NAMES
037197ef9bac docker.io/ceph/daemon:latest "/entrypoint.sh" 5
minutes ago Up 5 minutes ceph-mgr-ceph1
4947e5c1c544 docker.io/ceph/daemon:latest "/entrypoint.sh" 17
minutes ago Up 17 minutes ceph-mon-ceph1
all.yml is configured for Docker:
ceph_origin: repository
ceph_repository: community
ceph_stable_release: luminous
fsid: "{{ cluster_uuid.stdout }}"
generate_fsid: true
monitor_interface: eth0
public_network: 192.168.122.0/24
cluster_network: 192.168.122.0/24
ceph_tcmalloc_max_total_thread_cache: 134217728
mon_containerized_deployment: true
osd_containerized_deployment: true
docker: true
containerized_deployment: true
Does ceph-ansible support LVM OSDs using Docker?
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
