There is no support for ceph-volume (or LVM) with ceph-ansible and docker.
On Thu, Apr 26, 2018 at 3:16 PM, Jacob DeGlopper <jacob@xxxxxxxx> wrote:
> Hi - I'm trying to set up our first Ceph deployment with a small set of 3
> servers, using an SSD boot drive each and 2x Micron 5200 SSDs per server for
> OSD drives. It appears that Ceph under Docker gives us an allowable
> production config using 3 servers rather than 6. We are using CentOS 7.4 as
> the host operating system.
>
> I was able to get the cluster up and running using ceph-ansible with one OSD
> per drive, using Bluestore, but 4k block and MySQL performance was below the
> performance of a single SSD. One possible tuning step appears to be running
> 4-6 OSDs per SSD rather than 1, but I'm having trouble getting ceph-ansible
> to provision that. My impression is that I should preconfigure LVM volumes
> for the OSDs, and I've done that (this is a test on a clean VM install to
> eliminate any leftovers from my previous cluster):
>
> osda1 vg3 -wi-a----- 13.50g
> osda2 vg3 -wi-a----- 13.50g
> osda3 vg3 -wi-a----- 13.50g
> osda4 vg3 -wi-a----- 13.50g
>
> I configured osd.yml to include:
>
> osd_scenario: lvm
> osd_objectstore: bluestore
> lvm_volumes:
> - data: osda1
> data_vg: vg3
> - data: osda2
> data_vg: vg3
> - data: osda3
> data_vg: vg3
> - data: osda4
> data_vg: vg3
>
> and I see some OSD tasks being run by ansible, but there doesn't seem to be
> a startup script enabled for OSDs, and no OSD containers are running:
>
> [root@ceph1 jacob]# systemctl | grep ceph
> ceph-mgr@ceph1.service loaded active running Ceph Manager
> ceph-mon@ceph1.service loaded active running Ceph Monitor
> system-ceph\x2dmgr.slice loaded active active system-ceph\x2dmgr.slice
> system-ceph\x2dmon.slice loaded active active system-ceph\x2dmon.slice
>
> [root@ceph1 jacob]# docker ps
> CONTAINER ID IMAGE COMMAND CREATED STATUS
> PORTS NAMES
> 037197ef9bac docker.io/ceph/daemon:latest "/entrypoint.sh" 5
> minutes ago Up 5 minutes ceph-mgr-ceph1
> 4947e5c1c544 docker.io/ceph/daemon:latest "/entrypoint.sh" 17
> minutes ago Up 17 minutes ceph-mon-ceph1
>
> all.yml is configured for Docker:
>
> ceph_origin: repository
> ceph_repository: community
> ceph_stable_release: luminous
> fsid: "{{ cluster_uuid.stdout }}"
> generate_fsid: true
> monitor_interface: eth0
> public_network: 192.168.122.0/24
> cluster_network: 192.168.122.0/24
> ceph_tcmalloc_max_total_thread_cache: 134217728
> mon_containerized_deployment: true
> osd_containerized_deployment: true
> docker: true
> containerized_deployment: true
>
> Does ceph-ansible support LVM OSDs using Docker?
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
