On Thu, Jun 14, 2018 at 8:52 AM, John Spray <jspray@xxxxxxxxxx> wrote: > On Fri, Jun 1, 2018 at 5:44 PM, Vasu Kulkarni <vakulkar@xxxxxxxxxx> wrote: >> Hi Folks, >> >> In the qa suites, We have been relying on Ceph task for long time and >> quite frankly it has done excellent job of setting up cluster for >> various upper layer tests which don't care how the cluster >> is setup. >> >> I am now proposing where possible we start taking out Ceph Task and >> replace this with Ceph-Ansible Task and fix the roles to properly work >> with ceph-ansible task, this will help >> us test more like customer scenario's, make it easy to consume new >> features(eg: ceph-volume, vdo etc) there are few things to fix in >> role's for each cluster that is setup using ceph-ansible >> >> a) multiple mon's or multiple mds cannot exist in same node and should >> be put on different node), also look into how active/standy mds are setup >> using ceph-ansible and use them appropriately in config. > > I'm late to the thread, but wanted to mention that I seem to recall > the "one MDS per server" limitation coming up in some discussions > about the mgr orchestrator interface too -- iirc it was not thought a > big deal to enhance ceph-ansible to be able to do multiple MDS daemons > on one server, rather than sticking to the limitation. various systemd scripts should also be fixed because they assume its one role/node for those daemons along with any directory structure that happens during pre configuration step for various deploy methods. > > Cheers, > John > >> b) Daemon helper was another thing that was holding use of >> Ceph-Ansible task, but I have tested a fix in my personal branch and >> it seems to be working as long as we fix the roles >> >> c) for Dual Cluster setup we can continue to use old style Ceph Task, >> we recommend not to use different cluster names in ceph-deploy or >> ceph-ansible due to systemd issues. >> >> d) upgrades can also use the ceph-ansible task with cluster role fix. >> ( the inital cluster is setup using ceph-ansible but then later on we >> can still rely on old style apt-get update/yum update to >> update individual nodes, behind the scenes systemd will handle the daemons) >> >> I will update the Smoke suite to use ceph-ansible by default for all >> tests and see how the trial runs work, Ideally we could move 50 to 60% >> of the tests that can use ceph-ansible and rest can still rely on old >> style so that we have good mix of overall deployment tests. >> >> Feedback welcome >> >> Thanks >> Vasu >> -- >> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in >> the body of a message to majordomo@xxxxxxxxxxxxxxx >> More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
