Thanks for your guidance Sylvain Regards On Tue, Jul 13, 2021 at 5:18 PM <sylvain.desbureaux@xxxxxxxxxx> wrote: > I'm using : > * ubuntu 20.04 as OS for all the servers (control, compute, storage), > * "ubuntu" and "source" as target for kolla ansible (version victoria for > now) > * cephadm for ceph (started with v15.2.8, now I'm on v16.2.5) > > the installation was very smooth when I did. > ------------------------------ > *De :* Michel Niyoyita [micou12@xxxxxxxxx] > *Envoyé :* mardi 13 juillet 2021 17:02 > *À :* DESBUREAUX Sylvain INNOV/NET > *Cc :* Nathan Harper; ceph-users@xxxxxxx; tony.karera@xxxxxx > *Objet :* Re: Re: integration of openstack with ceph > > Dear Sylvain , > > Which OS are you using and versions for both ? > > Regards > > Michel > > On Tue, Jul 13, 2021 at 3:48 PM <sylvain.desbureaux@xxxxxxxxxx> wrote: > >> Hi, I'm using the same configuration (kolla - ansible victoria version + >> ceph as backend) >> >> I use the following overrides: >> >> enable_redis: "yes" # for cinder ceph backend >> ceph_nova_keyring: ceph.client.nova.keyring >> glance_backend_ceph: "yes" >> cinder_backend_ceph: "yes" >> nova_backend_ceph: "yes" >> >> >> I've also in /etc/kolla/config/cinder/ a minimal ceph.conf file, and the >> keyring for cinder backup and cinder: >> >> . >> ├── ceph.conf >> ├── cinder-backup >> │ ├── ceph.client.cinder-backup.keyring >> │ └── ceph.client.cinder.keyring >> └── cinder-volume >> └── ceph.client.cinder.keyring >> >> for nova, I've got the following in /etc/kolla/config/nova: >> >> . >> ├── ceph.client.cinder.keyring >> ├── ceph.client.nova.keyring >> └── ceph.conf >> >> and for glance in /etc/kolla/config/glance: >> >> . >> ├── ceph.client.glance.keyring >> └── ceph.conf >> >> I've also an override for volumes as I've got several volume types in >> cinder but I think it doesn't change anything here. >> >> >> >> ________________________________________ >> De : Michel Niyoyita [micou12@xxxxxxxxx] >> Envoyé : mardi 13 juillet 2021 15:23 >> À : Nathan Harper >> Cc : ceph-users@xxxxxxx; tony.karera@xxxxxx >> Objet : Re: integration of openstack with ceph >> >> Dear Nathan, >> >> Thanks for your reply, but how have you resolved the issue? we tried many >> times crosschecking usernames and pools and find are fine. >> >> Regards. >> >> Michel >> >> >> >> >> >> On Tue, Jul 13, 2021 at 3:16 PM Nathan Harper <nathan.harper@xxxxxxxxxxx> >> wrote: >> >> > We ran into problems doing the same a while ago, so I don't know if the >> > Kolla-Ansible has been fixed or not, but we found that there were some >> bits >> > of hardcoded configuration. Check to see if the templated cinder and >> > glance configuration files contain the right username and pool names - >> that >> > would be my first suggestion. >> > >> > On Tue, 13 Jul 2021 at 14:08, Michel Niyoyita <micou12@xxxxxxxxx> >> wrote: >> > >> >> Hello Nathan, >> >> >> >> We are using an existing cluster and we have already created pools and >> >> users. >> >> >> >> Regards >> >> >> >> On Tue, Jul 13, 2021 at 3:03 PM Nathan Harper < >> nathan.harper@xxxxxxxxxxx> >> >> wrote: >> >> >> >>> are connecting a Kolla deployment to an existing Ceph cluster, or >> using >> >>> Kolla to deploy Ceph too? >> >>> >> >>> On Tue, 13 Jul 2021 at 13:41, Michel Niyoyita <micou12@xxxxxxxxx> >> wrote: >> >>> >> >>>> Dear Ceph users, >> >>>> >> >>>> I am trying to integrate openstack with ceph but I am facing some >> >>>> issues on >> >>>> glance and cinder . I am using Kolla ansible to deploy openstack . >> >>>> please I >> >>>> need your advises and find below the errors I am getting. >> >>>> >> >>>> >> >>>> WARNING glance_store.driver [req-6faa6609-66b3-4de2-9980-4206691081bf >> >>>> 9552afabab8f4d438e462b69ec6b8ce4 ab25f6704b2e4a91af5e34d594503a60 - >> >>>> default >> >>>> default] Failed to configure store correctly: Store rbd could not be >> >>>> configured correctly. Reason: Error in store configuration: [errno 1] >> >>>> RADOS >> >>>> permission error (error connecting to the cluster) Disabling add >> >>>> method.: >> >>>> glance_store.exceptions.BadStoreConfiguration: Store rbd could not be >> >>>> configured correctly. Reason: Error in store configuration: [errno 1] >> >>>> RADOS >> >>>> permission error (error connecting to the cluster) >> >>>> 2021-07-13 04:11:49.696 34 INFO glance.api.v2.image_data >> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf >> >>>> 9552afabab8f4d438e462b69ec6b8ce4 >> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Unable to create >> >>>> trust: >> >>>> no such option collect_timing in group [keystone_authtoken] Use the >> >>>> existing user token. >> >>>> 2021-07-13 04:11:49.748 34 WARNING glance_store.driver >> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf >> >>>> 9552afabab8f4d438e462b69ec6b8ce4 >> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Failed to >> configure >> >>>> store correctly: Store rbd could not be configured correctly. Reason: >> >>>> Error >> >>>> in store configuration: [errno 1] RADOS permission error (error >> >>>> connecting >> >>>> to the cluster) Disabling add method.: >> >>>> glance_store.exceptions.BadStoreConfiguration: Store rbd could not be >> >>>> configured correctly. Reason: Error in store configuration: [errno 1] >> >>>> RADOS >> >>>> permission error (error connecting to the cluster) >> >>>> 2021-07-13 04:11:49.749 34 ERROR glance.api.v2.image_data >> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf >> >>>> 9552afabab8f4d438e462b69ec6b8ce4 >> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Error in store >> >>>> configuration. Adding images to store is disabled.: >> >>>> glance_store.exceptions.StoreAddDisabled: Configuration for store >> >>>> failed. >> >>>> Adding images to this store is disabled. >> >>>> 2021-07-13 04:11:49.749 34 ERROR glance.api.v2.image_data Traceback >> >>>> (most >> >>>> recent call last): >> >>>> >> >>>> >> >>>> >> >>>> client.connect() >> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd File >> >>>> "rados.pyx", line 673, in rados.Rados.connect >> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd >> >>>> rados.PermissionDeniedError: [errno 13] RADOS permission denied >> (error >> >>>> connecting to the cluster) >> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd >> >>>> 2021-07-13 04:00:16.636 30 ERROR cinder.volume.drivers.rbd >> >>>> [req-8b32eb35-44ce-4855-b0a0-40dd2d6ed5a5 - - - - -] Error >> connecting to >> >>>> ceph cluster.: rados.PermissionDeniedError: [errno 13] RADOS >> permission >> >>>> denied (error connecting to the cluster) >> >>>> >> >>>> >> >>>> 2021-07-13T14:32:21.970+0200 7f8c9875e700 0 cephx server >> client.glance: >> >>>> handle_request failed to decode CephXAuthenticate: >> buffer::end_of_buffer >> >>>> 2021-07-13T14:32:21.974+0200 7f8c93f55700 0 cephx server >> client.glance: >> >>>> handle_request failed to decode CephXAuthenticate: >> buffer::end_of_buffer >> >>>> 2021-07-13T14:32:22.138+0200 7f8c93f55700 0 cephx server >> client.glance: >> >>>> handle_request failed to decode CephXAuthenticate: >> buffer::end_of_buffer >> >>>> _______________________________________________ >> >>>> ceph-users mailing list -- ceph-users@xxxxxxx >> >>>> To unsubscribe send an email to ceph-users-leave@xxxxxxx >> >>>> >> >>> >> >>> >> >>> -- >> >>> *Nathan Harper* // IT Systems Lead >> >>> >> >>> *e: *nathan.harper@xxxxxxxxxxx *t*: 0117 906 1104 *m*: 0787 551 >> >>> 0891 *w: *www.cfms.org.uk >> >>> CFMS Services Ltd // Bristol & Bath Science Park // Dirac Crescent // >> Emersons >> >>> Green // Bristol // BS16 7FR >> >>> >> >>> < >> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >> > >> >>> < >> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >> > >> >>> < >> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >> .> >> >>> < >> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >> .> >> >>> < >> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >> .> >> >>> < >> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >> .> >> >>> < >> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >> .> >> >>> >> >> >> > >> > -- >> > *Nathan Harper* // IT Systems Lead >> > >> > *e: *nathan.harper@xxxxxxxxxxx *t*: 0117 906 1104 *m*: 0787 551 >> 0891 >> > *w: *www.cfms.org.uk >> > CFMS Services Ltd // Bristol & Bath Science Park // Dirac Crescent // >> Emersons >> > Green // Bristol // BS16 7FR >> > >> > < >> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >> > >> > < >> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >> > >> > < >> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >> .> >> > < >> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >> .> >> > < >> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >> .> >> > < >> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >> .> >> > < >> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >> .> >> > >> _______________________________________________ >> ceph-users mailing list -- ceph-users@xxxxxxx >> To unsubscribe send an email to ceph-users-leave@xxxxxxx >> >> >> _________________________________________________________________________________________________________________________ >> >> Ce message et ses pieces jointes peuvent contenir des informations >> confidentielles ou privilegiees et ne doivent donc >> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez >> recu ce message par erreur, veuillez le signaler >> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages >> electroniques etant susceptibles d'alteration, >> Orange decline toute responsabilite si ce message a ete altere, deforme >> ou falsifie. Merci. >> >> This message and its attachments may contain confidential or privileged >> information that may be protected by law; >> they should not be distributed, used or copied without authorisation. >> If you have received this email in error, please notify the sender and >> delete this message and its attachments. >> As emails may be altered, Orange is not liable for messages that have >> been modified, changed or falsified. >> Thank you. >> >> _________________________________________________________________________________________________________________________ > > Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc > pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler > a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, > Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. > > This message and its attachments may contain confidential or privileged information that may be protected by law; > they should not be distributed, used or copied without authorisation. > If you have received this email in error, please notify the sender and delete this message and its attachments. > As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. > Thank you. > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx