Hello Sylvain, We have tried this using the guidelines but the deployment fails at NOVA while using Victoria as the version. HOWEVER when we deploy with Wallaby the deployment gets successful but the Glance, cinder and nova services are down. Regards On Tue, Jul 13, 2021 at 5:23 PM Michel Niyoyita <micou12@xxxxxxxxx> wrote: > Thanks for your guidance Sylvain > > Regards > > On Tue, Jul 13, 2021 at 5:18 PM <sylvain.desbureaux@xxxxxxxxxx> wrote: > >> I'm using : >> * ubuntu 20.04 as OS for all the servers (control, compute, storage), >> * "ubuntu" and "source" as target for kolla ansible (version victoria for >> now) >> * cephadm for ceph (started with v15.2.8, now I'm on v16.2.5) >> >> the installation was very smooth when I did. >> ------------------------------ >> *De :* Michel Niyoyita [micou12@xxxxxxxxx] >> *Envoyé :* mardi 13 juillet 2021 17:02 >> *À :* DESBUREAUX Sylvain INNOV/NET >> *Cc :* Nathan Harper; ceph-users@xxxxxxx; tony.karera@xxxxxx >> *Objet :* Re: Re: integration of openstack with ceph >> >> Dear Sylvain , >> >> Which OS are you using and versions for both ? >> >> Regards >> >> Michel >> >> On Tue, Jul 13, 2021 at 3:48 PM <sylvain.desbureaux@xxxxxxxxxx> wrote: >> >>> Hi, I'm using the same configuration (kolla - ansible victoria version + >>> ceph as backend) >>> >>> I use the following overrides: >>> >>> enable_redis: "yes" # for cinder ceph backend >>> ceph_nova_keyring: ceph.client.nova.keyring >>> glance_backend_ceph: "yes" >>> cinder_backend_ceph: "yes" >>> nova_backend_ceph: "yes" >>> >>> >>> I've also in /etc/kolla/config/cinder/ a minimal ceph.conf file, and the >>> keyring for cinder backup and cinder: >>> >>> . >>> ├── ceph.conf >>> ├── cinder-backup >>> │ ├── ceph.client.cinder-backup.keyring >>> │ └── ceph.client.cinder.keyring >>> └── cinder-volume >>> └── ceph.client.cinder.keyring >>> >>> for nova, I've got the following in /etc/kolla/config/nova: >>> >>> . >>> ├── ceph.client.cinder.keyring >>> ├── ceph.client.nova.keyring >>> └── ceph.conf >>> >>> and for glance in /etc/kolla/config/glance: >>> >>> . >>> ├── ceph.client.glance.keyring >>> └── ceph.conf >>> >>> I've also an override for volumes as I've got several volume types in >>> cinder but I think it doesn't change anything here. >>> >>> >>> >>> ________________________________________ >>> De : Michel Niyoyita [micou12@xxxxxxxxx] >>> Envoyé : mardi 13 juillet 2021 15:23 >>> À : Nathan Harper >>> Cc : ceph-users@xxxxxxx; tony.karera@xxxxxx >>> Objet : Re: integration of openstack with ceph >>> >>> Dear Nathan, >>> >>> Thanks for your reply, but how have you resolved the issue? we tried many >>> times crosschecking usernames and pools and find are fine. >>> >>> Regards. >>> >>> Michel >>> >>> >>> >>> >>> >>> On Tue, Jul 13, 2021 at 3:16 PM Nathan Harper <nathan.harper@xxxxxxxxxxx >>> > >>> wrote: >>> >>> > We ran into problems doing the same a while ago, so I don't know if the >>> > Kolla-Ansible has been fixed or not, but we found that there were some >>> bits >>> > of hardcoded configuration. Check to see if the templated cinder and >>> > glance configuration files contain the right username and pool names - >>> that >>> > would be my first suggestion. >>> > >>> > On Tue, 13 Jul 2021 at 14:08, Michel Niyoyita <micou12@xxxxxxxxx> >>> wrote: >>> > >>> >> Hello Nathan, >>> >> >>> >> We are using an existing cluster and we have already created pools and >>> >> users. >>> >> >>> >> Regards >>> >> >>> >> On Tue, Jul 13, 2021 at 3:03 PM Nathan Harper < >>> nathan.harper@xxxxxxxxxxx> >>> >> wrote: >>> >> >>> >>> are connecting a Kolla deployment to an existing Ceph cluster, or >>> using >>> >>> Kolla to deploy Ceph too? >>> >>> >>> >>> On Tue, 13 Jul 2021 at 13:41, Michel Niyoyita <micou12@xxxxxxxxx> >>> wrote: >>> >>> >>> >>>> Dear Ceph users, >>> >>>> >>> >>>> I am trying to integrate openstack with ceph but I am facing some >>> >>>> issues on >>> >>>> glance and cinder . I am using Kolla ansible to deploy openstack . >>> >>>> please I >>> >>>> need your advises and find below the errors I am getting. >>> >>>> >>> >>>> >>> >>>> WARNING glance_store.driver >>> [req-6faa6609-66b3-4de2-9980-4206691081bf >>> >>>> 9552afabab8f4d438e462b69ec6b8ce4 ab25f6704b2e4a91af5e34d594503a60 - >>> >>>> default >>> >>>> default] Failed to configure store correctly: Store rbd could not be >>> >>>> configured correctly. Reason: Error in store configuration: [errno >>> 1] >>> >>>> RADOS >>> >>>> permission error (error connecting to the cluster) Disabling add >>> >>>> method.: >>> >>>> glance_store.exceptions.BadStoreConfiguration: Store rbd could not >>> be >>> >>>> configured correctly. Reason: Error in store configuration: [errno >>> 1] >>> >>>> RADOS >>> >>>> permission error (error connecting to the cluster) >>> >>>> 2021-07-13 04:11:49.696 34 INFO glance.api.v2.image_data >>> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf >>> >>>> 9552afabab8f4d438e462b69ec6b8ce4 >>> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Unable to create >>> >>>> trust: >>> >>>> no such option collect_timing in group [keystone_authtoken] Use the >>> >>>> existing user token. >>> >>>> 2021-07-13 04:11:49.748 34 WARNING glance_store.driver >>> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf >>> >>>> 9552afabab8f4d438e462b69ec6b8ce4 >>> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Failed to >>> configure >>> >>>> store correctly: Store rbd could not be configured correctly. >>> Reason: >>> >>>> Error >>> >>>> in store configuration: [errno 1] RADOS permission error (error >>> >>>> connecting >>> >>>> to the cluster) Disabling add method.: >>> >>>> glance_store.exceptions.BadStoreConfiguration: Store rbd could not >>> be >>> >>>> configured correctly. Reason: Error in store configuration: [errno >>> 1] >>> >>>> RADOS >>> >>>> permission error (error connecting to the cluster) >>> >>>> 2021-07-13 04:11:49.749 34 ERROR glance.api.v2.image_data >>> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf >>> >>>> 9552afabab8f4d438e462b69ec6b8ce4 >>> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Error in store >>> >>>> configuration. Adding images to store is disabled.: >>> >>>> glance_store.exceptions.StoreAddDisabled: Configuration for store >>> >>>> failed. >>> >>>> Adding images to this store is disabled. >>> >>>> 2021-07-13 04:11:49.749 34 ERROR glance.api.v2.image_data Traceback >>> >>>> (most >>> >>>> recent call last): >>> >>>> >>> >>>> >>> >>>> >>> >>>> client.connect() >>> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd File >>> >>>> "rados.pyx", line 673, in rados.Rados.connect >>> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd >>> >>>> rados.PermissionDeniedError: [errno 13] RADOS permission denied >>> (error >>> >>>> connecting to the cluster) >>> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd >>> >>>> 2021-07-13 04:00:16.636 30 ERROR cinder.volume.drivers.rbd >>> >>>> [req-8b32eb35-44ce-4855-b0a0-40dd2d6ed5a5 - - - - -] Error >>> connecting to >>> >>>> ceph cluster.: rados.PermissionDeniedError: [errno 13] RADOS >>> permission >>> >>>> denied (error connecting to the cluster) >>> >>>> >>> >>>> >>> >>>> 2021-07-13T14:32:21.970+0200 7f8c9875e700 0 cephx server >>> client.glance: >>> >>>> handle_request failed to decode CephXAuthenticate: >>> buffer::end_of_buffer >>> >>>> 2021-07-13T14:32:21.974+0200 7f8c93f55700 0 cephx server >>> client.glance: >>> >>>> handle_request failed to decode CephXAuthenticate: >>> buffer::end_of_buffer >>> >>>> 2021-07-13T14:32:22.138+0200 7f8c93f55700 0 cephx server >>> client.glance: >>> >>>> handle_request failed to decode CephXAuthenticate: >>> buffer::end_of_buffer >>> >>>> _______________________________________________ >>> >>>> ceph-users mailing list -- ceph-users@xxxxxxx >>> >>>> To unsubscribe send an email to ceph-users-leave@xxxxxxx >>> >>>> >>> >>> >>> >>> >>> >>> -- >>> >>> *Nathan Harper* // IT Systems Lead >>> >>> >>> >>> *e: *nathan.harper@xxxxxxxxxxx *t*: 0117 906 1104 *m*: 0787 551 >>> >>> 0891 *w: *www.cfms.org.uk >>> >>> CFMS Services Ltd // Bristol & Bath Science Park // Dirac Crescent >>> // Emersons >>> >>> Green // Bristol // BS16 7FR >>> >>> >>> >>> < >>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >>> > >>> >>> < >>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >>> > >>> >>> < >>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >>> .> >>> >>> < >>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >>> .> >>> >>> < >>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >>> .> >>> >>> < >>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >>> .> >>> >>> < >>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >>> .> >>> >>> >>> >> >>> > >>> > -- >>> > *Nathan Harper* // IT Systems Lead >>> > >>> > *e: *nathan.harper@xxxxxxxxxxx *t*: 0117 906 1104 *m*: 0787 551 >>> 0891 >>> > *w: *www.cfms.org.uk >>> > CFMS Services Ltd // Bristol & Bath Science Park // Dirac Crescent // >>> Emersons >>> > Green // Bristol // BS16 7FR >>> > >>> > < >>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >>> > >>> > < >>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop >>> > >>> > < >>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >>> .> >>> > < >>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page >>> .> >>> > < >>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >>> .> >>> > < >>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >>> .> >>> > < >>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking >>> .> >>> > >>> _______________________________________________ >>> ceph-users mailing list -- ceph-users@xxxxxxx >>> To unsubscribe send an email to ceph-users-leave@xxxxxxx >>> >>> >>> _________________________________________________________________________________________________________________________ >>> >>> Ce message et ses pieces jointes peuvent contenir des informations >>> confidentielles ou privilegiees et ne doivent donc >>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez >>> recu ce message par erreur, veuillez le signaler >>> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages >>> electroniques etant susceptibles d'alteration, >>> Orange decline toute responsabilite si ce message a ete altere, deforme >>> ou falsifie. Merci. >>> >>> This message and its attachments may contain confidential or privileged >>> information that may be protected by law; >>> they should not be distributed, used or copied without authorisation. >>> If you have received this email in error, please notify the sender and >>> delete this message and its attachments. >>> As emails may be altered, Orange is not liable for messages that have >>> been modified, changed or falsified. >>> Thank you. >>> >>> _________________________________________________________________________________________________________________________ >> >> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc >> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler >> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, >> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. >> >> This message and its attachments may contain confidential or privileged information that may be protected by law; >> they should not be distributed, used or copied without authorisation. >> If you have received this email in error, please notify the sender and delete this message and its attachments. >> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. >> Thank you. >> >> _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |