Re: integration of openstack with ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks for your guidance Sylvain

Regards

On Tue, Jul 13, 2021 at 5:18 PM <sylvain.desbureaux@xxxxxxxxxx> wrote:

> I'm using :
> * ubuntu 20.04 as OS for all the servers (control, compute, storage),
> * "ubuntu" and "source" as target for kolla ansible (version victoria for
> now)
> * cephadm for ceph (started with v15.2.8, now I'm on v16.2.5)
>
> the installation was very smooth when I did.
> ------------------------------
> *De :* Michel Niyoyita [micou12@xxxxxxxxx]
> *Envoyé :* mardi 13 juillet 2021 17:02
> *À :* DESBUREAUX Sylvain INNOV/NET
> *Cc :* Nathan Harper; ceph-users@xxxxxxx; tony.karera@xxxxxx
> *Objet :* Re:  Re: integration of openstack with ceph
>
> Dear Sylvain ,
>
> Which OS are you using and versions for both ?
>
> Regards
>
> Michel
>
> On Tue, Jul 13, 2021 at 3:48 PM <sylvain.desbureaux@xxxxxxxxxx> wrote:
>
>> Hi, I'm using the same configuration (kolla - ansible victoria version +
>> ceph as backend)
>>
>> I use the following overrides:
>>
>> enable_redis: "yes" # for cinder ceph backend
>> ceph_nova_keyring: ceph.client.nova.keyring
>> glance_backend_ceph: "yes"
>> cinder_backend_ceph: "yes"
>> nova_backend_ceph: "yes"
>>
>>
>> I've also in /etc/kolla/config/cinder/ a minimal ceph.conf file, and the
>> keyring for cinder backup and cinder:
>>
>> .
>> ├── ceph.conf
>> ├── cinder-backup
>> │   ├── ceph.client.cinder-backup.keyring
>> │   └── ceph.client.cinder.keyring
>> └── cinder-volume
>>     └── ceph.client.cinder.keyring
>>
>> for nova, I've got the following in /etc/kolla/config/nova:
>>
>> .
>> ├── ceph.client.cinder.keyring
>> ├── ceph.client.nova.keyring
>> └── ceph.conf
>>
>> and for glance in /etc/kolla/config/glance:
>>
>> .
>> ├── ceph.client.glance.keyring
>> └── ceph.conf
>>
>> I've also an override for volumes as I've got several volume types in
>> cinder but I think it doesn't change anything here.
>>
>>
>>
>> ________________________________________
>> De : Michel Niyoyita [micou12@xxxxxxxxx]
>> Envoyé : mardi 13 juillet 2021 15:23
>> À : Nathan Harper
>> Cc : ceph-users@xxxxxxx; tony.karera@xxxxxx
>> Objet :  Re: integration of openstack with ceph
>>
>> Dear Nathan,
>>
>> Thanks for your reply, but how have you resolved the issue? we tried many
>> times crosschecking usernames and pools and find are fine.
>>
>> Regards.
>>
>> Michel
>>
>>
>>
>>
>>
>> On Tue, Jul 13, 2021 at 3:16 PM Nathan Harper <nathan.harper@xxxxxxxxxxx>
>> wrote:
>>
>> > We ran into problems doing the same a while ago, so I don't know if the
>> > Kolla-Ansible has been fixed or not, but we found that there were some
>> bits
>> > of hardcoded configuration.  Check to see if the templated cinder and
>> > glance configuration files contain the right username and pool names -
>> that
>> > would be my first suggestion.
>> >
>> > On Tue, 13 Jul 2021 at 14:08, Michel Niyoyita <micou12@xxxxxxxxx>
>> wrote:
>> >
>> >> Hello Nathan,
>> >>
>> >> We are using an existing cluster and we have already created pools and
>> >> users.
>> >>
>> >> Regards
>> >>
>> >> On Tue, Jul 13, 2021 at 3:03 PM Nathan Harper <
>> nathan.harper@xxxxxxxxxxx>
>> >> wrote:
>> >>
>> >>> are connecting a Kolla deployment to an existing Ceph cluster, or
>> using
>> >>> Kolla to deploy Ceph too?
>> >>>
>> >>> On Tue, 13 Jul 2021 at 13:41, Michel Niyoyita <micou12@xxxxxxxxx>
>> wrote:
>> >>>
>> >>>> Dear Ceph users,
>> >>>>
>> >>>> I am trying to integrate openstack with ceph but I am facing some
>> >>>> issues on
>> >>>> glance and cinder . I am using Kolla ansible to deploy openstack .
>> >>>> please I
>> >>>> need your advises and find below the errors I am getting.
>> >>>>
>> >>>>
>> >>>> WARNING glance_store.driver [req-6faa6609-66b3-4de2-9980-4206691081bf
>> >>>> 9552afabab8f4d438e462b69ec6b8ce4 ab25f6704b2e4a91af5e34d594503a60 -
>> >>>> default
>> >>>> default] Failed to configure store correctly: Store rbd could not be
>> >>>> configured correctly. Reason: Error in store configuration: [errno 1]
>> >>>> RADOS
>> >>>> permission error (error connecting to the cluster) Disabling add
>> >>>> method.:
>> >>>> glance_store.exceptions.BadStoreConfiguration: Store rbd could not be
>> >>>> configured correctly. Reason: Error in store configuration: [errno 1]
>> >>>> RADOS
>> >>>> permission error (error connecting to the cluster)
>> >>>> 2021-07-13 04:11:49.696 34 INFO glance.api.v2.image_data
>> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf
>> >>>> 9552afabab8f4d438e462b69ec6b8ce4
>> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Unable to create
>> >>>> trust:
>> >>>> no such option collect_timing in group [keystone_authtoken] Use the
>> >>>> existing user token.
>> >>>> 2021-07-13 04:11:49.748 34 WARNING glance_store.driver
>> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf
>> >>>> 9552afabab8f4d438e462b69ec6b8ce4
>> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Failed to
>> configure
>> >>>> store correctly: Store rbd could not be configured correctly. Reason:
>> >>>> Error
>> >>>> in store configuration: [errno 1] RADOS permission error (error
>> >>>> connecting
>> >>>> to the cluster) Disabling add method.:
>> >>>> glance_store.exceptions.BadStoreConfiguration: Store rbd could not be
>> >>>> configured correctly. Reason: Error in store configuration: [errno 1]
>> >>>> RADOS
>> >>>> permission error (error connecting to the cluster)
>> >>>> 2021-07-13 04:11:49.749 34 ERROR glance.api.v2.image_data
>> >>>> [req-6faa6609-66b3-4de2-9980-4206691081bf
>> >>>> 9552afabab8f4d438e462b69ec6b8ce4
>> >>>> ab25f6704b2e4a91af5e34d594503a60 - default default] Error in store
>> >>>> configuration. Adding images to store is disabled.:
>> >>>> glance_store.exceptions.StoreAddDisabled: Configuration for store
>> >>>> failed.
>> >>>> Adding images to this store is disabled.
>> >>>> 2021-07-13 04:11:49.749 34 ERROR glance.api.v2.image_data Traceback
>> >>>> (most
>> >>>> recent call last):
>> >>>>
>> >>>>
>> >>>>
>> >>>>    client.connect()
>> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd   File
>> >>>> "rados.pyx", line 673, in rados.Rados.connect
>> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd
>> >>>> rados.PermissionDeniedError: [errno 13] RADOS permission denied
>> (error
>> >>>> connecting to the cluster)
>> >>>> 2021-07-13 04:00:11.608 30 ERROR cinder.volume.drivers.rbd
>> >>>> 2021-07-13 04:00:16.636 30 ERROR cinder.volume.drivers.rbd
>> >>>> [req-8b32eb35-44ce-4855-b0a0-40dd2d6ed5a5 - - - - -] Error
>> connecting to
>> >>>> ceph cluster.: rados.PermissionDeniedError: [errno 13] RADOS
>> permission
>> >>>> denied (error connecting to the cluster)
>> >>>>
>> >>>>
>> >>>> 2021-07-13T14:32:21.970+0200 7f8c9875e700  0 cephx server
>> client.glance:
>> >>>> handle_request failed to decode CephXAuthenticate:
>> buffer::end_of_buffer
>> >>>> 2021-07-13T14:32:21.974+0200 7f8c93f55700  0 cephx server
>> client.glance:
>> >>>> handle_request failed to decode CephXAuthenticate:
>> buffer::end_of_buffer
>> >>>> 2021-07-13T14:32:22.138+0200 7f8c93f55700  0 cephx server
>> client.glance:
>> >>>> handle_request failed to decode CephXAuthenticate:
>> buffer::end_of_buffer
>> >>>> _______________________________________________
>> >>>> ceph-users mailing list -- ceph-users@xxxxxxx
>> >>>> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>> >>>>
>> >>>
>> >>>
>> >>> --
>> >>> *Nathan Harper* // IT Systems Lead
>> >>>
>> >>> *e: *nathan.harper@xxxxxxxxxxx   *t*: 0117 906 1104  *m*:  0787 551
>> >>> 0891  *w: *www.cfms.org.uk
>> >>> CFMS Services Ltd // Bristol & Bath Science Park // Dirac Crescent //
>> Emersons
>> >>> Green // Bristol // BS16 7FR
>> >>>
>> >>> <
>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop
>> >
>> >>> <
>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop
>> >
>> >>> <
>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page
>> .>
>> >>> <
>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page
>> .>
>> >>> <
>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking
>> .>
>> >>> <
>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking
>> .>
>> >>> <
>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking
>> .>
>> >>>
>> >>
>> >
>> > --
>> > *Nathan Harper* // IT Systems Lead
>> >
>> > *e: *nathan.harper@xxxxxxxxxxx   *t*: 0117 906 1104  *m*:  0787 551
>> 0891
>> > *w: *www.cfms.org.uk
>> > CFMS Services Ltd // Bristol & Bath Science Park // Dirac Crescent //
>> Emersons
>> > Green // Bristol // BS16 7FR
>> >
>> > <
>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop
>> >
>> > <
>> https://cfms.org.uk/media/384108/email-footer-darren-swift.png?width=500&height=115&mode=crop
>> >
>> > <
>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page
>> .>
>> > <
>> https://cfms.org.uk/industry-themes/smart-infrastructure/?utm_source=email&utm_medium=gmail-footer&utm_campaign=infrastructure&utm_content=landing-page
>> .>
>> > <
>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking
>> .>
>> > <
>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking
>> .>
>> > <
>> https://cfms.org.uk/news-events-opinions/opinions/2021/may/make-the-most-of-automation-with-open-networking/?utm_source=email&utm_medium=gmail-footer&utm_campaign=opinions&utm_content=open-networking
>> .>
>> >
>> _______________________________________________
>> ceph-users mailing list -- ceph-users@xxxxxxx
>> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>>
>>
>> _________________________________________________________________________________________________________________________
>>
>> Ce message et ses pieces jointes peuvent contenir des informations
>> confidentielles ou privilegiees et ne doivent donc
>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez
>> recu ce message par erreur, veuillez le signaler
>> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages
>> electroniques etant susceptibles d'alteration,
>> Orange decline toute responsabilite si ce message a ete altere, deforme
>> ou falsifie. Merci.
>>
>> This message and its attachments may contain confidential or privileged
>> information that may be protected by law;
>> they should not be distributed, used or copied without authorisation.
>> If you have received this email in error, please notify the sender and
>> delete this message and its attachments.
>> As emails may be altered, Orange is not liable for messages that have
>> been modified, changed or falsified.
>> Thank you.
>>
>> _________________________________________________________________________________________________________________________
>
> Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or privileged information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
> Thank you.
>
>
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux