Re: Placement rule not resolved

[<ghislain.chevalier@xxxxxxxxxx>]

HI all,

 

I didn’t notice that osd reweight for ssd was curiously set to a low value.

I don’t know how and when these values were set so low.

Our environment is Mirantis-driven and the installation was powered by fuel and puppet.
(the installation was run by the openstack team and I checked the ceph cluster configuration afterwards)

 

After reweighing them to 1, the ceph-cluster is working properly.

Thanks to object lookup module of inkscope, I checked that the osd allocation was ok.

 

What is not normal is that crush tried to allocated osd that are not targeted by the rule in that case sas disks instead of ssd disks?

Must the cluster normal behavior ,i.e. the pg allocation, be  to be frozen?

I can say that because if I analyze the stuck pgs (inkscope module) and noticed that osd allocation for these pgs were either not correct (acting list) or uncomplete.

 

Best regards

 

De : ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] De la part de ghislain.chevalier@xxxxxxxxxx
Envoyé : mardi 6 octobre 2015 14:18
À : ceph-users
Objet : Placement rule not resolved

 

Hi,

 

Context:

Firefly 0.80.9

8 storage nodes

176 osds : 14*8 sas and 8*8 ssd

3 monitors

 

I create an alternate crushmap in order to fulfill tiering requirement i.e. select ssd or sas.

I created specific buckets “host-ssd” and “host-sas” and regroup them in “tier-ssd” and “tier-sas” under a “tier-root”

E.g. I want to select 1 ssd in 3 distinct hosts

 

I don’t understand why the placement rule for sas is working and not for ssd.

Sas are selected even if ,according to the crushmap,  they are not in the right tree.

When sometimes 3 ssd are selected, the pgs stay stuck but active

 

I attached the crushmap and ceph osd tree.

 

Can someone have a look and tell me where the default is?

 

Bgrds

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
ORANGE/IMT/OLPS/ASE/DAPI/CSE

Architecte de services d’infrastructure de stockage

Sofware-Defined Storage Architect
+33299124432

+33788624370
ghislain.chevalier@xxxxxxxxxx

P Pensez à l'Environnement avant d'imprimer ce message !

 

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.

Thank you.

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com