Placement rule not resolved

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

 

Context:

Firefly 0.80.9

8 storage nodes

176 osds : 14*8 sas and 8*8 ssd

3 monitors

 

I create an alternate crushmap in order to fulfill tiering requirement i.e. select ssd or sas.

I created specific buckets “host-ssd” and “host-sas” and regroup them in “tier-ssd” and “tier-sas” under a “tier-root”

E.g. I want to select 1 ssd in 3 distinct hosts

 

I don’t understand why the placement rule for sas is working and not for ssd.

Sas are selected even if ,according to the crushmap,  they are not in the right tree.

When sometimes 3 ssd are selected, the pgs stay stuck but active

 

I attached the crushmap and ceph osd tree.

 

Can someone have a look and tell me where the default is?

 

Bgrds

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
ORANGE/IMT/OLPS/ASE/DAPI/CSE

Architecte de services d’infrastructure de stockage

Sofware-Defined Storage Architect
+33299124432

+33788624370
ghislain.chevalier@xxxxxxxxxx

P Pensez à l'Environnement avant d'imprimer ce message !

 

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.
# begin crush map
tunable choose_local_tries 0
tunable choose_local_fallback_tries 0
tunable choose_total_tries 50
tunable chooseleaf_descend_once 1
tunable straw_calc_version 1

# devices
device 0 osd.0
device 1 osd.1
device 2 osd.2
device 3 osd.3
device 4 osd.4
device 5 osd.5
device 6 osd.6
device 7 osd.7
device 8 osd.8
device 9 osd.9
device 10 osd.10
device 11 osd.11
device 12 osd.12
device 13 osd.13
device 14 osd.14
device 15 osd.15
device 16 osd.16
device 17 osd.17
device 18 osd.18
device 19 osd.19
device 20 osd.20
device 21 osd.21
device 22 osd.22
device 23 osd.23
device 24 osd.24
device 25 osd.25
device 26 osd.26
device 27 osd.27
device 28 osd.28
device 29 osd.29
device 30 osd.30
device 31 osd.31
device 32 osd.32
device 33 osd.33
device 34 osd.34
device 35 osd.35
device 36 osd.36
device 37 osd.37
device 38 osd.38
device 39 osd.39
device 40 osd.40
device 41 osd.41
device 42 osd.42
device 43 osd.43
device 44 osd.44
device 45 osd.45
device 46 osd.46
device 47 osd.47
device 48 osd.48
device 49 osd.49
device 50 osd.50
device 51 osd.51
device 52 osd.52
device 53 osd.53
device 54 osd.54
device 55 osd.55
device 56 osd.56
device 57 osd.57
device 58 osd.58
device 59 osd.59
device 60 osd.60
device 61 osd.61
device 62 osd.62
device 63 osd.63
device 64 osd.64
device 65 osd.65
device 66 osd.66
device 67 osd.67
device 68 osd.68
device 69 osd.69
device 70 osd.70
device 71 osd.71
device 72 osd.72
device 73 osd.73
device 74 osd.74
device 75 osd.75
device 76 osd.76
device 77 osd.77
device 78 osd.78
device 79 osd.79
device 80 osd.80
device 81 osd.81
device 82 osd.82
device 83 osd.83
device 84 osd.84
device 85 osd.85
device 86 osd.86
device 87 osd.87
device 88 osd.88
device 89 osd.89
device 90 osd.90
device 91 osd.91
device 92 osd.92
device 93 osd.93
device 94 osd.94
device 95 osd.95
device 96 osd.96
device 97 osd.97
device 98 osd.98
device 99 osd.99
device 100 osd.100
device 101 osd.101
device 102 osd.102
device 103 osd.103
device 104 osd.104
device 105 osd.105
device 106 osd.106
device 107 osd.107
device 108 osd.108
device 109 osd.109
device 110 osd.110
device 111 osd.111
device 112 osd.112
device 113 osd.113
device 114 osd.114
device 115 osd.115
device 116 osd.116
device 117 osd.117
device 118 osd.118
device 119 osd.119
device 120 osd.120
device 121 osd.121
device 122 osd.122
device 123 osd.123
device 124 osd.124
device 125 osd.125
device 126 osd.126
device 127 osd.127
device 128 osd.128
device 129 osd.129
device 130 osd.130
device 131 osd.131
device 132 osd.132
device 133 osd.133
device 134 osd.134
device 135 osd.135
device 136 osd.136
device 137 osd.137
device 138 osd.138
device 139 osd.139
device 140 osd.140
device 141 osd.141
device 142 osd.142
device 143 osd.143
device 144 osd.144
device 145 osd.145
device 146 osd.146
device 147 osd.147
device 148 osd.148
device 149 osd.149
device 150 osd.150
device 151 osd.151
device 152 osd.152
device 153 osd.153
device 154 osd.154
device 155 osd.155
device 156 osd.156
device 157 osd.157
device 158 osd.158
device 159 osd.159
device 160 osd.160
device 161 osd.161
device 162 osd.162
device 163 osd.163
device 164 osd.164
device 165 osd.165
device 166 osd.166
device 167 osd.167
device 168 osd.168
device 169 osd.169
device 170 osd.170
device 171 osd.171
device 172 osd.172
device 173 osd.173
device 174 osd.174
device 175 osd.175

# types
type 0 osd
type 1 host
type 2 chassis
type 3 rack
type 4 row
type 5 pdu
type 6 pod
type 7 room
type 8 datacenter
type 9 region
type 10 root
type 100 host-ssd
type 200 host-sas
type 1000 tier

# buckets
host node-18 {
	id -18		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.0 weight 0.180
	item osd.5 weight 0.180
	item osd.6 weight 1.080
	item osd.10 weight 1.080
	item osd.11 weight 1.080
	item osd.12 weight 1.080
	item osd.16 weight 1.080
	item osd.18 weight 1.080
	item osd.20 weight 0.180
	item osd.25 weight 0.180
	item osd.28 weight 1.080
	item osd.30 weight 1.080
	item osd.36 weight 0.180
	item osd.39 weight 0.180
	item osd.42 weight 1.080
	item osd.45 weight 1.080
	item osd.49 weight 1.080
	item osd.51 weight 1.080
	item osd.54 weight 1.080
	item osd.57 weight 0.180
	item osd.60 weight 0.180
	item osd.63 weight 1.080
}
host node-20 {
	id -20		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.2 weight 1.080
	item osd.3 weight 0.180
	item osd.7 weight 0.180
	item osd.13 weight 1.080
	item osd.15 weight 1.080
	item osd.19 weight 1.080
	item osd.21 weight 1.080
	item osd.23 weight 0.180
	item osd.27 weight 1.080
	item osd.29 weight 0.180
	item osd.33 weight 1.080
	item osd.35 weight 0.180
	item osd.38 weight 1.080
	item osd.40 weight 1.080
	item osd.46 weight 1.080
	item osd.47 weight 1.080
	item osd.50 weight 1.080
	item osd.52 weight 0.180
	item osd.56 weight 1.080
	item osd.58 weight 1.080
	item osd.61 weight 0.180
	item osd.64 weight 0.180
}
host node-21 {
	id -21		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.1 weight 1.080
	item osd.4 weight 0.180
	item osd.8 weight 0.180
	item osd.9 weight 1.080
	item osd.14 weight 1.080
	item osd.17 weight 1.080
	item osd.22 weight 1.080
	item osd.24 weight 0.180
	item osd.26 weight 1.080
	item osd.31 weight 1.080
	item osd.32 weight 1.080
	item osd.34 weight 0.180
	item osd.37 weight 0.180
	item osd.41 weight 1.080
	item osd.43 weight 1.080
	item osd.44 weight 1.080
	item osd.48 weight 1.080
	item osd.53 weight 0.180
	item osd.55 weight 0.180
	item osd.59 weight 1.080
	item osd.62 weight 0.180
	item osd.65 weight 1.080
}
host node-22 {
	id -22		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.69 weight 1.080
	item osd.72 weight 0.180
	item osd.75 weight 1.080
	item osd.80 weight 0.180
	item osd.85 weight 1.080
	item osd.90 weight 0.180
	item osd.93 weight 0.180
	item osd.97 weight 1.080
	item osd.101 weight 1.080
	item osd.105 weight 1.080
	item osd.108 weight 1.080
	item osd.116 weight 1.080
	item osd.120 weight 1.080
	item osd.124 weight 0.180
	item osd.127 weight 1.080
	item osd.130 weight 1.080
	item osd.131 weight 0.180
	item osd.135 weight 1.080
	item osd.139 weight 0.180
	item osd.145 weight 1.080
	item osd.148 weight 1.080
	item osd.151 weight 0.180
}
room lodz-1 {
	id -71		# do not change unnecessarily
	# weight 66.240
	alg straw
	hash 0	# rjenkins1
	item node-18 weight 16.560
	item node-20 weight 16.560
	item node-21 weight 16.560
	item node-22 weight 16.560
}
host node-23 {
	id -23		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.70 weight 0.180
	item osd.76 weight 1.080
	item osd.78 weight 1.080
	item osd.83 weight 1.080
	item osd.84 weight 1.080
	item osd.88 weight 0.180
	item osd.91 weight 1.080
	item osd.95 weight 1.080
	item osd.99 weight 0.180
	item osd.104 weight 0.180
	item osd.107 weight 0.180
	item osd.109 weight 1.080
	item osd.112 weight 0.180
	item osd.114 weight 1.080
	item osd.119 weight 1.080
	item osd.126 weight 1.080
	item osd.134 weight 0.180
	item osd.138 weight 1.080
	item osd.142 weight 1.080
	item osd.146 weight 1.080
	item osd.150 weight 0.180
	item osd.152 weight 1.080
}
host node-24 {
	id -24		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.154 weight 1.080
	item osd.155 weight 0.180
	item osd.156 weight 1.080
	item osd.157 weight 0.180
	item osd.158 weight 1.080
	item osd.159 weight 1.080
	item osd.160 weight 1.080
	item osd.161 weight 1.080
	item osd.162 weight 0.180
	item osd.163 weight 1.080
	item osd.164 weight 0.180
	item osd.165 weight 1.080
	item osd.166 weight 1.080
	item osd.167 weight 0.180
	item osd.168 weight 0.180
	item osd.169 weight 1.080
	item osd.170 weight 1.080
	item osd.171 weight 0.180
	item osd.172 weight 1.080
	item osd.173 weight 1.080
	item osd.174 weight 0.180
	item osd.175 weight 1.080
}
host node-25 {
	id -25		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.66 weight 1.080
	item osd.68 weight 0.180
	item osd.73 weight 0.180
	item osd.77 weight 1.080
	item osd.81 weight 1.080
	item osd.86 weight 0.180
	item osd.89 weight 1.080
	item osd.92 weight 1.080
	item osd.98 weight 1.080
	item osd.102 weight 1.080
	item osd.106 weight 0.180
	item osd.111 weight 0.180
	item osd.115 weight 0.180
	item osd.118 weight 1.080
	item osd.122 weight 1.080
	item osd.128 weight 1.080
	item osd.132 weight 1.080
	item osd.137 weight 0.180
	item osd.140 weight 1.080
	item osd.144 weight 1.080
	item osd.149 weight 0.180
	item osd.153 weight 1.080
}
host node-26 {
	id -26		# do not change unnecessarily
	# weight 16.560
	alg straw
	hash 0	# rjenkins1
	item osd.67 weight 1.080
	item osd.71 weight 1.080
	item osd.74 weight 1.080
	item osd.79 weight 1.080
	item osd.82 weight 0.180
	item osd.87 weight 1.080
	item osd.94 weight 1.080
	item osd.96 weight 0.180
	item osd.100 weight 0.180
	item osd.103 weight 1.080
	item osd.110 weight 1.080
	item osd.113 weight 1.080
	item osd.117 weight 1.080
	item osd.121 weight 1.080
	item osd.123 weight 0.180
	item osd.125 weight 0.180
	item osd.129 weight 1.080
	item osd.133 weight 1.080
	item osd.136 weight 1.080
	item osd.141 weight 0.180
	item osd.143 weight 0.180
	item osd.147 weight 0.180
}
room lodz-2 {
	id -72		# do not change unnecessarily
	# weight 66.240
	alg straw
	hash 0	# rjenkins1
	item node-23 weight 16.560
	item node-24 weight 16.560
	item node-25 weight 16.560
	item node-26 weight 16.560
}
root default {
	id -1		# do not change unnecessarily
	# weight 132.480
	alg straw
	hash 0	# rjenkins1
	item lodz-1 weight 66.240
	item lodz-2 weight 66.240
}
host-ssd node-18-ssd {
	id -181		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.0 weight 0.180
	item osd.5 weight 0.180
	item osd.20 weight 0.180
	item osd.25 weight 0.180
	item osd.36 weight 0.180
	item osd.39 weight 0.180
	item osd.57 weight 0.180
	item osd.60 weight 0.180
}
host-sas node-18-sas {
	id -182		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.6 weight 1.080
	item osd.10 weight 1.080
	item osd.11 weight 1.080
	item osd.12 weight 1.080
	item osd.16 weight 1.080
	item osd.18 weight 1.080
	item osd.28 weight 1.080
	item osd.30 weight 1.080
	item osd.42 weight 1.080
	item osd.45 weight 1.080
	item osd.49 weight 1.080
	item osd.51 weight 1.080
	item osd.54 weight 1.080
	item osd.63 weight 1.080
}
host-ssd node-20-ssd {
	id -201		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.3 weight 0.180
	item osd.7 weight 0.180
	item osd.23 weight 0.180
	item osd.29 weight 0.180
	item osd.35 weight 0.180
	item osd.52 weight 0.180
	item osd.61 weight 0.180
	item osd.64 weight 0.180
}
host-sas node-20-sas {
	id -202		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.2 weight 1.080
	item osd.13 weight 1.080
	item osd.15 weight 1.080
	item osd.19 weight 1.080
	item osd.21 weight 1.080
	item osd.27 weight 1.080
	item osd.33 weight 1.080
	item osd.38 weight 1.080
	item osd.40 weight 1.080
	item osd.46 weight 1.080
	item osd.47 weight 1.080
	item osd.50 weight 1.080
	item osd.56 weight 1.080
	item osd.58 weight 1.080
}
host-ssd node-21-ssd {
	id -211		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.4 weight 0.180
	item osd.8 weight 0.180
	item osd.24 weight 0.180
	item osd.34 weight 0.180
	item osd.37 weight 0.180
	item osd.53 weight 0.180
	item osd.55 weight 0.180
	item osd.62 weight 0.180
}
host-sas node-21-sas {
	id -212		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.1 weight 1.080
	item osd.9 weight 1.080
	item osd.14 weight 1.080
	item osd.17 weight 1.080
	item osd.22 weight 1.080
	item osd.26 weight 1.080
	item osd.31 weight 1.080
	item osd.32 weight 1.080
	item osd.41 weight 1.080
	item osd.43 weight 1.080
	item osd.44 weight 1.080
	item osd.48 weight 1.080
	item osd.59 weight 1.080
	item osd.65 weight 1.080
}
host-ssd node-22-ssd {
	id -221		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.72 weight 0.180
	item osd.80 weight 0.180
	item osd.90 weight 0.180
	item osd.93 weight 0.180
	item osd.124 weight 0.180
	item osd.131 weight 0.180
	item osd.139 weight 0.180
	item osd.151 weight 0.180
}
host-sas node-22-sas {
	id -222		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.69 weight 1.080
	item osd.75 weight 1.080
	item osd.85 weight 1.080
	item osd.97 weight 1.080
	item osd.101 weight 1.080
	item osd.105 weight 1.080
	item osd.108 weight 1.080
	item osd.116 weight 1.080
	item osd.120 weight 1.080
	item osd.127 weight 1.080
	item osd.130 weight 1.080
	item osd.135 weight 1.080
	item osd.145 weight 1.080
	item osd.148 weight 1.080
}
host-ssd node-23-ssd {
	id -231		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.70 weight 0.180
	item osd.88 weight 0.180
	item osd.99 weight 0.180
	item osd.104 weight 0.180
	item osd.107 weight 0.180
	item osd.112 weight 0.180
	item osd.134 weight 0.180
	item osd.150 weight 0.180
}
host-sas node-23-sas {
	id -232		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.76 weight 1.080
	item osd.78 weight 1.080
	item osd.83 weight 1.080
	item osd.84 weight 1.080
	item osd.91 weight 1.080
	item osd.95 weight 1.080
	item osd.109 weight 1.080
	item osd.114 weight 1.080
	item osd.119 weight 1.080
	item osd.126 weight 1.080
	item osd.138 weight 1.080
	item osd.142 weight 1.080
	item osd.146 weight 1.080
	item osd.152 weight 1.080
}
host-ssd node-24-ssd {
	id -241		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.155 weight 0.180
	item osd.157 weight 0.180
	item osd.162 weight 0.180
	item osd.164 weight 0.180
	item osd.167 weight 0.180
	item osd.168 weight 0.180
	item osd.171 weight 0.180
	item osd.174 weight 0.180
}
host-sas node-24-sas {
	id -242		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.154 weight 1.080
	item osd.156 weight 1.080
	item osd.158 weight 1.080
	item osd.159 weight 1.080
	item osd.160 weight 1.080
	item osd.161 weight 1.080
	item osd.163 weight 1.080
	item osd.165 weight 1.080
	item osd.166 weight 1.080
	item osd.169 weight 1.080
	item osd.170 weight 1.080
	item osd.172 weight 1.080
	item osd.173 weight 1.080
	item osd.175 weight 1.080
}
host-ssd node-25-ssd {
	id -251		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.68 weight 0.180
	item osd.73 weight 0.180
	item osd.86 weight 0.180
	item osd.106 weight 0.180
	item osd.111 weight 0.180
	item osd.115 weight 0.180
	item osd.137 weight 0.180
	item osd.149 weight 0.180
}
host-sas node-25-sas {
	id -252		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.66 weight 1.080
	item osd.77 weight 1.080
	item osd.81 weight 1.080
	item osd.89 weight 1.080
	item osd.92 weight 1.080
	item osd.98 weight 1.080
	item osd.102 weight 1.080
	item osd.118 weight 1.080
	item osd.122 weight 1.080
	item osd.128 weight 1.080
	item osd.132 weight 1.080
	item osd.140 weight 1.080
	item osd.144 weight 1.080
	item osd.153 weight 1.080
}
host-ssd node-26-ssd {
	id -261		# do not change unnecessarily
	# weight 1.440
	alg straw
	hash 0	# rjenkins1
	item osd.82 weight 0.180
	item osd.96 weight 0.180
	item osd.100 weight 0.180
	item osd.123 weight 0.180
	item osd.125 weight 0.180
	item osd.141 weight 0.180
	item osd.143 weight 0.180
	item osd.147 weight 0.180
}
host-sas node-26-sas {
	id -262		# do not change unnecessarily
	# weight 15.120
	alg straw
	hash 0	# rjenkins1
	item osd.67 weight 1.080
	item osd.71 weight 1.080
	item osd.74 weight 1.080
	item osd.79 weight 1.080
	item osd.87 weight 1.080
	item osd.94 weight 1.080
	item osd.103 weight 1.080
	item osd.110 weight 1.080
	item osd.113 weight 1.080
	item osd.117 weight 1.080
	item osd.121 weight 1.080
	item osd.129 weight 1.080
	item osd.133 weight 1.080
	item osd.136 weight 1.080
}
tier tier-ssd {
	id -1100		# do not change unnecessarily
	# weight 11.520
	alg straw
	hash 0	# rjenkins1
	item node-18-ssd weight 1.440
	item node-20-ssd weight 1.440
	item node-21-ssd weight 1.440
	item node-22-ssd weight 1.440
	item node-23-ssd weight 1.440
	item node-24-ssd weight 1.440
	item node-25-ssd weight 1.440
	item node-26-ssd weight 1.440
}
tier tier-sas {
	id -1200		# do not change unnecessarily
	# weight 120.960
	alg straw
	hash 0	# rjenkins1
	item node-18-sas weight 15.120
	item node-20-sas weight 15.120
	item node-21-sas weight 15.120
	item node-22-sas weight 15.120
	item node-23-sas weight 15.120
	item node-24-sas weight 15.120
	item node-25-sas weight 15.120
	item node-26-sas weight 15.120
}
root tier-root {
	id -1010		# do not change unnecessarily
	# weight 132.480
	alg straw
	hash 0	# rjenkins1
	item tier-ssd weight 11.520
	item tier-sas weight 120.960
}

# rules
rule replicated_ruleset {
	ruleset 0
	type replicated
	min_size 1
	max_size 10
	step take default
	step chooseleaf firstn 0 type host
	step emit
}
rule ssd_ruleset {
	ruleset 76
	type replicated
	min_size 1
	max_size 10
	step take tier-ssd
	step chooseleaf firstn 0 type host-ssd
	step emit
}
rule sas_ruleset {
	ruleset 176
	type replicated
	min_size 1
	max_size 10
	step take tier-sas
	step chooseleaf firstn 0 type host-sas
	step emit
}

# end crush map
# id	weight	type name	up/down	reweight
-1010	132.5	root tier-root
-1100	11.52		tier tier-ssd
-181	1.44			host-ssd node-18-ssd
0	0.18				osd.0	up	0.2281	
5	0.18				osd.5	up	0.2434	
20	0.18				osd.20	up	0.2524	
25	0.18				osd.25	up	0.2571	
36	0.18				osd.36	up	0.2414	
39	0.18				osd.39	up	0.2436	
57	0.18				osd.57	up	0.2555	
60	0.18				osd.60	up	0.2569	
-201	1.44			host-ssd node-20-ssd
3	0.18				osd.3	up	0.2506	
7	0.18				osd.7	up	0.2441	
23	0.18				osd.23	up	0.2482	
29	0.18				osd.29	up	0.2595	
35	0.18				osd.35	up	0.2456	
52	0.18				osd.52	up	0.2553	
61	0.18				osd.61	up	0.2455	
64	0.18				osd.64	up	0.257	
-211	1.44			host-ssd node-21-ssd
4	0.18				osd.4	up	0.2405	
8	0.18				osd.8	up	0.2502	
24	0.18				osd.24	up	0.2511	
34	0.18				osd.34	up	0.246	
37	0.18				osd.37	up	0.2433	
53	0.18				osd.53	up	0.2537	
55	0.18				osd.55	up	0.2571	
62	0.18				osd.62	up	0.2462	
-221	1.44			host-ssd node-22-ssd
72	0.18				osd.72	up	0.2509	
80	0.18				osd.80	up	0.2562	
90	0.18				osd.90	up	0.2484	
93	0.18				osd.93	up	0.2537	
124	0.18				osd.124	up	0.2526	
131	0.18				osd.131	up	0.2538	
139	0.18				osd.139	up	0.2527	
151	0.18				osd.151	up	0.2553	
-231	1.44			host-ssd node-23-ssd
70	0.18				osd.70	up	0.2544	
88	0.18				osd.88	up	0.2492	
99	0.18				osd.99	up	0.2514	
104	0.18				osd.104	up	0.2528	
107	0.18				osd.107	up	0.2527	
112	0.18				osd.112	up	0.254	
134	0.18				osd.134	up	0.2536	
150	0.18				osd.150	up	0.2562	
-241	1.44			host-ssd node-24-ssd
155	0.18				osd.155	up	0.2551	
157	0.18				osd.157	up	0.2545	
162	0.18				osd.162	up	0.2554	
164	0.18				osd.164	up	0.2557	
167	0.18				osd.167	up	0.2566	
168	0.18				osd.168	up	0.2567	
171	0.18				osd.171	up	0.256	
174	0.18				osd.174	up	0.2533	
-251	1.44			host-ssd node-25-ssd
68	0.18				osd.68	up	0.259	
73	0.18				osd.73	up	0.2606	
86	0.18				osd.86	up	0.2635	
106	0.18				osd.106	up	0.2539	
111	0.18				osd.111	up	0.2543	
115	0.18				osd.115	up	0.2536	
137	0.18				osd.137	up	0.255	
149	0.18				osd.149	up	0.2564	
-261	1.44			host-ssd node-26-ssd
82	0.18				osd.82	up	0.2495	
96	0.18				osd.96	up	0.2522	
100	0.18				osd.100	up	0.2519	
123	0.18				osd.123	up	0.2549	
125	0.18				osd.125	up	0.2556	
141	0.18				osd.141	up	0.2555	
143	0.18				osd.143	up	0.2559	
147	0.18				osd.147	up	0.257	
-1200	121		tier tier-sas
-182	15.12			host-sas node-18-sas
6	1.08				osd.6	up	1	
10	1.08				osd.10	up	1	
11	1.08				osd.11	up	1	
12	1.08				osd.12	up	1	
16	1.08				osd.16	up	1	
18	1.08				osd.18	up	1	
28	1.08				osd.28	up	1	
30	1.08				osd.30	up	1	
42	1.08				osd.42	up	1	
45	1.08				osd.45	up	1	
49	1.08				osd.49	up	1	
51	1.08				osd.51	up	1	
54	1.08				osd.54	up	1	
63	1.08				osd.63	up	1	
-202	15.12			host-sas node-20-sas
2	1.08				osd.2	up	1	
13	1.08				osd.13	up	1	
15	1.08				osd.15	up	1	
19	1.08				osd.19	up	1	
21	1.08				osd.21	up	1	
27	1.08				osd.27	up	1	
33	1.08				osd.33	up	1	
38	1.08				osd.38	up	1	
40	1.08				osd.40	up	1	
46	1.08				osd.46	up	1	
47	1.08				osd.47	up	1	
50	1.08				osd.50	up	1	
56	1.08				osd.56	up	1	
58	1.08				osd.58	up	1	
-212	15.12			host-sas node-21-sas
1	1.08				osd.1	up	1	
9	1.08				osd.9	up	1	
14	1.08				osd.14	up	1	
17	1.08				osd.17	up	1	
22	1.08				osd.22	up	1	
26	1.08				osd.26	up	1	
31	1.08				osd.31	up	1	
32	1.08				osd.32	up	1	
41	1.08				osd.41	up	1	
43	1.08				osd.43	up	1	
44	1.08				osd.44	up	1	
48	1.08				osd.48	up	1	
59	1.08				osd.59	up	1	
65	1.08				osd.65	up	1	
-222	15.12			host-sas node-22-sas
69	1.08				osd.69	up	1	
75	1.08				osd.75	up	1	
85	1.08				osd.85	up	1	
97	1.08				osd.97	up	1	
101	1.08				osd.101	up	1	
105	1.08				osd.105	up	1	
108	1.08				osd.108	up	1	
116	1.08				osd.116	up	1	
120	1.08				osd.120	up	1	
127	1.08				osd.127	up	1	
130	1.08				osd.130	up	1	
135	1.08				osd.135	up	1	
145	1.08				osd.145	up	1	
148	1.08				osd.148	up	1	
-232	15.12			host-sas node-23-sas
76	1.08				osd.76	up	1	
78	1.08				osd.78	up	1	
83	1.08				osd.83	up	1	
84	1.08				osd.84	up	1	
91	1.08				osd.91	up	1	
95	1.08				osd.95	up	1	
109	1.08				osd.109	up	1	
114	1.08				osd.114	up	1	
119	1.08				osd.119	up	1	
126	1.08				osd.126	up	1	
138	1.08				osd.138	up	1	
142	1.08				osd.142	up	1	
146	1.08				osd.146	up	1	
152	1.08				osd.152	up	1	
-242	15.12			host-sas node-24-sas
154	1.08				osd.154	up	1	
156	1.08				osd.156	up	1	
158	1.08				osd.158	up	1	
159	1.08				osd.159	up	1	
160	1.08				osd.160	up	1	
161	1.08				osd.161	up	1	
163	1.08				osd.163	up	1	
165	1.08				osd.165	up	1	
166	1.08				osd.166	up	1	
169	1.08				osd.169	up	1	
170	1.08				osd.170	up	1	
172	1.08				osd.172	up	1	
173	1.08				osd.173	up	1	
175	1.08				osd.175	up	1	
-252	15.12			host-sas node-25-sas
66	1.08				osd.66	up	1	
77	1.08				osd.77	up	1	
81	1.08				osd.81	up	1	
89	1.08				osd.89	up	1	
92	1.08				osd.92	up	1	
98	1.08				osd.98	up	1	
102	1.08				osd.102	up	1	
118	1.08				osd.118	up	1	
122	1.08				osd.122	up	1	
128	1.08				osd.128	up	1	
132	1.08				osd.132	up	1	
140	1.08				osd.140	up	1	
144	1.08				osd.144	up	1	
153	1.08				osd.153	up	1	
-262	15.12			host-sas node-26-sas
67	1.08				osd.67	up	1	
71	1.08				osd.71	up	1	
74	1.08				osd.74	up	1	
79	1.08				osd.79	up	1	
87	1.08				osd.87	up	1	
94	1.08				osd.94	up	1	
103	1.08				osd.103	up	1	
110	1.08				osd.110	up	1	
113	1.08				osd.113	up	1	
117	1.08				osd.117	up	1	
121	1.08				osd.121	up	1	
129	1.08				osd.129	up	1	
133	1.08				osd.133	up	1	
136	1.08				osd.136	up	1	
-1	132.5	root default
-71	66.24		room lodz-1
-18	16.56			host node-18
0	0.18				osd.0	up	0.2281	
5	0.18				osd.5	up	0.2434	
6	1.08				osd.6	up	1	
10	1.08				osd.10	up	1	
11	1.08				osd.11	up	1	
12	1.08				osd.12	up	1	
16	1.08				osd.16	up	1	
18	1.08				osd.18	up	1	
20	0.18				osd.20	up	0.2524	
25	0.18				osd.25	up	0.2571	
28	1.08				osd.28	up	1	
30	1.08				osd.30	up	1	
36	0.18				osd.36	up	0.2414	
39	0.18				osd.39	up	0.2436	
42	1.08				osd.42	up	1	
45	1.08				osd.45	up	1	
49	1.08				osd.49	up	1	
51	1.08				osd.51	up	1	
54	1.08				osd.54	up	1	
57	0.18				osd.57	up	0.2555	
60	0.18				osd.60	up	0.2569	
63	1.08				osd.63	up	1	
-20	16.56			host node-20
2	1.08				osd.2	up	1	
3	0.18				osd.3	up	0.2506	
7	0.18				osd.7	up	0.2441	
13	1.08				osd.13	up	1	
15	1.08				osd.15	up	1	
19	1.08				osd.19	up	1	
21	1.08				osd.21	up	1	
23	0.18				osd.23	up	0.2482	
27	1.08				osd.27	up	1	
29	0.18				osd.29	up	0.2595	
33	1.08				osd.33	up	1	
35	0.18				osd.35	up	0.2456	
38	1.08				osd.38	up	1	
40	1.08				osd.40	up	1	
46	1.08				osd.46	up	1	
47	1.08				osd.47	up	1	
50	1.08				osd.50	up	1	
52	0.18				osd.52	up	0.2553	
56	1.08				osd.56	up	1	
58	1.08				osd.58	up	1	
61	0.18				osd.61	up	0.2455	
64	0.18				osd.64	up	0.257	
-21	16.56			host node-21
1	1.08				osd.1	up	1	
4	0.18				osd.4	up	0.2405	
8	0.18				osd.8	up	0.2502	
9	1.08				osd.9	up	1	
14	1.08				osd.14	up	1	
17	1.08				osd.17	up	1	
22	1.08				osd.22	up	1	
24	0.18				osd.24	up	0.2511	
26	1.08				osd.26	up	1	
31	1.08				osd.31	up	1	
32	1.08				osd.32	up	1	
34	0.18				osd.34	up	0.246	
37	0.18				osd.37	up	0.2433	
41	1.08				osd.41	up	1	
43	1.08				osd.43	up	1	
44	1.08				osd.44	up	1	
48	1.08				osd.48	up	1	
53	0.18				osd.53	up	0.2537	
55	0.18				osd.55	up	0.2571	
59	1.08				osd.59	up	1	
62	0.18				osd.62	up	0.2462	
65	1.08				osd.65	up	1	
-22	16.56			host node-22
69	1.08				osd.69	up	1	
72	0.18				osd.72	up	0.2509	
75	1.08				osd.75	up	1	
80	0.18				osd.80	up	0.2562	
85	1.08				osd.85	up	1	
90	0.18				osd.90	up	0.2484	
93	0.18				osd.93	up	0.2537	
97	1.08				osd.97	up	1	
101	1.08				osd.101	up	1	
105	1.08				osd.105	up	1	
108	1.08				osd.108	up	1	
116	1.08				osd.116	up	1	
120	1.08				osd.120	up	1	
124	0.18				osd.124	up	0.2526	
127	1.08				osd.127	up	1	
130	1.08				osd.130	up	1	
131	0.18				osd.131	up	0.2538	
135	1.08				osd.135	up	1	
139	0.18				osd.139	up	0.2527	
145	1.08				osd.145	up	1	
148	1.08				osd.148	up	1	
151	0.18				osd.151	up	0.2553	
-72	66.24		room lodz-2
-23	16.56			host node-23
70	0.18				osd.70	up	0.2544	
76	1.08				osd.76	up	1	
78	1.08				osd.78	up	1	
83	1.08				osd.83	up	1	
84	1.08				osd.84	up	1	
88	0.18				osd.88	up	0.2492	
91	1.08				osd.91	up	1	
95	1.08				osd.95	up	1	
99	0.18				osd.99	up	0.2514	
104	0.18				osd.104	up	0.2528	
107	0.18				osd.107	up	0.2527	
109	1.08				osd.109	up	1	
112	0.18				osd.112	up	0.254	
114	1.08				osd.114	up	1	
119	1.08				osd.119	up	1	
126	1.08				osd.126	up	1	
134	0.18				osd.134	up	0.2536	
138	1.08				osd.138	up	1	
142	1.08				osd.142	up	1	
146	1.08				osd.146	up	1	
150	0.18				osd.150	up	0.2562	
152	1.08				osd.152	up	1	
-24	16.56			host node-24
154	1.08				osd.154	up	1	
155	0.18				osd.155	up	0.2551	
156	1.08				osd.156	up	1	
157	0.18				osd.157	up	0.2545	
158	1.08				osd.158	up	1	
159	1.08				osd.159	up	1	
160	1.08				osd.160	up	1	
161	1.08				osd.161	up	1	
162	0.18				osd.162	up	0.2554	
163	1.08				osd.163	up	1	
164	0.18				osd.164	up	0.2557	
165	1.08				osd.165	up	1	
166	1.08				osd.166	up	1	
167	0.18				osd.167	up	0.2566	
168	0.18				osd.168	up	0.2567	
169	1.08				osd.169	up	1	
170	1.08				osd.170	up	1	
171	0.18				osd.171	up	0.256	
172	1.08				osd.172	up	1	
173	1.08				osd.173	up	1	
174	0.18				osd.174	up	0.2533	
175	1.08				osd.175	up	1	
-25	16.56			host node-25
66	1.08				osd.66	up	1	
68	0.18				osd.68	up	0.259	
73	0.18				osd.73	up	0.2606	
77	1.08				osd.77	up	1	
81	1.08				osd.81	up	1	
86	0.18				osd.86	up	0.2635	
89	1.08				osd.89	up	1	
92	1.08				osd.92	up	1	
98	1.08				osd.98	up	1	
102	1.08				osd.102	up	1	
106	0.18				osd.106	up	0.2539	
111	0.18				osd.111	up	0.2543	
115	0.18				osd.115	up	0.2536	
118	1.08				osd.118	up	1	
122	1.08				osd.122	up	1	
128	1.08				osd.128	up	1	
132	1.08				osd.132	up	1	
137	0.18				osd.137	up	0.255	
140	1.08				osd.140	up	1	
144	1.08				osd.144	up	1	
149	0.18				osd.149	up	0.2564	
153	1.08				osd.153	up	1	
-26	16.56			host node-26
67	1.08				osd.67	up	1	
71	1.08				osd.71	up	1	
74	1.08				osd.74	up	1	
79	1.08				osd.79	up	1	
82	0.18				osd.82	up	0.2495	
87	1.08				osd.87	up	1	
94	1.08				osd.94	up	1	
96	0.18				osd.96	up	0.2522	
100	0.18				osd.100	up	0.2519	
103	1.08				osd.103	up	1	
110	1.08				osd.110	up	1	
113	1.08				osd.113	up	1	
117	1.08				osd.117	up	1	
121	1.08				osd.121	up	1	
123	0.18				osd.123	up	0.2549	
125	0.18				osd.125	up	0.2556	
129	1.08				osd.129	up	1	
133	1.08				osd.133	up	1	
136	1.08				osd.136	up	1	
141	0.18				osd.141	up	0.2555	
143	0.18				osd.143	up	0.2559	
147	0.18				osd.147	up	0.257	
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux