Re: EC 8+3 Pool PGs stuck in remapped+incomplete

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello Weiwen,

Thank you for the response. I've attached the output for all PGs in state
incomplete and remapped+incomplete. Thank you!

Thanks,
Jayanth Reddy

On Sat, Jun 17, 2023 at 11:00 PM 胡 玮文 <huww98@xxxxxxxxxxx> wrote:

> Hi Jayanth,
>
> Can you post the complete output of “ceph pg <ID> query”? So that we can
> understand the situation better.
>
> Can you get OSD 3 or 4 back into the cluster? If you are sure they cannot
> rejoin, you may try “ceph osd lost <ID>” (doc says this may result in
> permanent data lost. I didn’t have a chance to try this myself).
>
> Weiwen Hu
>
> > 在 2023年6月18日,00:26,Jayanth Reddy <jayanthreddy5666@xxxxxxxxx> 写道:
> >
> > Hello Nino / Users,
> >
> > After some initial analysis, I had increased max_pg_per_osd to 480, but
> > we're out of luck. Also tried force-backfill and force-repair as well.
> > On querying PG using *# ceph pg **<pg.ID> query* the output says
> blocked_by
> > 3 to 4 OSDs which are out of the cluster already. Guessing if these have
> to
> > do something with the recovery.
> >
> > Thanks,
> > Jayanth Reddy
> >
> >> On Sat, Jun 17, 2023 at 12:31 PM Jayanth Reddy <
> jayanthreddy5666@xxxxxxxxx>
> >> wrote:
> >>
> >> Thanks, Nino.
> >>
> >> Would give these initial suggestions a try and let you know at the
> >> earliest.
> >>
> >> Regards,
> >> Jayanth Reddy
> >> ------------------------------
> >> *From:* Nino Kotur <ninokotur@xxxxxxxxx>
> >> *Sent:* Saturday, June 17, 2023 12:16:09 PM
> >> *To:* Jayanth Reddy <jayanthreddy5666@xxxxxxxxx>
> >> *Cc:* ceph-users@xxxxxxx <ceph-users@xxxxxxx>
> >> *Subject:* Re:  EC 8+3 Pool PGs stuck in remapped+incomplete
> >>
> >> problem is just that some of your OSDs have too much PGs and pool cannot
> >> recover as it cannot create more PGs
> >>
> >> [osd.214,osd.223,osd.548,osd.584] have slow ops.
> >>            too many PGs per OSD (330 > max 250)
> >>
> >> I'd have to guess that the safest thing would be permanently or
> >> temporarily adding more storage so that PGs drop below 250, another
> option
> >> is just dropping down the total number of PGs but I don't know if I
> would
> >> perform that action before my pool was healthy!
> >>
> >> in case that there is only one OSD that has this number of OSDs but all
> >> other OSDs have less than 100-150 than you can just reweight problematic
> >> OSD so it rebalances those "too many PGs"
> >>
> >> But it looks to me that you have way too many PGs which is also super
> >> negatively impacting performance.
> >>
> >> Another option is to increase max allowed PGs per OSD to say 350 this
> >> should also allow cluster to rebuild honestly even tho this may be
> easiest
> >> option, i'd never do this, performance cost of having over 150 PGs per
> OSD
> >> suffer greatly.
> >>
> >>
> >> kind regards,
> >> Nino
> >>
> >>
> >> On Sat, Jun 17, 2023 at 8:23 AM Jayanth Reddy <
> jayanthreddy5666@xxxxxxxxx>
> >> wrote:
> >>
> >> Hello Users,
> >> Greetings. We've a Ceph Cluster with the version
> >> *ceph version 14.2.5-382-g8881d33957
> >> (8881d33957b54b101eae9c7627b351af10e87ee8) nautilus (stable)*
> >>
> >> 5 PGs belonging to our RGW 8+3 EC Pool are stuck in incomplete and
> >> incomplete+remapped states. Below are the PGs,
> >>
> >> # ceph pg dump_stuck inactive
> >> ok
> >> PG_STAT STATE               UP
> >> UP_PRIMARY ACTING
> >>                 ACTING_PRIMARY
> >> 15.251e          incomplete
> [151,464,146,503,166,41,555,542,9,565,268]
> >>     151
> >> [151,464,146,503,166,41,555,542,9,565,268]            151
> >> 15.3f3           incomplete
> [584,281,672,699,199,224,239,430,355,504,196]
> >>     584
> >> [584,281,672,699,199,224,239,430,355,504,196]            584
> >> 15.985  remapped+incomplete
> [396,690,493,214,319,209,546,91,599,237,352]
> >>     396
> >>
> >>
> [2147483647,2147483647,2147483647,214,319,2147483647,546,91,599,2147483647,352]
> >>           214
> >> 15.39d3 remapped+incomplete
> [404,221,223,585,38,102,533,471,568,451,195]
> >>     404
> >> [2147483647,2147483647,223,585,38,102,533,2147483647,231,451,2147483647]
> >>         223
> >> 15.d46  remapped+incomplete
> [297,646,212,254,110,169,500,372,623,470,678]
> >>     297
> >>
> [2147483647,548,2147483647,2147483647,110,169,500,372,2147483647,470,678]
> >>         548
> >>
> >> Some of the OSDs had gone down on the cluster. Below is the # ceph
> status
> >>
> >> # ceph -s
> >>  cluster:
> >>    id:     30d6f7ee-fa02-4ab3-8a09-9321c8002794
> >>    health: HEALTH_WARN
> >>            noscrub,nodeep-scrub flag(s) set
> >>            1 pools have many more objects per pg than average
> >>            Reduced data availability: 5 pgs inactive, 5 pgs incomplete
> >>            Degraded data redundancy: 44798/8718528059 objects degraded
> >> (0.001%), 1 pg degraded, 1 pg undersized
> >>            22726 pgs not deep-scrubbed in time
> >>            23552 pgs not scrubbed in time
> >>            77 slow ops, oldest one blocked for 56400 sec, daemons
> >> [osd.214,osd.223,osd.548,osd.584] have slow ops.
> >>            too many PGs per OSD (330 > max 250)
> >>
> >>  services:
> >>    mon: 3 daemons, quorum brc1mon2,brc1mon3,brc1mon1 (age 2y)
> >>    mgr: brc1mon2(active, since 8d), standbys: brc1mon1, brc1mon3
> >>    mds: cephfs:1 {0=brc1mds2=up:active} 1 up:standby
> >>    osd: 1012 osds: 698 up (since 14h), 698 in (since 2d); 3 remapped pgs
> >>         flags noscrub,nodeep-scrub
> >>    rgw: 2 daemons active (brc1rgw1, brc1rgw2)
> >>
> >>  data:
> >>    pools:   17 pools, 23552 pgs
> >>    objects: 863.74M objects, 1.2 PiB
> >>    usage:   2.4 PiB used, 6.2 PiB / 8.6 PiB avail
> >>    pgs:     0.021% pgs not active
> >>             44798/8718528059 objects degraded (0.001%)
> >>             23546 active+clean
> >>             3     remapped+incomplete
> >>             2     incomplete
> >>             1     active+undersized+degraded
> >>
> >>  io:
> >>    client:   24 MiB/s rd, 3.2 KiB/s wr, 56 op/s rd, 4 op/s wr
> >>
> >> And the health detail shows as
> >>
> >> # ceph health detail
> >> HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 pools have many more
> >> objects per pg than average; Reduced data availability: 5 pgs inactive,
> 5
> >> pgs incomplete; Degraded data redundancy: 44798/8718528081 objects
> degraded
> >> (0.001%), 1 pg degraded, 1 pg undersized; 22726 pgs not deep-scrubbed in
> >> time; 23552 pgs not scrubbed in time; 77 slow ops, oldest one blocked
> for
> >> 56440 sec, daemons [osd.214,osd.223,osd.548,osd.584] have slow ops.; too
> >> many PGs per OSD (330 > max 250)
> >> OSDMAP_FLAGS noscrub,nodeep-scrub flag(s) set
> >> MANY_OBJECTS_PER_PG 1 pools have many more objects per pg than average
> >>    pool iscsi-images objects per pg (540004) is more than 14.7248 times
> >> cluster average (36673)
> >> PG_AVAILABILITY Reduced data availability: 5 pgs inactive, 5 pgs
> incomplete
> >>    pg 15.3f3 is incomplete, acting
> >> [584,281,672,699,199,224,239,430,355,504,196] (reducing pool
> >> default.rgw.buckets.data min_size from 9 may help; search ceph.com/docs
> >> for
> >> 'incomplete')
> >>    pg 15.985 is remapped+incomplete, acting
> >>
> >>
> [2147483647,2147483647,2147483647,214,319,2147483647,546,91,599,2147483647,352]
> >> (reducing pool default.rgw.buckets.data min_size from 9 may help; search
> >> ceph.com/docs for 'incomplete')
> >>    pg 15.d46 is remapped+incomplete, acting
> >>
> [2147483647,548,2147483647,2147483647,110,169,500,372,2147483647,470,678]
> >> (reducing pool default.rgw.buckets.data min_size from 9 may help; search
> >> ceph.com/docs for 'incomplete')
> >>    pg 15.251e is incomplete, acting
> >> [151,464,146,503,166,41,555,542,9,565,268] (reducing pool
> >> default.rgw.buckets.data min_size from 9 may help; search ceph.com/docs
> >> for
> >> 'incomplete')
> >>    pg 15.39d3 is remapped+incomplete, acting
> >> [2147483647,2147483647,223,585,38,102,533,2147483647,231,451,2147483647]
> >> (reducing pool default.rgw.buckets.data min_size from 9 may help; search
> >> ceph.com/docs for 'incomplete')
> >> PG_DEGRADED Degraded data redundancy: 44798/8718528081 objects degraded
> >> (0.001%), 1 pg degraded, 1 pg undersized
> >>    pg 15.28f0 is stuck undersized for 67359238.592403, current state
> >> active+undersized+degraded, last acting
> >> [2147483647,343,355,415,426,640,302,392,78,202,607]
> >> PG_NOT_DEEP_SCRUBBED 22726 pgs not deep-scrubbed in time
> >>
> >> We've the pools as below
> >>
> >> # ceph osd lspools
> >> 1 iscsi-images
> >> 2 cephfs_data
> >> 3 cephfs_metadata
> >> 4 .rgw.root
> >> 5 default.rgw.control
> >> 6 default.rgw.meta
> >> 7 default.rgw.log
> >> 8 default.rgw.buckets.index
> >> 13 rbd
> >> 15 default.rgw.buckets.data
> >> 16 default.rgw.buckets.non-ec
> >> 19 cephfs_data-ec
> >> 22 rbd-ec
> >> 23 iscsi-images-ec
> >> 24 hpecpool
> >> 25 hpec.rgw.buckets.index
> >> 26 hpec.rgw.buckets.non-ec
> >>
> >>
> >> We've been struggling for a long time to fix this but out of luck! Our
> RGW
> >> daemons hosted on dedicated machines are continuously failing to
> respond,
> >> being behind a load balancer, LB throws 504 Gateway Timeout as the
> daemons
> >> are failing to respond in the expected time. We perform active health
> >> checks from the LB on '/' by HTTP HEAD but these are failing as well,
> very
> >> frequently. Currently we're surviving by writing a script that restarts
> RGW
> >> daemons whenever the LB responds with HTTP status code 504. Any help is
> >> highly appreciated!
> >>
> >> Regards,
> >> Jayanth Reddy
> >> _______________________________________________
> >> ceph-users mailing list -- ceph-users@xxxxxxx
> >> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> >>
> >>
> > _______________________________________________
> > ceph-users mailing list -- ceph-users@xxxxxxx
> > To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
ID   CLASS WEIGHT      REWEIGHT SIZE    RAW USE DATA    OMAP     META     AVAIL   %USE  VAR  PGS STATUS TYPE NAME                                 
 -41                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -        root root_cache                           
 -73                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -            datacenter br_cache                   
 -76                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                room f1room1_cache                
 -79                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                    row c8a_cache                 
 -82                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        rack r169_cache           
-151                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1wosd01_cache 
-154                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1wosd02_cache 
-157                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1wosd03_cache 
-160                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1wosd04_cache 
-163                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1wosd05_cache 
 -83                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        rack r170_cache           
-100                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd01_cache 
-101                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd02_cache 
-102                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd03_cache 
-103                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd04_cache 
 -84                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        rack r171_cache           
-104                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd05_cache 
-105                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd06_cache 
-106                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd07_cache 
-107                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd08_cache 
 -85                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        rack r172_cache           
-108                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd09_cache 
-109                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd10_cache 
-110                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd11_cache 
-111                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            host brc1hosd12_cache 
 -86                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        rack r173_cache           
 -87                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        rack r174_cache           
 -40       12780.08301        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -        root root_data                            
 -42       12780.08301        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -            datacenter br                         
 -43       12780.08301        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                room f1room1                      
 -52       12780.08301        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                    row c8a                       
-304        8932.55762        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        srvgrp hpegrp             
 -54        2981.76294        - 2.9 PiB 819 TiB 813 TiB  695 GiB  6.1 TiB 2.1 PiB 27.83 1.00   -                            rack r170             
  -7         745.44098        - 720 TiB 206 TiB 204 TiB  203 GiB  1.5 TiB 514 TiB 28.56 1.03   -                                host brc1hosd01   
   2   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  212 KiB   22 GiB  10 TiB 18.39 0.66 320     up                             osd.2         
  11   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  240 KiB   28 GiB 8.2 TiB 35.73 1.29 346     up                             osd.11        
  20   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   74 MiB   27 GiB  10 TiB 20.70 0.75 368     up                             osd.20        
  29   hdd    12.73199  1.00000  13 TiB 4.1 TiB 4.1 TiB   16 MiB   23 GiB 8.6 TiB 32.58 1.18 294     up                             osd.29        
  39   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB  176 KiB   28 GiB 6.4 TiB 49.73 1.80 322     up                             osd.39        
  48   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   55 MiB   23 GiB  10 TiB 19.18 0.69 342     up                             osd.48        
  56   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB  164 KiB   28 GiB 6.3 TiB 50.30 1.82 325     up                             osd.56        
  66   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  175 KiB   38 GiB  10 TiB 21.17 0.76 361     up                             osd.66        
  75   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  208 KiB   25 GiB  10 TiB 20.13 0.73 354     up                             osd.75        
  85   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.4 TiB  136 GiB   27 GiB 8.2 TiB 35.96 1.30 333     up                             osd.85        
  94   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB   84 KiB   27 GiB 8.2 TiB 35.81 1.29 362     up                             osd.94        
 103   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  124 KiB   28 GiB 8.2 TiB 35.59 1.28 342     up                             osd.103       
 112   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  162 MiB   25 GiB  10 TiB 20.51 0.74 361     up                             osd.112       
 121   hdd    12.73199  1.00000  13 TiB 8.5 TiB 8.5 TiB  168 KiB   41 GiB 4.2 TiB 66.73 2.41 340     up                             osd.121       
 130   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  236 KiB   37 GiB  10 TiB 19.07 0.69 334     up                             osd.130       
 138   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  136 KiB   36 GiB  10 TiB 18.38 0.66 327     up                             osd.138       
 146   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  145 MiB   22 GiB  10 TiB 18.62 0.67 328     up                             osd.146       
 155   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   66 GiB   35 GiB  10 TiB 21.19 0.76 358     up                             osd.155       
 164   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.2 TiB   64 MiB   27 GiB 6.5 TiB 49.14 1.77 317     up                             osd.164       
 173   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   36 KiB   23 GiB  10 TiB 18.87 0.68 332     up                             osd.173       
 182   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  208 KiB   25 GiB  10 TiB 20.41 0.74 361     up                             osd.182       
 191   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  200 KiB   25 GiB  10 TiB 19.09 0.69 335     up                             osd.191       
 200   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   70 MiB   24 GiB 8.4 TiB 33.71 1.22 321     up                             osd.200       
 209   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   64 KiB   27 GiB 8.2 TiB 35.38 1.28 346     up                             osd.209       
 218   hdd    12.73199  1.00000  13 TiB 6.6 TiB 6.6 TiB   92 KiB   42 GiB 6.1 TiB 52.20 1.88 370     up                             osd.218       
 227   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   52 KiB   25 GiB  10 TiB 21.03 0.76 373     up                             osd.227       
 235   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.4 TiB  160 KiB   34 GiB 6.3 TiB 50.73 1.83 343     up                             osd.235       
 244   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   63 MiB   23 GiB  10 TiB 19.72 0.71 350     up                             osd.244       
 253   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   84 MiB   24 GiB  10 TiB 20.19 0.73 358     up                             osd.253       
 262   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.262       
 271   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   84 KiB   25 GiB  10 TiB 20.39 0.74 359     up                             osd.271       
 280   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  256 KiB   25 GiB  10 TiB 19.92 0.72 348     up                             osd.280       
 290   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  2.4 MiB   37 GiB  10 TiB 20.02 0.72 345     up                             osd.290       
 299   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   80 KiB   26 GiB 8.4 TiB 34.07 1.23 322     up                             osd.299       
 318   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB   76 MiB   28 GiB 6.3 TiB 50.15 1.81 327     up                             osd.318       
 327   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB  118 MiB   27 GiB 8.3 TiB 35.01 1.26 341     up                             osd.327       
 337   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  209 MiB   24 GiB  10 TiB 19.61 0.71 348     up                             osd.337       
 346   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  196 KiB   26 GiB  10 TiB 20.16 0.73 353     up                             osd.346       
 355   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   84 MiB   35 GiB  10 TiB 19.01 0.69 335     up                             osd.355       
 364   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   48 KiB   40 GiB 8.1 TiB 36.30 1.31 357     up                             osd.364       
 373   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  136 KiB   30 GiB  10 TiB 19.36 0.70 339     up                             osd.373       
 382   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  6.3 MiB   27 GiB  10 TiB 21.16 0.76 370     up                             osd.382       
 391   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   80 MiB   24 GiB  10 TiB 19.44 0.70 337     up                             osd.391       
 400   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   92 MiB   33 GiB  11 TiB 17.29 0.62 305     up                             osd.400       
 409   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  144 KiB   23 GiB  10 TiB 19.30 0.70 332     up                             osd.409       
 418   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   36 MiB   24 GiB  10 TiB 19.86 0.72 357     up                             osd.418       
 427   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  108 KiB   27 GiB  10 TiB 19.79 0.71 349     up                             osd.427       
 436   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB   88 KiB   28 GiB 6.3 TiB 50.60 1.83 339     up                             osd.436       
 451   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  232 KiB   27 GiB  10 TiB 21.32 0.77 375     up                             osd.451       
 461   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  120 KiB   26 GiB 8.2 TiB 35.39 1.28 347     up                             osd.461       
 470   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  100 KiB   24 GiB  10 TiB 20.02 0.72 346     up                             osd.470       
 479   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.479       
 488   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   63 MiB   24 GiB  10 TiB 20.03 0.72 348     up                             osd.488       
 497   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   56 KiB   37 GiB 8.3 TiB 34.97 1.26 338     up                             osd.497       
 506   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  244 KiB   23 GiB  10 TiB 19.10 0.69 327     up                             osd.506       
 515   hdd    12.73199  1.00000  13 TiB 6.6 TiB 6.5 TiB  106 MiB   42 GiB 6.1 TiB 51.71 1.87 355     up                             osd.515       
 524   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  208 KiB   26 GiB 8.2 TiB 35.22 1.27 350     up                             osd.524       
 530   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  132 KiB   24 GiB  10 TiB 19.61 0.71 341     up                             osd.530       
 308   ssd     6.98499  1.00000 7.0 TiB 2.0 TiB 2.0 TiB   16 KiB  3.6 GiB 4.9 TiB 29.27 1.06   3     up                             osd.308       
 -17         745.44098        - 733 TiB 210 TiB 208 TiB  145 GiB  1.5 TiB 523 TiB 28.65 1.03   -                                host brc1hosd02   
   7   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   56 MiB   25 GiB  10 TiB 19.63 0.71 347     up                             osd.7         
  16   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  112 KiB   25 GiB  10 TiB 19.55 0.71 344     up                             osd.16        
  25   hdd    12.73199  1.00000  13 TiB 4.8 TiB 4.7 TiB   84 KiB   31 GiB 8.0 TiB 37.42 1.35 386     up                             osd.25        
  34   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   85 MiB   23 GiB  10 TiB 19.14 0.69 337     up                             osd.34        
  43   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   96 KiB   22 GiB  10 TiB 18.82 0.68 321     up                             osd.43        
  52   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   28 MiB   22 GiB  10 TiB 18.49 0.67 319     up                             osd.52        
  61   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   48 KiB   30 GiB 6.2 TiB 51.03 1.84 357     up                             osd.61        
  70   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   72 MiB   39 GiB 8.1 TiB 36.33 1.31 368     up                             osd.70        
  79   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   52 KiB   30 GiB 6.2 TiB 51.18 1.85 349     up                             osd.79        
  88   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   64 KiB   22 GiB  10 TiB 18.57 0.67 333     up                             osd.88        
  97   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   75 MiB   26 GiB  10 TiB 20.26 0.73 356     up                             osd.97        
 106   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB  120 KiB   28 GiB 6.4 TiB 50.05 1.81 335     up                             osd.106       
 115   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   15 MiB   25 GiB  10 TiB 20.12 0.73 344     up                             osd.115       
 124   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB   88 KiB   21 GiB  10 TiB 17.76 0.64 317     up                             osd.124       
 133   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  164 KiB   24 GiB  10 TiB 19.76 0.71 343     up                             osd.133       
 142   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  140 KiB   25 GiB 8.4 TiB 34.15 1.23 323     up                             osd.142       
 151   hdd    12.73199  1.00000  13 TiB 8.5 TiB 8.5 TiB  196 KiB   33 GiB 4.2 TiB 66.96 2.42 340     up                             osd.151       
 159   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  100 KiB   27 GiB 8.2 TiB 35.67 1.29 353     up                             osd.159       
 168   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB  136 KiB   21 GiB  10 TiB 17.74 0.64 308     up                             osd.168       
 177   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB   71 GiB   31 GiB 6.3 TiB 50.29 1.82 325     up                             osd.177       
 186   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   96 KiB   30 GiB 6.2 TiB 51.26 1.85 347     up                             osd.186       
 195   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   69 MiB   27 GiB 8.3 TiB 35.02 1.26 343     up                             osd.195       
 204   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  104 KiB   26 GiB 8.2 TiB 35.28 1.27 352     up                             osd.204       
 213   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.213       
 222   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   96 KiB   23 GiB  10 TiB 19.34 0.70 346     up                             osd.222       
 231   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   72 KiB   26 GiB 8.3 TiB 34.78 1.26 344     up                             osd.231       
 241   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   22 MiB   25 GiB  10 TiB 19.78 0.71 343     up                             osd.241       
 249   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  145 MiB   24 GiB  10 TiB 19.57 0.71 353     up                             osd.249       
 258   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB  140 MiB   24 GiB 8.5 TiB 33.55 1.21 314     up                             osd.258       
 267   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  179 MiB   26 GiB  10 TiB 19.64 0.71 333     up                             osd.267       
 276   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB  132 KiB   29 GiB 8.1 TiB 36.25 1.31 347     up                             osd.276       
 285   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   61 MiB   30 GiB 6.2 TiB 50.95 1.84 342     up                             osd.285       
 293   hdd    12.73199  1.00000  13 TiB 6.2 TiB 6.2 TiB   55 MiB   26 GiB 6.5 TiB 49.07 1.77 313     up                             osd.293       
 302   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB  200 KiB   24 GiB 8.5 TiB 33.53 1.21 319     up                             osd.302       
 319   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   77 MiB   23 GiB  10 TiB 19.57 0.71 346     up                             osd.319       
 328   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   81 MiB   26 GiB  10 TiB 20.54 0.74 368     up                             osd.328       
 336   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB    8 KiB   22 GiB  10 TiB 17.93 0.65 319     up                             osd.336       
 345   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  173 MiB   25 GiB  10 TiB 20.11 0.73 353     up                             osd.345       
 354   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   68 MiB   23 GiB  10 TiB 19.16 0.69 338     up                             osd.354       
 363   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  139 KiB   25 GiB 8.4 TiB 33.79 1.22 321     up                             osd.363       
 372   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   76 KiB   25 GiB  11 TiB 17.37 0.63 303     up                             osd.372       
 380   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB  124 KiB   25 GiB 8.4 TiB 34.27 1.24 326     up                             osd.380       
 389   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.1 TiB   93 MiB   22 GiB 8.6 TiB 32.71 1.18 306     up                             osd.389       
 398   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   68 KiB   23 GiB  10 TiB 19.76 0.71 341     up                             osd.398       
 407   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  120 KiB   25 GiB  10 TiB 19.41 0.70 330     up                             osd.407       
 416   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB   14 MiB   24 GiB 8.5 TiB 33.37 1.20 312     up                             osd.416       
 425   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   73 MiB   23 GiB  10 TiB 18.84 0.68 328     up                             osd.425       
 434   hdd    12.73199  1.00000  13 TiB 4.8 TiB 4.7 TiB   80 KiB   39 GiB 8.0 TiB 37.34 1.35 371     up                             osd.434       
 443   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   96 KiB   26 GiB  10 TiB 19.96 0.72 340     up                             osd.443       
 452   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  6.3 MiB   25 GiB  10 TiB 20.20 0.73 353     up                             osd.452       
 460   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   69 MiB   24 GiB  10 TiB 19.48 0.70 346     up                             osd.460       
 469   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   96 KiB   29 GiB 8.1 TiB 36.45 1.32 363     up                             osd.469       
 478   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB  136 KiB   25 GiB 8.4 TiB 34.30 1.24 324     up                             osd.478       
 487   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  116 KiB   26 GiB 8.3 TiB 34.77 1.26 320     up                             osd.487       
 496   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   72 GiB   25 GiB  10 TiB 19.06 0.69 340     up                             osd.496       
 504   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  120 KiB   25 GiB  10 TiB 19.96 0.72 344     up                             osd.504       
 513   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   60 KiB   37 GiB  10 TiB 19.95 0.72 346     up                             osd.513       
 521   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   72 KiB   35 GiB  10 TiB 19.22 0.69 332     up                             osd.521       
 310   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB   24 KiB 1024 MiB 6.9 TiB  0.66 0.02   3     up                             osd.310       
 -15         745.44098        - 745 TiB 200 TiB 198 TiB  206 GiB  1.5 TiB 546 TiB 26.80 0.97   -                                host brc1hosd03   
   6   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  103 MiB   38 GiB  10 TiB 21.11 0.76 372     up                             osd.6         
  15   hdd    12.73199  1.00000  13 TiB 4.1 TiB 4.1 TiB   22 MiB   23 GiB 8.6 TiB 32.35 1.17 295     up                             osd.15        
  24   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB  116 KiB   28 GiB 6.4 TiB 49.94 1.80 323     up                             osd.24        
  32   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   64 KiB   28 GiB 8.3 TiB 34.80 1.26 333     up                             osd.32        
  40   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  208 KiB   22 GiB  10 TiB 18.73 0.68 323     up                             osd.40        
  49   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   69 MiB   20 GiB  11 TiB 17.53 0.63 316     up                             osd.49        
  58   hdd    12.73199  1.00000  13 TiB 8.5 TiB 8.5 TiB   84 KiB   31 GiB 4.3 TiB 66.62 2.41 339     up                             osd.58        
  67   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  2.7 MiB   22 GiB  10 TiB 18.29 0.66 322     up                             osd.67        
  76   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  100 KiB   27 GiB 8.3 TiB 34.43 1.24 330     up                             osd.76        
  84   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  218 MiB   36 GiB  10 TiB 19.04 0.69 336     up                             osd.84        
  93   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   68 KiB   26 GiB 8.3 TiB 35.00 1.26 338     up                             osd.93        
 102   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   56 KiB   22 GiB  10 TiB 18.78 0.68 338     up                             osd.102       
 110   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   60 MiB   22 GiB  10 TiB 19.19 0.69 331     up                             osd.110       
 119   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   74 MiB   24 GiB  10 TiB 19.94 0.72 340     up                             osd.119       
 128   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   46 MiB   23 GiB  10 TiB 19.72 0.71 343     up                             osd.128       
 139   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  100 MiB   26 GiB  10 TiB 20.08 0.72 357     up                             osd.139       
 148   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB   56 KiB   27 GiB 6.4 TiB 49.36 1.78 318     up                             osd.148       
 157   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   90 MiB   39 GiB 8.1 TiB 36.41 1.31 361     up                             osd.157       
 167   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.1 TiB   72 MiB   23 GiB 8.6 TiB 32.71 1.18 299     up                             osd.167       
 176   hdd    12.73199  1.00000  13 TiB 4.8 TiB 4.7 TiB   68 MiB   31 GiB 8.0 TiB 37.40 1.35 384     up                             osd.176       
 184   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   56 MiB   25 GiB  10 TiB 19.70 0.71 343     up                             osd.184       
 193   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   66 GiB   34 GiB  10 TiB 20.66 0.75 356     up                             osd.193       
 202   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   88 MiB   22 GiB  11 TiB 17.32 0.63 299     up                             osd.202       
 211   hdd    12.73199  1.00000  13 TiB 8.3 TiB 8.3 TiB   96 KiB   30 GiB 4.4 TiB 65.07 2.35 316     up                             osd.211       
 220   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  100 KiB   37 GiB  10 TiB 19.62 0.71 341     up                             osd.220       
 229   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  124 KiB   22 GiB  10 TiB 18.54 0.67 324     up                             osd.229       
 238   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   96 KiB   23 GiB  10 TiB 19.60 0.71 341     up                             osd.238       
 247   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  140 KiB   39 GiB 8.2 TiB 35.71 1.29 345     up                             osd.247       
 256   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  124 KiB   23 GiB  10 TiB 18.68 0.67 323     up                             osd.256       
 265   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   88 KiB   25 GiB 8.3 TiB 34.63 1.25 321     up                             osd.265       
 273   hdd    12.73199  1.00000  13 TiB 6.2 TiB 6.1 TiB  150 MiB   39 GiB 6.6 TiB 48.53 1.75 294     up                             osd.273       
 282   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  125 MiB   25 GiB 8.4 TiB 34.15 1.23 319     up                             osd.282       
 296   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   36 KiB   23 GiB  10 TiB 18.17 0.66 316     up                             osd.296       
 305   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   73 MiB   40 GiB 6.2 TiB 51.00 1.84 346     up                             osd.305       
 323   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   92 KiB   23 GiB  10 TiB 18.86 0.68 336     up                             osd.323       
 331   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  128 KiB   24 GiB  10 TiB 19.54 0.71 339     up                             osd.331       
 340   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   80 KiB   21 GiB  11 TiB 17.47 0.63 302     up                             osd.340       
 349   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.4 TiB   68 KiB   30 GiB 6.3 TiB 50.86 1.84 338     up                             osd.349       
 358   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  104 KiB   35 GiB  10 TiB 18.45 0.67 312     up                             osd.358       
 367   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   44 KiB   22 GiB  10 TiB 18.72 0.68 329     up                             osd.367       
 376   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   57 MiB   26 GiB 8.4 TiB 34.10 1.23 328     up                             osd.376       
 385   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   64 KiB   21 GiB  10 TiB 17.62 0.64 311     up                             osd.385       
 394   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  100 KiB   21 GiB  11 TiB 17.47 0.63 304     up                             osd.394       
 403   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB   96 KiB   30 GiB 8.2 TiB 35.85 1.29 349     up                             osd.403       
 412   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   36 KiB   24 GiB  10 TiB 19.73 0.71 352     up                             osd.412       
 421   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   54 MiB   23 GiB  10 TiB 18.48 0.67 323     up                             osd.421       
 430   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   64 KiB   23 GiB  10 TiB 19.19 0.69 338     up                             osd.430       
 438   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   40 KiB   23 GiB  10 TiB 19.17 0.69 338     up                             osd.438       
 446   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   66 GiB   35 GiB  10 TiB 20.30 0.73 341     up                             osd.446       
 455   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   68 KiB   38 GiB  10 TiB 19.72 0.71 341     up                             osd.455       
 464   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   84 KiB   33 GiB  10 TiB 18.16 0.66 319     up                             osd.464       
 473   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   68 KiB   27 GiB  10 TiB 21.48 0.78 371     up                             osd.473       
 481   hdd    12.73199  1.00000  13 TiB 2.0 TiB 2.0 TiB   32 KiB   19 GiB  11 TiB 15.79 0.57 282     up                             osd.481       
 490   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  160 KiB   38 GiB 8.2 TiB 35.47 1.28 342     up                             osd.490       
 499   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB   64 MiB   24 GiB 8.5 TiB 33.16 1.20 311     up                             osd.499       
 508   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   24 KiB   22 GiB  10 TiB 18.15 0.66 326     up                             osd.508       
 516   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  1.5 MiB   23 GiB  10 TiB 18.85 0.68 329     up                             osd.516       
 525   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   73 GiB   27 GiB  10 TiB 19.44 0.70 344     up                             osd.525       
 313   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB    8 KiB 1024 MiB 6.9 TiB  0.66 0.02   3     up                             osd.313       
 -11         745.44098        - 745 TiB 204 TiB 202 TiB  141 GiB  1.5 TiB 541 TiB 27.36 0.99   -                                host brc1hosd04   
   3   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB  210 KiB   26 GiB 8.3 TiB 35.13 1.27 341     up                             osd.3         
  12   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  140 KiB   28 GiB  10 TiB 19.54 0.71 344     up                             osd.12        
  23   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB 1019 KiB   27 GiB  10 TiB 21.00 0.76 370     up                             osd.23        
  33   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   48 KiB   23 GiB  10 TiB 19.09 0.69 331     up                             osd.33        
  42   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB   64 KiB   29 GiB 8.2 TiB 35.92 1.30 356     up                             osd.42        
  51   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  128 KiB   25 GiB 8.4 TiB 33.78 1.22 311     up                             osd.51        
  60   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  120 KiB   23 GiB  10 TiB 18.91 0.68 339     up                             osd.60        
  69   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   73 MiB   22 GiB  10 TiB 18.80 0.68 330     up                             osd.69        
  78   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  201 MiB   25 GiB  10 TiB 18.65 0.67 335     up                             osd.78        
  87   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   92 MiB   36 GiB  10 TiB 19.13 0.69 329     up                             osd.87        
  96   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB   80 KiB   24 GiB 8.5 TiB 33.03 1.19 304     up                             osd.96        
 105   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  124 KiB   22 GiB  10 TiB 18.47 0.67 316     up                             osd.105       
 114   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   72 KiB   28 GiB  10 TiB 20.65 0.75 359     up                             osd.114       
 123   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  104 KiB   21 GiB  10 TiB 18.29 0.66 325     up                             osd.123       
 132   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   56 KiB   24 GiB  10 TiB 19.73 0.71 340     up                             osd.132       
 141   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   68 KiB   22 GiB  10 TiB 18.37 0.66 317     up                             osd.141       
 150   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   24 KiB   33 GiB 6.2 TiB 51.14 1.85 344     up                             osd.150       
 160   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   71 MiB   24 GiB  10 TiB 18.73 0.68 325     up                             osd.160       
 169   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  108 KiB   25 GiB  10 TiB 19.85 0.72 345     up                             osd.169       
 178   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB  109 KiB   28 GiB 6.4 TiB 50.00 1.81 327     up                             osd.178       
 187   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB   63 MiB   28 GiB 6.4 TiB 49.97 1.80 322     up                             osd.187       
 196   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   62 MiB   28 GiB  10 TiB 21.15 0.76 368     up                             osd.196       
 205   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   84 KiB   34 GiB  10 TiB 18.07 0.65 318     up                             osd.205       
 214   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  144 KiB   35 GiB  10 TiB 19.32 0.70 337     up                             osd.214       
 223   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   60 MiB   21 GiB  11 TiB 17.08 0.62 300     up                             osd.223       
 232   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   68 MiB   24 GiB  10 TiB 19.50 0.70 328     up                             osd.232       
 240   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  120 KiB   23 GiB  10 TiB 19.50 0.70 338     up                             osd.240       
 250   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   40 KiB   24 GiB  10 TiB 19.62 0.71 346     up                             osd.250       
 259   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.6 TiB   40 KiB   40 GiB 8.1 TiB 36.73 1.33 363     up                             osd.259       
 268   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  3.5 MiB   29 GiB 8.2 TiB 35.67 1.29 361     up                             osd.268       
 277   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB  200 KiB   28 GiB 6.4 TiB 49.98 1.80 335     up                             osd.277       
 286   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  136 KiB   25 GiB 8.3 TiB 34.62 1.25 334     up                             osd.286       
 294   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB  136 KiB   23 GiB 8.6 TiB 32.82 1.18 301     up                             osd.294       
 303   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  140 KiB   23 GiB  10 TiB 18.75 0.68 326     up                             osd.303       
 321   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB   75 MiB   25 GiB 8.5 TiB 33.50 1.21 312     up                             osd.321       
 330   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   68 KiB   25 GiB 8.4 TiB 33.98 1.23 329     up                             osd.330       
 339   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB   80 KiB   28 GiB 8.2 TiB 35.85 1.29 354     up                             osd.339       
 348   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  136 MiB   22 GiB  10 TiB 18.94 0.68 328     up                             osd.348       
 357   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   36 MiB   23 GiB  10 TiB 19.29 0.70 339     up                             osd.357       
 366   hdd    12.73199  1.00000  13 TiB 8.3 TiB 8.2 TiB  188 KiB   40 GiB 4.5 TiB 64.98 2.35 306     up                             osd.366       
 375   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   56 KiB   30 GiB 8.3 TiB 34.67 1.25 332     up                             osd.375       
 384   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   76 KiB   38 GiB  10 TiB 20.49 0.74 354     up                             osd.384       
 393   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  148 KiB   23 GiB  10 TiB 19.73 0.71 357     up                             osd.393       
 402   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB   65 GiB   35 GiB 8.2 TiB 35.79 1.29 345     up                             osd.402       
 411   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   96 KiB   21 GiB  11 TiB 17.18 0.62 305     up                             osd.411       
 420   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  104 KiB   24 GiB 8.4 TiB 33.65 1.21 324     up                             osd.420       
 429   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB   44 KiB   28 GiB 6.5 TiB 49.31 1.78 315     up                             osd.429       
 439   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   71 MiB   24 GiB 8.4 TiB 33.93 1.23 328     up                             osd.439       
 447   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  186 KiB   37 GiB  10 TiB 20.49 0.74 365     up                             osd.447       
 456   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   67 MiB   25 GiB 8.4 TiB 34.26 1.24 330     up                             osd.456       
 465   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB   36 KiB   25 GiB  10 TiB 17.70 0.64 306     up                             osd.465       
 474   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   60 KiB   22 GiB  10 TiB 17.86 0.64 311     up                             osd.474       
 483   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   72 MiB   35 GiB  10 TiB 17.98 0.65 317     up                             osd.483       
 492   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  109 MiB   25 GiB 8.3 TiB 34.58 1.25 325     up                             osd.492       
 501   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   74 GiB   28 GiB 8.3 TiB 34.78 1.26 324     up                             osd.501       
 510   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   46 MiB   24 GiB  10 TiB 19.12 0.69 332     up                             osd.510       
 518   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB  153 MiB   21 GiB  10 TiB 17.82 0.64 308     up                             osd.518       
 527   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   88 MiB   38 GiB 8.3 TiB 34.90 1.26 337     up                             osd.527       
 311   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB    8 KiB 1024 MiB 6.9 TiB  0.66 0.02   2     up                             osd.311       
 -55        2969.03174        - 2.8 PiB 820 TiB 813 TiB  412 GiB  6.0 TiB 2.0 PiB 28.21 1.02   -                            rack r171             
  -5         745.44098        - 733 TiB 215 TiB 214 TiB  1.0 GiB  1.5 TiB 517 TiB 29.40 1.06   -                                host brc1hosd05   
   1   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.7 TiB   64 KiB   31 GiB 8.0 TiB 36.97 1.33 373     up                             osd.1         
  10   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  148 KiB   25 GiB  10 TiB 19.81 0.72 347     up                             osd.10        
  19   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  184 KiB   22 GiB  10 TiB 18.12 0.65 321     up                             osd.19        
  28   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  137 MiB   20 GiB  11 TiB 17.20 0.62 309     up                             osd.28        
  37   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   68 KiB   23 GiB  10 TiB 18.81 0.68 330     up                             osd.37        
  46   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  136 KiB   30 GiB  10 TiB 20.24 0.73 339     up                             osd.46        
  53   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  172 MiB   28 GiB 8.2 TiB 35.49 1.28 350     up                             osd.53        
  63   hdd    12.73199  1.00000  13 TiB  11 TiB  11 TiB   80 KiB   50 GiB 1.9 TiB 84.89 3.06 392     up                             osd.63        
  72   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   76 KiB   25 GiB  10 TiB 19.97 0.72 344     up                             osd.72        
  80   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  116 KiB   22 GiB  10 TiB 18.81 0.68 333     up                             osd.80        
  91   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   48 KiB   25 GiB 8.4 TiB 33.93 1.23 314     up                             osd.91        
 100   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   91 MiB   21 GiB  11 TiB 17.45 0.63 312     up                             osd.100       
 109   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  104 KiB   21 GiB  11 TiB 17.15 0.62 298     up                             osd.109       
 118   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB  1.5 MiB   28 GiB 8.1 TiB 36.05 1.30 359     up                             osd.118       
 127   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  136 KiB   25 GiB 8.3 TiB 34.77 1.26 336     up                             osd.127       
 136   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   56 KiB   38 GiB 8.3 TiB 35.02 1.26 338     up                             osd.136       
 145   hdd    12.73199  1.00000  13 TiB 6.7 TiB 6.6 TiB   80 KiB   34 GiB 6.1 TiB 52.31 1.89 364     up                             osd.145       
 154   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB   96 KiB   20 GiB  11 TiB 16.51 0.60 291     up                             osd.154       
 163   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   65 MiB   24 GiB  10 TiB 19.88 0.72 347     up                             osd.163       
 172   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   40 KiB   25 GiB 8.4 TiB 33.78 1.22 318     up                             osd.172       
 181   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  114 MiB   34 GiB  10 TiB 18.47 0.67 334     up                             osd.181       
 190   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  104 KiB   25 GiB 8.4 TiB 34.06 1.23 319     up                             osd.190       
 199   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   44 KiB   26 GiB  10 TiB 20.13 0.73 348     up                             osd.199       
 208   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  140 KiB   24 GiB  10 TiB 19.09 0.69 334     up                             osd.208       
 217   hdd    12.73199  1.00000  13 TiB 6.7 TiB 6.6 TiB   72 KiB   32 GiB 6.1 TiB 52.47 1.89 364     up                             osd.217       
 226   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.6 TiB  136 KiB   39 GiB 8.1 TiB 36.61 1.32 361     up                             osd.226       
 236   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   51 KiB   29 GiB 6.2 TiB 51.39 1.86 352     up                             osd.236       
 245   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   80 KiB   26 GiB 8.4 TiB 34.34 1.24 334     up                             osd.245       
 255   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   36 KiB   23 GiB  10 TiB 19.17 0.69 333     up                             osd.255       
 264   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  144 KiB   21 GiB  11 TiB 17.40 0.63 315     up                             osd.264       
 274   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   72 KiB   27 GiB  10 TiB 20.80 0.75 366     up                             osd.274       
 283   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB  128 KiB   26 GiB 8.3 TiB 34.99 1.26 335     up                             osd.283       
 291   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   60 KiB   29 GiB 8.1 TiB 36.17 1.31 354     up                             osd.291       
 300   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.300       
 320   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   87 MiB   26 GiB 8.3 TiB 34.48 1.24 323     up                             osd.320       
 329   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  112 KiB   22 GiB  10 TiB 18.51 0.67 329     up                             osd.329       
 338   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   68 MiB   29 GiB 8.2 TiB 35.49 1.28 346     up                             osd.338       
 347   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   76 MiB   25 GiB  10 TiB 20.48 0.74 362     up                             osd.347       
 356   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  136 KiB   23 GiB  10 TiB 18.85 0.68 334     up                             osd.356       
 365   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  132 KiB   26 GiB  10 TiB 19.97 0.72 344     up                             osd.365       
 374   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB   72 KiB   24 GiB 8.5 TiB 33.28 1.20 317     up                             osd.374       
 383   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   57 MiB   26 GiB 8.3 TiB 35.20 1.27 348     up                             osd.383       
 392   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  137 MiB   24 GiB  10 TiB 19.49 0.70 341     up                             osd.392       
 401   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   48 KiB   22 GiB  10 TiB 18.23 0.66 321     up                             osd.401       
 410   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  136 KiB   23 GiB  10 TiB 19.99 0.72 344     up                             osd.410       
 419   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  108 KiB   22 GiB  10 TiB 18.66 0.67 327     up                             osd.419       
 428   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   40 KiB   24 GiB  10 TiB 19.68 0.71 345     up                             osd.428       
 437   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB  100 KiB   20 GiB  11 TiB 16.84 0.61 295     up                             osd.437       
 445   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   80 KiB   27 GiB 8.2 TiB 35.56 1.28 345     up                             osd.445       
 454   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   56 KiB   21 GiB  10 TiB 18.05 0.65 322     up                             osd.454       
 463   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   80 KiB   22 GiB  10 TiB 18.80 0.68 331     up                             osd.463       
 472   hdd    12.73199  1.00000  13 TiB  11 TiB  10 TiB  228 KiB   40 GiB 2.2 TiB 82.51 2.98 345     up                             osd.472       
 482   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB  132 KiB   20 GiB  11 TiB 16.55 0.60 286     up                             osd.482       
 491   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  144 KiB   23 GiB  10 TiB 19.35 0.70 343     up                             osd.491       
 500   hdd    12.73199  1.00000  13 TiB  10 TiB  10 TiB   63 MiB   36 GiB 2.2 TiB 82.45 2.98 353     up                             osd.500       
 509   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  156 KiB   38 GiB 8.2 TiB 35.65 1.29 355     up                             osd.509       
 517   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   64 KiB   24 GiB  10 TiB 19.39 0.70 334     up                             osd.517       
 526   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  112 KiB   33 GiB  10 TiB 20.61 0.74 346     up                             osd.526       
 309   ssd     6.98499  1.00000 7.0 TiB 4.0 TiB 4.0 TiB    8 KiB  6.9 GiB 2.9 TiB 57.89 2.09   5     up                             osd.309       
  -3         732.70868        - 707 TiB 191 TiB 189 TiB  201 GiB  1.5 TiB 517 TiB 26.97 0.97   -                                host brc1hosd06   
   0   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   72 MiB   26 GiB 8.3 TiB 34.89 1.26 332     up                             osd.0         
   9   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB  158 MiB   28 GiB  10 TiB 20.87 0.75 368     up                             osd.9         
  18   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.6 TiB   65 GiB   29 GiB 8.1 TiB 36.55 1.32 371     up                             osd.18        
  27   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   52 MiB   28 GiB 8.1 TiB 36.35 1.31 360     up                             osd.27        
  36   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB  132 KiB   28 GiB 8.2 TiB 35.82 1.29 347     up                             osd.36        
  45   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB  100 KiB   21 GiB  10 TiB 17.81 0.64 314     up                             osd.45        
  54   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.6 TiB  132 KiB   29 GiB 8.1 TiB 36.60 1.32 359     up                             osd.54        
  62   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   76 KiB   30 GiB 6.2 TiB 51.41 1.86 344     up                             osd.62        
  71   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.7 TiB  112 KiB   29 GiB 8.0 TiB 37.12 1.34 378     up                             osd.71        
  81   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  116 KiB   29 GiB  10 TiB 21.48 0.78 372     up                             osd.81        
  90   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.90        
  98   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.7 TiB   77 MiB   39 GiB 8.0 TiB 37.06 1.34 376     up                             osd.98        
 107   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   63 MiB   26 GiB 8.4 TiB 34.37 1.24 336     up                             osd.107       
 116   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   71 MiB   23 GiB  10 TiB 18.84 0.68 330     up                             osd.116       
 125   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   63 GiB   23 GiB  10 TiB 19.10 0.69 323     up                             osd.125       
 134   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   72 MiB   24 GiB  10 TiB 20.02 0.72 359     up                             osd.134       
 143   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   76 KiB   37 GiB  10 TiB 20.02 0.72 359     up                             osd.143       
 152   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   42 MiB   23 GiB  10 TiB 18.81 0.68 334     up                             osd.152       
 161   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   88 KiB   32 GiB 6.2 TiB 51.10 1.84 352     up                             osd.161       
 170   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   83 MiB   29 GiB  10 TiB 21.03 0.76 364     up                             osd.170       
 179   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   81 MiB   33 GiB  10 TiB 21.33 0.77 366     up                             osd.179       
 188   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   18 MiB   21 GiB  10 TiB 17.85 0.64 313     up                             osd.188       
 197   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.4 TiB   14 MiB   29 GiB 6.3 TiB 50.74 1.83 337     up                             osd.197       
 206   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   90 MiB   35 GiB  10 TiB 18.78 0.68 328     up                             osd.206       
 215   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB  108 KiB   27 GiB 8.4 TiB 34.21 1.24 322     up                             osd.215       
 224   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   64 KiB   28 GiB 8.1 TiB 36.15 1.31 371     up                             osd.224       
 233   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   36 KiB   24 GiB  10 TiB 18.96 0.68 335     up                             osd.233       
 242   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB  160 KiB   25 GiB 8.4 TiB 34.33 1.24 325     up                             osd.242       
 260   hdd    12.73199  1.00000  13 TiB 4.9 TiB 4.8 TiB  3.3 MiB   36 GiB 7.9 TiB 38.33 1.38 401     up                             osd.260       
 269   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.269       
 278   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   71 GiB   26 GiB  10 TiB 19.35 0.70 323     up                             osd.278       
 287   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   64 KiB   29 GiB 6.2 TiB 51.24 1.85 355     up                             osd.287       
 295   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   72 KiB   27 GiB  10 TiB 21.10 0.76 361     up                             osd.295       
 314   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   57 MiB   36 GiB 8.4 TiB 33.70 1.22 317     up                             osd.314       
 322   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB  104 KiB   38 GiB 8.1 TiB 36.40 1.31 362     up                             osd.322       
 332   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   72 KiB   22 GiB  10 TiB 18.45 0.67 328     up                             osd.332       
 342   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  479 MiB   23 GiB  10 TiB 20.05 0.72 357     up                             osd.342       
 350   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   56 KiB   24 GiB  10 TiB 19.13 0.69 337     up                             osd.350       
 359   hdd    12.73199  1.00000  13 TiB 2.8 TiB 2.8 TiB  148 KiB   31 GiB 9.9 TiB 21.92 0.79 392     up                             osd.359       
 368   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   44 KiB   21 GiB  10 TiB 17.54 0.63 311     up                             osd.368       
 377   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   72 KiB   23 GiB  10 TiB 19.06 0.69 326     up                             osd.377       
 386   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   80 KiB   28 GiB  10 TiB 21.32 0.77 365     up                             osd.386       
 395   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   40 KiB   23 GiB  10 TiB 19.70 0.71 345     up                             osd.395       
 404   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   72 KiB   38 GiB  10 TiB 21.46 0.77 370     up                             osd.404       
 413   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   72 KiB   21 GiB  10 TiB 18.00 0.65 311     up                             osd.413       
 422   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   28 MiB   25 GiB 8.4 TiB 34.22 1.24 334     up                             osd.422       
 431   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   56 KiB   24 GiB  10 TiB 19.00 0.69 341     up                             osd.431       
 440   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.4 TiB  133 MiB   30 GiB 6.3 TiB 50.86 1.84 342     up                             osd.440       
 448   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB  142 MiB   20 GiB  11 TiB 16.36 0.59 279     up                             osd.448       
 457   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  140 KiB   25 GiB  10 TiB 20.78 0.75 359     up                             osd.457       
 466   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  100 KiB   29 GiB  10 TiB 21.34 0.77 369     up                             osd.466       
 475   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   88 KiB   25 GiB  10 TiB 19.86 0.72 348     up                             osd.475       
 484   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   80 KiB   23 GiB  10 TiB 19.97 0.72 355     up                             osd.484       
 493   hdd    12.73199  1.00000  13 TiB 4.8 TiB 4.7 TiB  3.0 MiB   36 GiB 7.9 TiB 37.57 1.36 378     up                             osd.493       
 502   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   58 MiB   27 GiB  10 TiB 20.82 0.75 376     up                             osd.502       
 511   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   80 KiB   21 GiB  10 TiB 18.22 0.66 323     up                             osd.511       
 520   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   56 KiB   37 GiB  10 TiB 20.36 0.74 362     up                             osd.520       
 304   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB   86 MiB  938 MiB 6.9 TiB  0.66 0.02   4     up                             osd.304       
  -9         745.44098        - 733 TiB 203 TiB 201 TiB  207 GiB  1.5 TiB 530 TiB 27.65 1.00   -                                host brc1hosd07   
   4   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   68 KiB   23 GiB  10 TiB 18.65 0.67 324     up                             osd.4         
  13   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   64 GiB   35 GiB 8.4 TiB 34.24 1.24 316     up                             osd.13        
  21   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  104 KiB   28 GiB  10 TiB 21.57 0.78 374     up                             osd.21        
  31   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB  108 KiB   23 GiB 8.5 TiB 33.26 1.20 315     up                             osd.31        
  41   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   48 KiB   24 GiB  10 TiB 19.67 0.71 342     up                             osd.41        
  50   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   69 MiB   23 GiB  10 TiB 19.46 0.70 330     up                             osd.50        
  59   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  159 MiB   24 GiB  10 TiB 20.02 0.72 345     up                             osd.59        
  68   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  116 KiB   22 GiB  10 TiB 18.91 0.68 327     up                             osd.68        
  77   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   88 KiB   33 GiB 8.3 TiB 34.91 1.26 333     up                             osd.77        
  86   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB   68 KiB   27 GiB 8.2 TiB 35.83 1.29 349     up                             osd.86        
  95   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   75 MiB   23 GiB  10 TiB 19.32 0.70 337     up                             osd.95        
 104   hdd    12.73199  1.00000  13 TiB 8.6 TiB 8.6 TiB   60 KiB   33 GiB 4.1 TiB 67.94 2.45 367     up                             osd.104       
 113   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   60 KiB   28 GiB 8.2 TiB 35.57 1.28 344     up                             osd.113       
 122   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   68 KiB   22 GiB  10 TiB 18.01 0.65 313     up                             osd.122       
 131   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB   61 MiB   27 GiB  10 TiB 21.04 0.76 375     up                             osd.131       
 140   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   14 MiB   25 GiB 8.4 TiB 34.29 1.24 323     up                             osd.140       
 147   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   68 MiB   22 GiB  10 TiB 18.96 0.68 338     up                             osd.147       
 158   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   76 GiB   27 GiB 8.3 TiB 34.42 1.24 315     up                             osd.158       
 165   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   56 KiB   21 GiB  10 TiB 18.23 0.66 318     up                             osd.165       
 174   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   64 KiB   21 GiB  11 TiB 17.40 0.63 316     up                             osd.174       
 183   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   60 MiB   26 GiB 8.3 TiB 34.66 1.25 341     up                             osd.183       
 192   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   84 KiB   25 GiB 8.4 TiB 34.32 1.24 332     up                             osd.192       
 201   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  100 KiB   23 GiB  10 TiB 18.45 0.67 330     up                             osd.201       
 210   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   71 MiB   22 GiB  10 TiB 18.66 0.67 327     up                             osd.210       
 219   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.6 TiB   66 GiB   36 GiB 8.0 TiB 37.26 1.35 374     up                             osd.219       
 228   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   96 KiB   22 GiB  10 TiB 18.16 0.66 306     up                             osd.228       
 237   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   80 MiB   25 GiB  10 TiB 19.38 0.70 343     up                             osd.237       
 246   hdd    12.73199  1.00000  13 TiB 6.6 TiB 6.5 TiB   77 MiB   36 GiB 6.2 TiB 51.64 1.86 359     up                             osd.246       
 254   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  132 KiB   28 GiB 8.2 TiB 35.54 1.28 348     up                             osd.254       
 263   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   72 KiB   25 GiB  10 TiB 20.19 0.73 345     up                             osd.263       
 272   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   72 MiB   25 GiB  10 TiB 19.29 0.70 348     up                             osd.272       
 281   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  160 KiB   22 GiB  10 TiB 18.43 0.67 319     up                             osd.281       
 289   hdd    12.73199  1.00000  13 TiB 2.8 TiB 2.8 TiB  104 KiB   39 GiB 9.9 TiB 22.08 0.80 373     up                             osd.289       
 298   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.298       
 317   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB  113 MiB   27 GiB 6.4 TiB 49.83 1.80 333     up                             osd.317       
 326   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   67 MiB   23 GiB  10 TiB 18.87 0.68 332     up                             osd.326       
 335   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  128 KiB   24 GiB  10 TiB 20.30 0.73 350     up                             osd.335       
 344   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  104 KiB   36 GiB  10 TiB 19.04 0.69 333     up                             osd.344       
 353   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  128 KiB   24 GiB  10 TiB 19.82 0.72 352     up                             osd.353       
 362   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB   57 MiB   28 GiB 6.3 TiB 50.14 1.81 332     up                             osd.362       
 371   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB   70 MiB   29 GiB 6.3 TiB 50.57 1.83 346     up                             osd.371       
 381   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.2 TiB  201 MiB   38 GiB 6.4 TiB 49.37 1.78 304     up                             osd.381       
 390   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB  116 KiB   27 GiB 8.2 TiB 35.78 1.29 354     up                             osd.390       
 399   hdd    12.73199  1.00000  13 TiB 6.2 TiB 6.2 TiB   68 MiB   26 GiB 6.5 TiB 48.79 1.76 307     up                             osd.399       
 408   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  302 MiB   28 GiB  10 TiB 21.49 0.78 380     up                             osd.408       
 417   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  128 KiB   23 GiB  10 TiB 18.64 0.67 321     up                             osd.417       
 426   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  136 KiB   26 GiB  10 TiB 21.09 0.76 361     up                             osd.426       
 435   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   40 KiB   23 GiB  10 TiB 19.12 0.69 326     up                             osd.435       
 444   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   68 KiB   26 GiB  10 TiB 20.28 0.73 355     up                             osd.444       
 453   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB    8 KiB   25 GiB  10 TiB 19.77 0.71 348     up                             osd.453       
 462   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   52 KiB   25 GiB  10 TiB 19.81 0.72 355     up                             osd.462       
 471   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  112 KiB   28 GiB  10 TiB 21.20 0.77 373     up                             osd.471       
 480   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   72 KiB   27 GiB 8.2 TiB 35.55 1.28 352     up                             osd.480       
 489   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB   78 MiB   26 GiB 8.2 TiB 35.74 1.29 347     up                             osd.489       
 498   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  104 KiB   37 GiB 8.2 TiB 35.31 1.27 344     up                             osd.498       
 507   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   64 MiB   22 GiB  10 TiB 18.15 0.66 322     up                             osd.507       
 522   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   55 MiB   22 GiB  10 TiB 18.32 0.66 315     up                             osd.522       
 528   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  1.5 MiB   25 GiB 8.4 TiB 34.11 1.23 329     up                             osd.528       
 307   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB  3.3 MiB 1021 MiB 6.9 TiB  0.66 0.02   2     up                             osd.307       
 -19         745.44098        - 733 TiB 211 TiB 209 TiB  2.2 GiB  1.5 TiB 522 TiB 28.78 1.04   -                                host brc1hosd08   
   8   hdd    12.73199  1.00000  13 TiB 8.7 TiB 8.6 TiB  136 KiB   36 GiB 4.1 TiB 67.95 2.45 362     up                             osd.8         
  17   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.17        
  26   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  2.5 MiB   23 GiB  10 TiB 18.85 0.68 329     up                             osd.26        
  35   hdd    12.73199  1.00000  13 TiB 6.6 TiB 6.5 TiB   44 KiB   33 GiB 6.2 TiB 51.45 1.86 359     up                             osd.35        
  44   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB  139 MiB   30 GiB 8.1 TiB 36.51 1.32 363     up                             osd.44        
  55   hdd    12.73199  0.50000  13 TiB 1.3 TiB 1.3 TiB   44 KiB   29 GiB  11 TiB 10.31 0.37 173     up                             osd.55        
  64   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  327 MiB   21 GiB  11 TiB 17.43 0.63 303     up                             osd.64        
  74   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   72 KiB   22 GiB  10 TiB 18.01 0.65 312     up                             osd.74        
  83   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   57 MiB   31 GiB  10 TiB 19.97 0.72 341     up                             osd.83        
  92   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   72 KiB   25 GiB 8.4 TiB 34.42 1.24 337     up                             osd.92        
 101   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB  268 KiB   28 GiB 8.2 TiB 35.84 1.29 354     up                             osd.101       
 111   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   88 KiB   26 GiB  10 TiB 20.10 0.73 352     up                             osd.111       
 120   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  140 KiB   22 GiB  10 TiB 18.31 0.66 325     up                             osd.120       
 129   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  168 KiB   20 GiB  11 TiB 17.17 0.62 292     up                             osd.129       
 137   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB   72 MiB   28 GiB 6.4 TiB 49.78 1.80 325     up                             osd.137       
 149   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  148 MiB   23 GiB  10 TiB 18.84 0.68 338     up                             osd.149       
 156   hdd    12.73199  1.00000  13 TiB 8.4 TiB 8.3 TiB   44 KiB   31 GiB 4.4 TiB 65.81 2.38 334     up                             osd.156       
 166   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   91 MiB   27 GiB  10 TiB 20.64 0.75 355     up                             osd.166       
 175   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB  208 MiB   38 GiB 8.5 TiB 33.56 1.21 319     up                             osd.175       
 185   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  136 KiB   23 GiB  10 TiB 19.18 0.69 331     up                             osd.185       
 194   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   14 MiB   23 GiB  10 TiB 19.54 0.71 351     up                             osd.194       
 203   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB  318 MiB   27 GiB 8.3 TiB 35.10 1.27 350     up                             osd.203       
 212   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB   40 KiB   23 GiB 8.5 TiB 33.14 1.20 312     up                             osd.212       
 221   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  108 KiB   24 GiB  10 TiB 20.31 0.73 355     up                             osd.221       
 230   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   72 KiB   25 GiB  10 TiB 20.44 0.74 357     up                             osd.230       
 239   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  125 MiB   26 GiB 8.3 TiB 34.50 1.25 336     up                             osd.239       
 248   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   36 KiB   28 GiB 8.2 TiB 35.57 1.28 349     up                             osd.248       
 257   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  160 KiB   27 GiB 8.2 TiB 35.56 1.28 344     up                             osd.257       
 266   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   60 KiB   30 GiB 6.2 TiB 51.42 1.86 354     up                             osd.266       
 275   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  224 KiB   23 GiB  10 TiB 18.97 0.68 331     up                             osd.275       
 284   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   84 MiB   30 GiB  10 TiB 19.88 0.72 361     up                             osd.284       
 292   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  316 KiB   22 GiB  10 TiB 18.36 0.66 323     up                             osd.292       
 301   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  105 MiB   36 GiB  10 TiB 18.45 0.67 321     up                             osd.301       
 312   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  328 KiB   26 GiB  10 TiB 20.10 0.73 355     up                             osd.312       
 325   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  186 KiB   32 GiB  10 TiB 20.43 0.74 351     up                             osd.325       
 334   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB  168 KiB   24 GiB 8.5 TiB 33.40 1.21 307     up                             osd.334       
 341   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  112 KiB   24 GiB  10 TiB 19.46 0.70 350     up                             osd.341       
 351   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  2.2 MiB   24 GiB 8.4 TiB 33.70 1.22 315     up                             osd.351       
 360   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  108 KiB   26 GiB 8.4 TiB 34.11 1.23 327     up                             osd.360       
 369   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB   83 MiB   25 GiB 8.5 TiB 33.50 1.21 308     up                             osd.369       
 378   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  164 KiB   26 GiB 8.2 TiB 35.21 1.27 339     up                             osd.378       
 387   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  196 KiB   24 GiB  10 TiB 19.36 0.70 332     up                             osd.387       
 396   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  128 KiB   38 GiB 8.2 TiB 35.35 1.28 353     up                             osd.396       
 405   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  224 KiB   28 GiB 8.2 TiB 35.42 1.28 343     up                             osd.405       
 415   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   36 KiB   22 GiB  10 TiB 18.25 0.66 318     up                             osd.415       
 424   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB  218 KiB   28 GiB 8.2 TiB 35.89 1.30 356     up                             osd.424       
 433   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   77 MiB   23 GiB  10 TiB 18.56 0.67 325     up                             osd.433       
 442   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB   52 KiB   33 GiB 6.2 TiB 51.33 1.85 355     up                             osd.442       
 450   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  221 MiB   37 GiB  10 TiB 20.19 0.73 344     up                             osd.450       
 459   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   70 MiB   24 GiB  10 TiB 19.02 0.69 328     up                             osd.459       
 468   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB  128 KiB   30 GiB 8.2 TiB 35.91 1.30 354     up                             osd.468       
 477   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  196 KiB   26 GiB 8.3 TiB 35.15 1.27 341     up                             osd.477       
 486   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   52 KiB   24 GiB  10 TiB 19.83 0.72 342     up                             osd.486       
 495   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   80 KiB   24 GiB  10 TiB 19.39 0.70 343     up                             osd.495       
 505   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   72 KiB   24 GiB  10 TiB 18.67 0.67 330     up                             osd.505       
 514   hdd    12.73199  1.00000  13 TiB 8.6 TiB 8.6 TiB   89 MiB   39 GiB 4.1 TiB 67.47 2.44 355     up                             osd.514       
 523   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   72 KiB   25 GiB  10 TiB 20.91 0.75 373     up                             osd.523       
 529   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   63 MiB   24 GiB  10 TiB 19.89 0.72 343     up                             osd.529       
 316   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB    8 KiB 1024 MiB 6.9 TiB  0.66 0.02   2     up                             osd.316       
 -56        2981.76294        - 2.9 PiB 804 TiB 797 TiB  554 GiB  6.0 TiB 2.1 PiB 27.06 0.98   -                            rack r172             
 -31         745.44098        - 745 TiB 195 TiB 194 TiB  1.5 GiB  1.5 TiB 550 TiB 26.16 0.94   -                                host brc1hosd09   
 531   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB  100 KiB   20 GiB  11 TiB 16.64 0.60 303     up                             osd.531       
 533   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   88 KiB   22 GiB  10 TiB 18.19 0.66 319     up                             osd.533       
 539   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   70 MiB   22 GiB  10 TiB 17.67 0.64 315     up                             osd.539       
 542   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB  144 KiB   28 GiB 6.3 TiB 50.13 1.81 332     up                             osd.542       
 545   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  188 KiB   25 GiB  10 TiB 19.94 0.72 343     up                             osd.545       
 548   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   24 KiB   25 GiB  10 TiB 19.53 0.71 339     up                             osd.548       
 551   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB   96 KiB   27 GiB 6.4 TiB 49.51 1.79 323     up                             osd.551       
 554   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   64 KiB   26 GiB  10 TiB 19.60 0.71 333     up                             osd.554       
 557   hdd    12.73199  1.00000  13 TiB 4.1 TiB 4.1 TiB   78 MiB   24 GiB 8.6 TiB 32.46 1.17 303     up                             osd.557       
 560   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  104 KiB   29 GiB 8.2 TiB 35.25 1.27 339     up                             osd.560       
 563   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   88 KiB   22 GiB  10 TiB 17.90 0.65 315     up                             osd.563       
 566   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   75 MiB   22 GiB  10 TiB 18.83 0.68 328     up                             osd.566       
 569   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   64 KiB   25 GiB 8.4 TiB 34.34 1.24 328     up                             osd.569       
 572   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  643 MiB   22 GiB  10 TiB 17.60 0.64 300     up                             osd.572       
 575   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   68 KiB   22 GiB  10 TiB 18.62 0.67 327     up                             osd.575       
 578   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  148 KiB   26 GiB 8.2 TiB 35.34 1.28 338     up                             osd.578       
 581   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   67 MiB   22 GiB  10 TiB 18.15 0.66 316     up                             osd.581       
 584   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   68 KiB   22 GiB  10 TiB 18.82 0.68 336     up                             osd.584       
 587   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   27 MiB   22 GiB  10 TiB 18.23 0.66 322     up                             osd.587       
 590   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   64 KiB   26 GiB 8.4 TiB 34.02 1.23 324     up                             osd.590       
 593   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   28 KiB   37 GiB  10 TiB 19.57 0.71 338     up                             osd.593       
 596   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  108 KiB   24 GiB  10 TiB 19.31 0.70 333     up                             osd.596       
 599   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  148 KiB   22 GiB  10 TiB 19.25 0.69 330     up                             osd.599       
 602   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB   88 KiB   20 GiB  11 TiB 16.62 0.60 290     up                             osd.602       
 605   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   56 KiB   27 GiB 8.2 TiB 35.29 1.27 354     up                             osd.605       
 608   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   52 KiB   26 GiB 8.3 TiB 34.82 1.26 345     up                             osd.608       
 611   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   85 MiB   24 GiB 8.4 TiB 34.00 1.23 327     up                             osd.611       
 614   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   67 MiB   21 GiB  11 TiB 17.14 0.62 308     up                             osd.614       
 617   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   61 MiB   37 GiB 8.4 TiB 33.90 1.22 325     up                             osd.617       
 620   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB   52 KiB   20 GiB  11 TiB 16.86 0.61 295     up                             osd.620       
 623   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   64 MiB   23 GiB  10 TiB 18.94 0.68 333     up                             osd.623       
 626   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.5 TiB  150 MiB   30 GiB 6.2 TiB 51.00 1.84 347     up                             osd.626       
 629   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB  100 KiB   27 GiB 6.4 TiB 49.60 1.79 320     up                             osd.629       
 632   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   40 KiB   29 GiB 8.1 TiB 36.00 1.30 353     up                             osd.632       
 638   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  148 KiB   22 GiB  10 TiB 18.51 0.67 322     up                             osd.638       
 641   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   92 KiB   39 GiB 8.2 TiB 35.63 1.29 347     up                             osd.641       
 644   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  156 KiB   25 GiB  10 TiB 19.60 0.71 344     up                             osd.644       
 647   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   81 MiB   34 GiB  10 TiB 18.04 0.65 324     up                             osd.647       
 650   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  100 KiB   36 GiB  10 TiB 18.28 0.66 324     up                             osd.650       
 653   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   15 MiB   27 GiB 8.3 TiB 34.78 1.26 329     up                             osd.653       
 656   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  180 KiB   29 GiB  10 TiB 20.48 0.74 349     up                             osd.656       
 659   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  116 KiB   26 GiB  10 TiB 20.13 0.73 352     up                             osd.659       
 662   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   36 KiB   24 GiB  10 TiB 19.67 0.71 343     up                             osd.662       
 665   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   72 KiB   38 GiB 8.2 TiB 35.22 1.27 338     up                             osd.665       
 668   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   16 MiB   23 GiB  10 TiB 19.50 0.70 333     up                             osd.668       
 671   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB  100 KiB   30 GiB  10 TiB 21.00 0.76 367     up                             osd.671       
 673   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   75 KiB   24 GiB  10 TiB 18.84 0.68 341     up                             osd.673       
 676   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  108 KiB   23 GiB  10 TiB 19.75 0.71 344     up                             osd.676       
 679   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   68 KiB   25 GiB  10 TiB 19.48 0.70 334     up                             osd.679       
 682   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  104 KiB   28 GiB 8.2 TiB 35.54 1.28 350     up                             osd.682       
 685   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  132 KiB   25 GiB 8.4 TiB 33.76 1.22 318     up                             osd.685       
 688   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  6.2 MiB   26 GiB 8.3 TiB 34.56 1.25 319     up                             osd.688       
 691   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB  132 KiB   24 GiB 8.5 TiB 33.19 1.20 306     up                             osd.691       
 694   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.7 TiB  176 KiB   39 GiB  10 TiB 21.46 0.77 371     up                             osd.694       
 697   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   32 KiB   25 GiB 8.4 TiB 33.99 1.23 327     up                             osd.697       
 700   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB   75 MiB   20 GiB  11 TiB 16.79 0.61 292     up                             osd.700       
 703   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   60 KiB   22 GiB  10 TiB 19.23 0.69 337     up                             osd.703       
 706   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.4 TiB   96 KiB   29 GiB 6.3 TiB 50.87 1.84 344     up                             osd.706       
 635   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB   16 KiB 1024 MiB 6.9 TiB  0.66 0.02   3     up                             osd.635       
 -37         745.44098        - 745 TiB 200 TiB 198 TiB  137 GiB  1.5 TiB 546 TiB 26.79 0.97   -                                host brc1hosd10   
 534   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   68 KiB   23 GiB  10 TiB 18.67 0.67 333     up                             osd.534       
 537   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   70 GiB   28 GiB  10 TiB 20.35 0.73 348     up                             osd.537       
 541   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   28 MiB   36 GiB 8.1 TiB 36.40 1.31 362     up                             osd.541       
 544   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB  2.8 MiB   24 GiB 8.5 TiB 33.26 1.20 314     up                             osd.544       
 547   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB   36 KiB   22 GiB  10 TiB 18.56 0.67 326     up                             osd.547       
 550   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  2.8 MiB   23 GiB  10 TiB 18.79 0.68 328     up                             osd.550       
 553   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  152 KiB   24 GiB  10 TiB 19.60 0.71 333     up                             osd.553       
 556   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  141 MiB   24 GiB  10 TiB 19.43 0.70 347     up                             osd.556       
 559   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   65 MiB   20 GiB  11 TiB 17.06 0.62 298     up                             osd.559       
 562   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   44 KiB   26 GiB  10 TiB 19.42 0.70 341     up                             osd.562       
 565   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   76 KiB   28 GiB 8.2 TiB 35.95 1.30 360     up                             osd.565       
 568   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   92 KiB   28 GiB 8.2 TiB 35.65 1.29 350     up                             osd.568       
 571   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.7 TiB  160 KiB   40 GiB 8.0 TiB 37.04 1.34 375     up                             osd.571       
 574   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB  186 KiB   35 GiB 8.3 TiB 35.12 1.27 342     up                             osd.574       
 577   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   69 MiB   27 GiB  10 TiB 20.57 0.74 360     up                             osd.577       
 580   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  104 KiB   24 GiB 8.4 TiB 33.77 1.22 317     up                             osd.580       
 583   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  132 KiB   22 GiB  10 TiB 17.88 0.65 317     up                             osd.583       
 586   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB  139 MiB   28 GiB 6.4 TiB 50.12 1.81 330     up                             osd.586       
 589   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  104 KiB   24 GiB  10 TiB 19.78 0.71 345     up                             osd.589       
 591   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.1 TiB   60 MiB   21 GiB  11 TiB 17.04 0.62 312     up                             osd.591       
 594   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   47 MiB   38 GiB 8.2 TiB 35.59 1.28 338     up                             osd.594       
 597   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  136 KiB   22 GiB  10 TiB 18.03 0.65 315     up                             osd.597       
 600   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  140 KiB   23 GiB  10 TiB 19.33 0.70 332     up                             osd.600       
 603   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   60 KiB   37 GiB  10 TiB 19.04 0.69 326     up                             osd.603       
 606   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   83 MiB   34 GiB 8.1 TiB 36.01 1.30 352     up                             osd.606       
 609   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB   64 MiB   21 GiB  11 TiB 16.69 0.60 289     up                             osd.609       
 612   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   92 KiB   26 GiB  10 TiB 20.08 0.72 358     up                             osd.612       
 615   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB    8 KiB   24 GiB 8.4 TiB 33.82 1.22 317     up                             osd.615       
 618   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  140 KiB   26 GiB 8.3 TiB 34.82 1.26 339     up                             osd.618       
 621   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.0 TiB  173 MiB   20 GiB  11 TiB 16.21 0.59 291     up                             osd.621       
 624   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  152 KiB   21 GiB  10 TiB 17.57 0.63 310     up                             osd.624       
 627   hdd    12.73199  1.00000  13 TiB 6.5 TiB 6.4 TiB   96 KiB   31 GiB 6.3 TiB 50.69 1.83 336     up                             osd.627       
 630   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   64 KiB   22 GiB  10 TiB 17.92 0.65 317     up                             osd.630       
 633   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   14 MiB   24 GiB  10 TiB 19.56 0.71 339     up                             osd.633       
 640   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   24 KiB   24 GiB  10 TiB 19.54 0.71 349     up                             osd.640       
 643   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   79 MiB   33 GiB 8.3 TiB 34.61 1.25 334     up                             osd.643       
 646   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB   88 KiB   38 GiB 6.4 TiB 49.83 1.80 326     up                             osd.646       
 649   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   67 MiB   30 GiB  10 TiB 17.93 0.65 315     up                             osd.649       
 652   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   84 KiB   26 GiB 8.3 TiB 34.67 1.25 334     up                             osd.652       
 655   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   72 KiB   27 GiB  10 TiB 20.23 0.73 362     up                             osd.655       
 658   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   75 MiB   23 GiB  10 TiB 19.08 0.69 338     up                             osd.658       
 661   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   48 KiB   22 GiB  11 TiB 17.53 0.63 306     up                             osd.661       
 664   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   80 KiB   38 GiB 8.3 TiB 34.88 1.26 332     up                             osd.664       
 667   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB   66 GiB   34 GiB  10 TiB 20.07 0.72 344     up                             osd.667       
 670   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  100 KiB   23 GiB  10 TiB 18.85 0.68 322     up                             osd.670       
 674   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   56 KiB   27 GiB 8.4 TiB 33.68 1.22 311     up                             osd.674       
 677   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   54 MiB   23 GiB  10 TiB 18.93 0.68 331     up                             osd.677       
 680   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  108 KiB   28 GiB 8.2 TiB 35.48 1.28 344     up                             osd.680       
 683   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   64 KiB   25 GiB 8.4 TiB 33.77 1.22 312     up                             osd.683       
 686   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB   20 KiB   28 GiB 6.3 TiB 50.50 1.82 343     up                             osd.686       
 690   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB   68 KiB   26 GiB 8.3 TiB 34.46 1.24 324     up                             osd.690       
 692   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.2 TiB   80 KiB   24 GiB 8.5 TiB 33.00 1.19 299     up                             osd.692       
 696   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.5 TiB  1.1 MiB   25 GiB  10 TiB 20.05 0.72 349     up                             osd.696       
 699   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  104 KiB   23 GiB  10 TiB 19.00 0.69 343     up                             osd.699       
 702   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   28 KiB   23 GiB  10 TiB 18.33 0.66 318     up                             osd.702       
 705   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB  101 KiB   28 GiB 6.3 TiB 50.20 1.81 330     up                             osd.705       
 708   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   52 KiB   23 GiB  10 TiB 18.36 0.66 320     up                             osd.708       
 709   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   85 MiB   26 GiB  10 TiB 19.33 0.70 334     up                             osd.709       
 636   ssd     6.98499  1.00000 7.0 TiB 2.0 TiB 2.0 TiB    8 KiB  3.6 GiB 4.9 TiB 29.30 1.06   4     up                             osd.636       
 -13         745.44098        - 733 TiB 187 TiB 186 TiB  139 GiB  1.5 TiB 545 TiB 25.55 0.92   -                                host brc1hosd11   
   5   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB   71 MiB   21 GiB  10 TiB 17.69 0.64 307     up                             osd.5         
  14   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB  168 KiB   21 GiB  11 TiB 16.87 0.61 299     up                             osd.14        
  22   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB  2.8 MiB   24 GiB 8.5 TiB 33.55 1.21 309     up                             osd.22        
  30   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   67 MiB   25 GiB 8.5 TiB 33.63 1.21 314     up                             osd.30        
  38   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.4 TiB  120 KiB   27 GiB 6.4 TiB 50.09 1.81 330     up                             osd.38        
  47   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   44 KiB   27 GiB  10 TiB 20.29 0.73 356     up                             osd.47        
  57   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   64 KiB   27 GiB 8.3 TiB 34.97 1.26 327     up                             osd.57        
  65   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  128 KiB   37 GiB  10 TiB 18.94 0.68 336     up                             osd.65        
  73   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB  100 KiB   21 GiB  10 TiB 17.68 0.64 312     up                             osd.73        
  82   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   16 KiB   26 GiB  10 TiB 19.83 0.72 344     up                             osd.82        
  89   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   76 KiB   22 GiB  10 TiB 18.26 0.66 322     up                             osd.89        
  99   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.5 TiB  333 MiB   39 GiB 8.2 TiB 35.93 1.30 354     up                             osd.99        
 108   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  134 MiB   26 GiB  10 TiB 19.89 0.72 350     up                             osd.108       
 117   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  3.2 MiB   36 GiB  10 TiB 18.84 0.68 325     up                             osd.117       
 126   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  208 KiB   25 GiB  10 TiB 20.52 0.74 353     up                             osd.126       
 135   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  140 KiB   22 GiB  10 TiB 18.92 0.68 332     up                             osd.135       
 144   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   64 KiB   25 GiB 8.4 TiB 34.24 1.24 329     up                             osd.144       
 153   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  136 KiB   23 GiB  10 TiB 18.84 0.68 329     up                             osd.153       
 162   hdd    12.73199  1.00000  13 TiB 3.0 TiB 3.0 TiB   63 MiB   40 GiB 9.7 TiB 23.70 0.86 416     up                             osd.162       
 171   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   96 KiB   31 GiB  10 TiB 18.43 0.67 318     up                             osd.171       
 180   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   27 MiB   24 GiB 8.4 TiB 33.87 1.22 322     up                             osd.180       
 189   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   88 MiB   26 GiB  10 TiB 19.97 0.72 344     up                             osd.189       
 198   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB  152 KiB   31 GiB 8.1 TiB 36.45 1.32 362     up                             osd.198       
 207   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   64 KiB   25 GiB 8.4 TiB 34.17 1.23 332     up                             osd.207       
 216   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   46 MiB   23 GiB  10 TiB 19.09 0.69 336     up                             osd.216       
 225   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   24 MiB   28 GiB  10 TiB 21.01 0.76 369     up                             osd.225       
 234   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   72 KiB   28 GiB 8.1 TiB 36.29 1.31 361     up                             osd.234       
 243   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   64 KiB   21 GiB  10 TiB 17.87 0.65 312     up                             osd.243       
 252   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   64 KiB   26 GiB 8.4 TiB 34.34 1.24 327     up                             osd.252       
 261   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB   92 KiB   27 GiB 6.4 TiB 49.64 1.79 323     up                             osd.261       
 270   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   60 MiB   27 GiB  10 TiB 20.78 0.75 365     up                             osd.270       
 279   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   85 MiB   27 GiB 8.3 TiB 35.04 1.26 341     up                             osd.279       
 288   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB  136 KiB   37 GiB 8.4 TiB 34.20 1.23 330     up                             osd.288       
 297   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   48 KiB   23 GiB  10 TiB 19.10 0.69 337     up                             osd.297       
 315   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   64 KiB   26 GiB 8.2 TiB 35.21 1.27 341     up                             osd.315       
 324   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  184 KiB   24 GiB  10 TiB 19.42 0.70 332     up                             osd.324       
 333   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  128 KiB   38 GiB 8.2 TiB 35.62 1.29 346     up                             osd.333       
 343   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   79 MiB   22 GiB  10 TiB 18.07 0.65 320     up                             osd.343       
 352   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  138 MiB   24 GiB  10 TiB 19.89 0.72 348     up                             osd.352       
 361   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB  104 KiB   27 GiB  10 TiB 20.86 0.75 364     up                             osd.361       
 370   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   73 MiB   26 GiB 8.2 TiB 35.25 1.27 348     up                             osd.370       
 379   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  212 MiB   27 GiB  10 TiB 19.15 0.69 334     up                             osd.379       
 388   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   76 KiB   37 GiB 8.3 TiB 35.03 1.26 338     up                             osd.388       
 397   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB  100 KiB   23 GiB  10 TiB 19.60 0.71 338     up                             osd.397       
 406   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB   68 MiB   38 GiB 8.3 TiB 35.12 1.27 339     up                             osd.406       
 414   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB   18 MiB   21 GiB  11 TiB 17.11 0.62 305     up                             osd.414       
 423   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.423       
 432   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   72 KiB   27 GiB  10 TiB 19.86 0.72 352     up                             osd.432       
 441   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB   44 KiB   29 GiB 6.4 TiB 49.98 1.80 321     up                             osd.441       
 449   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB  120 KiB   22 GiB  10 TiB 18.25 0.66 324     up                             osd.449       
 458   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  116 KiB   22 GiB  10 TiB 18.50 0.67 318     up                             osd.458       
 467   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.1 TiB   65 GiB   30 GiB  11 TiB 17.34 0.63 304     up                             osd.467       
 476   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB  136 KiB   26 GiB  10 TiB 20.41 0.74 349     up                             osd.476       
 485   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   73 GiB   29 GiB  10 TiB 21.34 0.77 360     up                             osd.485       
 494   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.6 TiB   67 MiB   28 GiB 8.1 TiB 36.61 1.32 363     up                             osd.494       
 503   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   80 KiB   36 GiB  10 TiB 19.51 0.70 336     up                             osd.503       
 512   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB   16 MiB   22 GiB  11 TiB 16.35 0.59 298     up                             osd.512       
 519   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  160 KiB   23 GiB  10 TiB 18.81 0.68 341     up                             osd.519       
 306   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB   16 KiB 1024 MiB 6.9 TiB  0.66 0.02   1     up                             osd.306       
 -34         745.44098        - 745 TiB 222 TiB 220 TiB  276 GiB  1.5 TiB 524 TiB 29.72 1.07   -                                host brc1hosd12   
 535   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   63 MiB   29 GiB  10 TiB 20.97 0.76 362     up                             osd.535       
 538   hdd    12.73199  1.00000  13 TiB 2.1 TiB 2.1 TiB   76 KiB   20 GiB  11 TiB 16.76 0.61 296     up                             osd.538       
 540   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   61 MiB   24 GiB  10 TiB 19.90 0.72 350     up                             osd.540       
 543   hdd    12.73199  1.00000  13 TiB 6.4 TiB 6.3 TiB   76 MiB   39 GiB 6.4 TiB 50.04 1.81 335     up                             osd.543       
 546   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  179 MiB   23 GiB  10 TiB 19.15 0.69 331     up                             osd.546       
 549   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   88 KiB   37 GiB 8.4 TiB 34.33 1.24 324     up                             osd.549       
 552   hdd    12.73199  1.00000  13 TiB 6.3 TiB 6.3 TiB   76 KiB   27 GiB 6.4 TiB 49.71 1.79 318     up                             osd.552       
 555   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   88 KiB   24 GiB  10 TiB 19.91 0.72 348     up                             osd.555       
 558   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   92 KiB   39 GiB 8.2 TiB 35.57 1.28 351     up                             osd.558       
 561   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB  104 KiB   22 GiB  10 TiB 17.77 0.64 313     up                             osd.561       
 564   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB  160 KiB   24 GiB  10 TiB 19.30 0.70 334     up                             osd.564       
 567   hdd    12.73199  0.50000  13 TiB 1.4 TiB 1.3 TiB   73 GiB   20 GiB  11 TiB 10.84 0.39 174     up                             osd.567       
 570   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   62 MiB   28 GiB 8.2 TiB 35.61 1.29 356     up                             osd.570       
 573   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   69 MiB   27 GiB 8.2 TiB 35.95 1.30 355     up                             osd.573       
 576   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB  104 KiB   25 GiB 8.4 TiB 34.16 1.23 332     up                             osd.576       
 579   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   76 KiB   22 GiB  10 TiB 18.34 0.66 322     up                             osd.579       
 582   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   76 KiB   26 GiB  10 TiB 20.70 0.75 362     up                             osd.582       
 585   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB  199 MiB   42 GiB 8.1 TiB 36.21 1.31 361     up                             osd.585       
 588   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB  112 KiB   22 GiB  10 TiB 19.02 0.69 332     up                             osd.588       
 592   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  2.5 MiB   25 GiB 8.3 TiB 34.86 1.26 330     up                             osd.592       
 595   hdd    12.73199  1.00000  13 TiB 2.7 TiB 2.6 TiB   74 GiB   28 GiB  10 TiB 21.13 0.76 363     up                             osd.595       
 598   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   40 KiB   21 GiB  10 TiB 18.06 0.65 321     up                             osd.598       
 601   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   78 MiB   35 GiB 8.4 TiB 33.78 1.22 320     up                             osd.601       
 604   hdd    12.73199  1.00000  13 TiB 8.5 TiB 8.5 TiB  104 KiB   33 GiB 4.2 TiB 67.10 2.42 345     up                             osd.604       
 607   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.3 TiB   68 KiB   22 GiB  10 TiB 17.93 0.65 312     up                             osd.607       
 610   hdd    12.73199  1.00000  13 TiB 2.6 TiB 2.6 TiB   14 MiB   26 GiB  10 TiB 20.25 0.73 350     up                             osd.610       
 613   hdd    12.73199  1.00000  13 TiB 2.2 TiB 2.2 TiB  104 KiB   21 GiB  10 TiB 17.66 0.64 302     up                             osd.613       
 616   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   92 KiB   26 GiB  10 TiB 20.03 0.72 357     up                             osd.616       
 619   hdd    12.73199  1.00000  13 TiB 4.1 TiB 4.1 TiB  172 KiB   37 GiB 8.6 TiB 32.56 1.18 299     up                             osd.619       
 622   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.7 TiB   81 MiB   31 GiB 8.0 TiB 37.04 1.34 365     up                             osd.622       
 625   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.3 TiB   84 MiB   25 GiB 8.4 TiB 34.33 1.24 340     up                             osd.625       
 628   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   76 KiB   28 GiB 8.2 TiB 35.70 1.29 349     up                             osd.628       
 631   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   48 KiB   28 GiB 8.4 TiB 33.84 1.22 320     up                             osd.631       
 634   hdd    12.73199  1.00000  13 TiB 4.7 TiB 4.6 TiB   66 GiB   37 GiB 8.0 TiB 37.31 1.35 362     up                             osd.634       
 639   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.4 TiB  196 KiB   31 GiB 8.3 TiB 35.17 1.27 340     up                             osd.639       
 642   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.3 TiB   52 MiB   24 GiB 8.4 TiB 33.99 1.23 330     up                             osd.642       
 645   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB   56 MiB   21 GiB  10 TiB 17.70 0.64 310     up                             osd.645       
 648   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   81 MiB   25 GiB  10 TiB 19.65 0.71 349     up                             osd.648       
 651   hdd    12.73199  1.00000  13 TiB  10 TiB  10 TiB   40 KiB   35 GiB 2.3 TiB 81.87 2.96 333     up                             osd.651       
 654   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   64 KiB   23 GiB  10 TiB 19.22 0.69 340     up                             osd.654       
 657   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.3 TiB  112 KiB   22 GiB  10 TiB 18.53 0.67 326     up                             osd.657       
 660   hdd    12.73199  1.00000  13 TiB 8.2 TiB 8.1 TiB   92 KiB   29 GiB 4.6 TiB 64.13 2.32 303     up                             osd.660       
 663   hdd    12.73199  1.00000  13 TiB 4.3 TiB 4.2 TiB  104 KiB   37 GiB 8.5 TiB 33.61 1.21 313     up                             osd.663       
 666   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB   62 GiB   22 GiB  10 TiB 18.27 0.66 309     up                             osd.666       
 669   hdd    12.73199  1.00000  13 TiB 8.5 TiB 8.4 TiB  132 KiB   43 GiB 4.3 TiB 66.39 2.40 339     up                             osd.669       
 672   hdd    12.73199  1.00000  13 TiB 4.2 TiB 4.1 TiB  116 KiB   24 GiB 8.6 TiB 32.76 1.18 305     up                             osd.672       
 675   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB   40 KiB   22 GiB  10 TiB 17.75 0.64 309     up                             osd.675       
 678   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB   80 KiB   28 GiB 8.2 TiB 35.63 1.29 347     up                             osd.678       
 681   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   76 KiB   23 GiB  10 TiB 19.37 0.70 332     up                             osd.681       
 684   hdd    12.73199  1.00000  13 TiB 4.5 TiB 4.5 TiB  2.2 MiB   26 GiB 8.2 TiB 35.51 1.28 337     up                             osd.684       
 687   hdd    12.73199  1.00000  13 TiB 4.4 TiB 4.4 TiB  168 KiB   26 GiB 8.3 TiB 34.73 1.25 337     up                             osd.687       
 689   hdd    12.73199  1.00000  13 TiB 4.6 TiB 4.6 TiB   96 KiB   27 GiB 8.2 TiB 35.94 1.30 356     up                             osd.689       
 693   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   64 MiB   23 GiB  10 TiB 18.96 0.68 339     up                             osd.693       
 695   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.5 TiB   66 MiB   26 GiB  10 TiB 20.02 0.72 353     up                             osd.695       
 698   hdd    12.73199  1.00000  13 TiB 2.3 TiB 2.2 TiB   56 MiB   22 GiB  10 TiB 17.76 0.64 313     up                             osd.698       
 701   hdd    12.73199  1.00000  13 TiB 2.5 TiB 2.4 TiB   64 MiB   24 GiB  10 TiB 19.38 0.70 343     up                             osd.701       
 704   hdd    12.73199  1.00000  13 TiB 6.2 TiB 6.2 TiB   96 KiB   27 GiB 6.5 TiB 48.97 1.77 304     up                             osd.704       
 707   hdd    12.73199  1.00000  13 TiB 2.4 TiB 2.4 TiB   84 KiB   23 GiB  10 TiB 18.72 0.68 324     up                             osd.707       
 637   ssd     6.98499  1.00000 7.0 TiB  47 GiB  46 GiB  144 KiB 1024 MiB 6.9 TiB  0.66 0.02   4     up                             osd.637       
 -57                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            rack r173             
 -58                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            rack r174             
-301        3847.52515        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                        srvgrp wdgrp              
 -53        3847.52515        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                            rack r169             
-145         769.50500        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                                host brc1wosd01   
 712   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.712       
 717   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.717       
 722   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.722       
 728   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.728       
 733   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.733       
 738   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.738       
 743   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.743       
 747   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.747       
 753   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.753       
 758   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.758       
 763   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.763       
 768   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.768       
 773   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.773       
 778   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.778       
 783   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.783       
 788   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.788       
 793   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.793       
 798   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.798       
 803   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.803       
 808   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.808       
 813   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.813       
 818   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.818       
 823   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.823       
 828   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.828       
 833   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.833       
 838   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.838       
 843   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.843       
 848   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.848       
 853   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.853       
 858   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.858       
 863   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.863       
 868   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.868       
 873   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.873       
 878   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.878       
 883   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.883       
 888   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.888       
 893   hdd     5.58499        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.893       
 898   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.898       
 903   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.903       
 908   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.908       
 913   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.913       
 917   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.917       
 922   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.922       
 927   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.927       
 932   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.932       
 937   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.937       
 942   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.942       
 947   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.947       
 952   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.952       
 957   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.957       
 962   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.962       
 967   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.967       
 972   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.972       
 979   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.979       
 984   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.984       
 989   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.989       
 994   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.994       
 999   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.999       
1004   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1004      
1009   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1009      
1013   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1013      
-142         769.50500        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                                host brc1wosd02   
 711   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.711       
 716   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.716       
 721   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.721       
 725   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.725       
 730   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.730       
 735   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.735       
 740   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.740       
 745   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.745       
 750   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.750       
 755   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.755       
 760   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.760       
 765   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.765       
 770   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.770       
 775   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.775       
 780   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.780       
 785   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.785       
 790   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.790       
 795   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.795       
 800   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.800       
 805   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.805       
 810   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.810       
 815   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.815       
 820   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.820       
 825   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.825       
 830   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.830       
 835   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.835       
 840   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.840       
 845   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.845       
 850   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.850       
 855   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.855       
 860   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.860       
 865   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.865       
 870   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.870       
 875   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.875       
 881   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.881       
 886   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.886       
 891   hdd     5.58499        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.891       
 896   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.896       
 901   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.901       
 906   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.906       
 911   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.911       
 916   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.916       
 921   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.921       
 926   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.926       
 931   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.931       
 936   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.936       
 941   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.941       
 946   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.946       
 951   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.951       
 956   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.956       
 961   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.961       
 966   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.966       
 971   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.971       
 976   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.976       
 981   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.981       
 986   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.986       
 990   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.990       
 995   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.995       
1000   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1000      
1005   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1005      
1010   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1010      
-139         769.50500        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                                host brc1wosd03   
 710   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.710       
 715   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.715       
 720   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.720       
 726   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.726       
 731   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.731       
 736   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.736       
 741   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.741       
 746   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.746       
 751   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.751       
 756   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.756       
 761   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.761       
 766   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.766       
 771   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.771       
 776   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.776       
 781   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.781       
 786   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.786       
 791   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.791       
 796   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.796       
 801   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.801       
 806   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.806       
 811   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.811       
 816   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.816       
 821   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.821       
 826   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.826       
 831   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.831       
 836   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.836       
 842   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.842       
 847   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.847       
 852   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.852       
 857   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.857       
 862   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.862       
 867   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.867       
 872   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.872       
 877   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.877       
 882   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.882       
 887   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.887       
 892   hdd     5.58499        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.892       
 897   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.897       
 902   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.902       
 907   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.907       
 912   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.912       
 919   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.919       
 924   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.924       
 929   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.929       
 934   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.934       
 939   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.939       
 944   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.944       
 948   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.948       
 953   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.953       
 958   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.958       
 963   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.963       
 968   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.968       
 973   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.973       
 977   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.977       
 982   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.982       
 987   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.987       
 992   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.992       
 997   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.997       
1002   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1002      
1007   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1007      
1012   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1012      
-148         769.50500        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                                host brc1wosd04   
 714   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.714       
 719   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.719       
 724   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.724       
 729   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.729       
 734   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.734       
 739   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.739       
 744   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.744       
 749   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.749       
 754   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.754       
 759   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.759       
 764   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.764       
 769   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.769       
 774   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.774       
 779   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.779       
 784   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.784       
 789   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.789       
 794   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.794       
 799   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.799       
 804   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.804       
 809   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.809       
 814   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.814       
 819   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.819       
 824   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.824       
 829   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.829       
 834   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.834       
 839   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.839       
 844   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.844       
 849   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.849       
 854   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.854       
 859   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.859       
 864   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.864       
 869   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.869       
 874   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.874       
 879   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.879       
 884   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.884       
 889   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.889       
 894   hdd     5.58499        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.894       
 899   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.899       
 904   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.904       
 909   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.909       
 914   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.914       
 918   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.918       
 923   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.923       
 928   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.928       
 933   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.933       
 938   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.938       
 943   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.943       
 950   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.950       
 955   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.955       
 960   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.960       
 965   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.965       
 970   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.970       
 975   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.975       
 980   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.980       
 985   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.985       
 991   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.991       
 996   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.996       
1001   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1001      
1006   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1006      
1011   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1011      
1014   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1014      
-136         769.50507        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -                                host brc1wosd05   
 532   hdd    12.73239        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.532       
 713   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.713       
 718   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.718       
 723   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.723       
 727   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.727       
 732   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.732       
 737   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.737       
 742   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.742       
 748   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.748       
 752   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.752       
 757   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.757       
 762   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.762       
 767   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.767       
 772   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.772       
 777   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.777       
 782   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.782       
 787   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.787       
 792   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.792       
 797   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.797       
 802   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.802       
 807   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.807       
 812   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.812       
 817   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.817       
 822   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.822       
 827   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.827       
 832   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.832       
 837   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.837       
 841   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.841       
 846   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.846       
 851   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.851       
 856   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.856       
 861   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.861       
 866   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.866       
 871   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.871       
 876   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.876       
 880   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.880       
 885   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.885       
 890   hdd     5.58499        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.890       
 895   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.895       
 900   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.900       
 905   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.905       
 910   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.910       
 915   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.915       
 920   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.920       
 925   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.925       
 930   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.930       
 935   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.935       
 940   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.940       
 945   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.945       
 949   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.949       
 954   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.954       
 959   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.959       
 964   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.964       
 969   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.969       
 974   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.974       
 978   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.978       
 983   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.983       
 988   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.988       
 993   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.993       
 998   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.998       
1003   hdd    12.73199        0     0 B     0 B     0 B      0 B      0 B     0 B     0    0   0   down                             osd.1003      
  -1                 0        -     0 B     0 B     0 B      0 B      0 B     0 B     0    0   -        root default                              
                          TOTAL 8.6 PiB 2.4 PiB 2.4 PiB  1.6 TiB   18 TiB 6.2 PiB 27.70                                                           
MIN/MAX VAR: 0.02/3.06  STDDEV: 12.53
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux