I think I need a second set of eyes to understand some unexpected data
movement when adding new OSDs to a cluster (Luminous 12.2.11).
Our cluster ran low on space sooner than expected; so as a stopgap I
recommissioned a couple of older storage nodes while we get new hardware
purchases under way.
I spent a little time to run drive tests and weed out any weaklings
before creating new OSDs... because of this one node was ready before
the other. Each has 30 HDDs/OSDs.
So for the first node I introduced the new OSDs by increasing their
crush weight gradually to the final value (0.55 in steps of 0.1 - the
values don't make much sense relative to hdd capacity but that's
historic). We never had more than ~2% of pgs misplaced at any one time.
All went well, the new OSDs acquired pgs in the expected proportions and
the space crunch was mitigated.
Then I started adding the second node - first setting its osds to crush
weight 0.1. All of a sudden, bam, 14-15% of pgs were misplaced! This
didn't make any sense to me - what seems to have happened is that ceph
evacuated almost all data from the previous new node. I just don't
understand this given the osd crush weights...
What might cause this? The output of "ceph df tree" is below; the first
new node is "node-98", the second is "node-99". Is there anything
obvious I could be missing?
One note, we almost certainly need more pgs to improve the data
distribution, but seems too risky to change that until more space available.
Thanks for any ideas, Graham
ID CLASS WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR PGS TYPE NAME
-2 267.21521 - 4.69PiB 3.30PiB 1.39PiB 0 0 - root default
-10 132.50159 - 2.24PiB 1.53PiB 726TiB 68.40 0.97 - rack even01
-50 25.61932 - 440TiB 345TiB 95.4TiB 78.32 1.11 - host node-02
328 hdd 0.36699 1.00000 7.28TiB 5.41TiB 1.87TiB 74.33 1.06 46 osd.328
329 hdd 0.36699 1.00000 7.28TiB 5.59TiB 1.69TiB 76.80 1.09 49 osd.329
330 hdd 0.36699 1.00000 7.28TiB 6.12TiB 1.16TiB 84.11 1.20 50 osd.330
331 hdd 0.36699 1.00000 7.28TiB 5.38TiB 1.90TiB 73.96 1.05 46 osd.331
332 hdd 0.36699 1.00000 7.28TiB 5.47TiB 1.80TiB 75.23 1.07 47 osd.332
333 hdd 0.36699 1.00000 7.28TiB 5.47TiB 1.81TiB 75.11 1.07 46 osd.333
334 hdd 0.36699 1.00000 7.28TiB 5.70TiB 1.58TiB 78.28 1.11 49 osd.334
335 hdd 0.36699 0.79999 7.28TiB 6.85TiB 442GiB 94.08 1.34 55 osd.335
336 hdd 0.36699 1.00000 7.28TiB 5.25TiB 2.03TiB 72.14 1.03 44 osd.336
337 hdd 0.36699 1.00000 7.28TiB 5.82TiB 1.46TiB 79.92 1.14 48 osd.337
338 hdd 0.36699 1.00000 7.28TiB 4.81TiB 2.47TiB 66.08 0.94 39 osd.338
339 hdd 0.36699 1.00000 7.28TiB 5.49TiB 1.78TiB 75.50 1.07 46 osd.339
340 hdd 0.36699 1.00000 7.28TiB 5.60TiB 1.68TiB 76.89 1.09 47 osd.340
341 hdd 0.36699 1.00000 7.28TiB 5.26TiB 2.02TiB 72.24 1.03 45 osd.341
342 hdd 0.36699 1.00000 7.28TiB 5.71TiB 1.57TiB 78.45 1.11 48 osd.342
343 hdd 0.36699 1.00000 7.28TiB 6.34TiB 958GiB 87.15 1.24 53 osd.343
344 hdd 0.36699 1.00000 7.28TiB 6.26TiB 1.02TiB 85.98 1.22 51 osd.344
345 hdd 0.36699 1.00000 7.28TiB 5.28TiB 1.99TiB 72.60 1.03 46 osd.345
346 hdd 0.36699 1.00000 7.28TiB 4.94TiB 2.33TiB 67.93 0.97 41 osd.346
347 hdd 0.36699 1.00000 7.28TiB 5.38TiB 1.90TiB 73.89 1.05 45 osd.347
348 hdd 0.36699 1.00000 7.28TiB 5.35TiB 1.92TiB 73.57 1.05 44 osd.348
349 hdd 0.36699 0.89999 7.28TiB 6.65TiB 642GiB 91.39 1.30 53 osd.349
350 hdd 0.36699 1.00000 7.28TiB 5.18TiB 2.09TiB 71.24 1.01 45 osd.350
351 hdd 0.36699 1.00000 7.28TiB 5.62TiB 1.66TiB 77.25 1.10 47 osd.351
352 hdd 0.36699 1.00000 7.28TiB 5.79TiB 1.49TiB 79.56 1.13 48 osd.352
353 hdd 0.36699 1.00000 7.28TiB 6.18TiB 1.10TiB 84.89 1.21 53 osd.353
354 hdd 0.36699 1.00000 7.28TiB 5.70TiB 1.58TiB 78.29 1.11 49 osd.354
355 hdd 0.36699 1.00000 7.28TiB 6.12TiB 1.16TiB 84.12 1.20 52 osd.355
356 hdd 0.36699 1.00000 7.28TiB 5.67TiB 1.61TiB 77.89 1.11 45 osd.356
357 hdd 0.36699 1.00000 7.28TiB 5.94TiB 1.33TiB 81.67 1.16 49 osd.357
358 hdd 0.36699 1.00000 7.28TiB 6.58TiB 713GiB 90.44 1.29 55 osd.358
359 hdd 0.36699 1.00000 7.28TiB 6.02TiB 1.26TiB 82.71 1.18 51 osd.359
360 hdd 0.36699 1.00000 7.28TiB 5.70TiB 1.58TiB 78.27 1.11 47 osd.360
361 hdd 0.36699 1.00000 7.28TiB 5.38TiB 1.90TiB 73.87 1.05 47 osd.361
362 hdd 0.36699 1.00000 7.28TiB 5.28TiB 2.00TiB 72.52 1.03 46 osd.362
363 hdd 0.36699 1.00000 7.28TiB 5.69TiB 1.59TiB 78.14 1.11 48 osd.363
364 hdd 0.36699 1.00000 7.28TiB 5.70TiB 1.58TiB 78.29 1.11 48 osd.364
365 hdd 0.36699 1.00000 7.28TiB 5.92TiB 1.36TiB 81.29 1.16 50 osd.365
366 hdd 0.36699 1.00000 7.28TiB 6.13TiB 1.15TiB 84.18 1.20 51 osd.366
367 hdd 0.36699 1.00000 7.28TiB 5.15TiB 2.13TiB 70.71 1.00 44 osd.367
368 hdd 0.36699 1.00000 7.28TiB 6.16TiB 1.12TiB 84.66 1.20 53 osd.368
369 hdd 0.36699 1.00000 7.28TiB 6.24TiB 1.04TiB 85.71 1.22 52 osd.369
370 hdd 0.36699 1.00000 7.28TiB 5.84TiB 1.44TiB 80.18 1.14 47 osd.370
371 hdd 0.36699 1.00000 7.28TiB 6.22TiB 1.05TiB 85.51 1.22 51 osd.371
372 hdd 0.36699 1.00000 7.28TiB 5.70TiB 1.58TiB 78.26 1.11 49 osd.372
373 hdd 0.36699 1.00000 7.28TiB 6.14TiB 1.13TiB 84.42 1.20 50 osd.373
374 hdd 0.36699 1.00000 7.28TiB 5.69TiB 1.59TiB 78.14 1.11 48 osd.374
375 hdd 0.36699 1.00000 7.28TiB 5.62TiB 1.66TiB 77.20 1.10 49 osd.375
376 hdd 0.36699 1.00000 7.28TiB 6.35TiB 947GiB 87.29 1.24 53 osd.376
377 hdd 0.36699 1.00000 7.28TiB 5.69TiB 1.58TiB 78.24 1.11 47 osd.377
378 hdd 0.36699 1.00000 7.28TiB 5.80TiB 1.48TiB 79.67 1.13 48 osd.378
379 hdd 0.36699 1.00000 7.28TiB 6.12TiB 1.15TiB 84.16 1.20 51 osd.379
380 hdd 0.36699 1.00000 7.28TiB 5.25TiB 2.03TiB 72.14 1.03 43 osd.380
381 hdd 0.36699 1.00000 7.28TiB 5.90TiB 1.38TiB 81.08 1.15 48 osd.381
382 hdd 0.36699 0.89999 7.28TiB 5.13TiB 2.15TiB 70.46 1.00 41 osd.382
383 hdd 0.36699 1.00000 7.28TiB 5.38TiB 1.90TiB 73.87 1.05 44 osd.383
384 hdd 0.36699 1.00000 7.28TiB 5.74TiB 1.54TiB 78.86 1.12 49 osd.384
385 hdd 0.36699 1.00000 7.28TiB 5.91TiB 1.36TiB 81.27 1.15 51 osd.385
386 hdd 0.36699 1.00000 7.28TiB 6.58TiB 713GiB 90.44 1.29 54 osd.386
387 hdd 0.36699 1.00000 7.28TiB 5.26TiB 2.02TiB 72.28 1.03 45 osd.387
324 ssd 0.89999 1.00000 894GiB 45.6GiB 849GiB 5.10 0.07 121 osd.324
325 ssd 0.89999 1.00000 894GiB 38.3GiB 856GiB 4.28 0.06 115 osd.325
326 ssd 0.89999 1.00000 894GiB 26.1GiB 868GiB 2.92 0.04 117 osd.326
327 ssd 0.89999 1.00000 894GiB 32.3GiB 862GiB 3.62 0.05 117 osd.327
-51 12.91180 - 220TiB 175TiB 44.6TiB 79.73 1.13 - host node-04
646 hdd 0.45799 1.00000 9.10TiB 7.79TiB 1.31TiB 85.63 1.22 65 osd.646
647 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.97TiB 78.35 1.11 59 osd.647
648 hdd 0.45799 1.00000 9.10TiB 7.02TiB 2.07TiB 77.23 1.10 59 osd.648
649 hdd 0.45799 1.00000 9.10TiB 7.53TiB 1.57TiB 82.78 1.18 60 osd.649
650 hdd 0.45799 1.00000 9.10TiB 6.88TiB 2.21TiB 75.69 1.08 58 osd.650
651 hdd 0.45799 1.00000 9.10TiB 7.06TiB 2.04TiB 77.58 1.10 57 osd.651
652 hdd 0.45799 1.00000 9.10TiB 7.76TiB 1.33TiB 85.37 1.21 64 osd.652
653 hdd 0.45799 1.00000 9.10TiB 7.58TiB 1.52TiB 83.29 1.18 65 osd.653
654 hdd 0.45799 1.00000 9.10TiB 7.26TiB 1.84TiB 79.77 1.13 62 osd.654
655 hdd 0.45799 1.00000 9.10TiB 7.02TiB 2.08TiB 77.15 1.10 59 osd.655
656 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.55TiB 83.00 1.18 63 osd.656
657 hdd 0.45799 1.00000 9.10TiB 7.31TiB 1.78TiB 80.42 1.14 61 osd.657
658 hdd 0.45799 1.00000 9.10TiB 7.43TiB 1.67TiB 81.64 1.16 60 osd.658
659 hdd 0.45799 1.00000 9.10TiB 6.89TiB 2.21TiB 75.75 1.08 57 osd.659
660 hdd 0.45799 1.00000 9.10TiB 6.67TiB 2.43TiB 73.33 1.04 56 osd.660
661 hdd 0.45799 1.00000 9.10TiB 7.88TiB 1.22TiB 86.60 1.23 66 osd.661
662 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.76TiB 80.60 1.15 61 osd.662
663 hdd 0.45799 1.00000 9.10TiB 7.03TiB 2.07TiB 77.25 1.10 60 osd.663
664 hdd 0.45799 1.00000 9.10TiB 7.39TiB 1.71TiB 81.20 1.15 62 osd.664
665 hdd 0.45799 1.00000 9.10TiB 7.37TiB 1.73TiB 81.01 1.15 62 osd.665
666 hdd 0.45799 1.00000 9.10TiB 6.56TiB 2.53TiB 72.16 1.03 55 osd.666
667 hdd 0.45799 1.00000 9.10TiB 7.04TiB 2.06TiB 77.35 1.10 59 osd.667
668 hdd 0.45799 1.00000 9.10TiB 7.37TiB 1.73TiB 81.02 1.15 62 osd.668
669 hdd 0.45799 0.79999 9.10TiB 8.53TiB 580GiB 93.77 1.33 71 osd.669
642 ssd 0.48000 1.00000 447GiB 26.6GiB 421GiB 5.94 0.08 67 osd.642
643 ssd 0.48000 1.00000 447GiB 13.1GiB 434GiB 2.93 0.04 65 osd.643
644 ssd 0.48000 1.00000 447GiB 20.3GiB 427GiB 4.55 0.06 67 osd.644
645 ssd 0.48000 1.00000 447GiB 26.6GiB 421GiB 5.94 0.08 63 osd.645
-52 12.91180 - 220TiB 172TiB 48.3TiB 78.07 1.11 - host node-06
674 hdd 0.45799 1.00000 9.10TiB 7.36TiB 1.74TiB 80.91 1.15 60 osd.674
675 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.98TiB 78.27 1.11 60 osd.675
676 hdd 0.45799 1.00000 9.10TiB 7.28TiB 1.81TiB 80.06 1.14 59 osd.676
677 hdd 0.45799 1.00000 9.10TiB 6.93TiB 2.17TiB 76.18 1.08 58 osd.677
678 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.63TiB 82.06 1.17 62 osd.678
679 hdd 0.45799 1.00000 9.10TiB 7.00TiB 2.10TiB 76.91 1.09 57 osd.679
680 hdd 0.45799 1.00000 9.10TiB 7.78TiB 1.31TiB 85.56 1.22 65 osd.680
681 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.96TiB 78.42 1.11 61 osd.681
682 hdd 0.45799 1.00000 9.10TiB 6.59TiB 2.51TiB 72.44 1.03 56 osd.682
683 hdd 0.45799 1.00000 9.10TiB 7.31TiB 1.78TiB 80.41 1.14 61 osd.683
684 hdd 0.45799 1.00000 9.10TiB 6.59TiB 2.50TiB 72.46 1.03 56 osd.684
685 hdd 0.45799 1.00000 9.10TiB 7.36TiB 1.74TiB 80.91 1.15 65 osd.685
686 hdd 0.45799 1.00000 9.10TiB 7.34TiB 1.76TiB 80.68 1.15 62 osd.686
687 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.87TiB 79.47 1.13 60 osd.687
688 hdd 0.45799 1.00000 9.10TiB 6.57TiB 2.53TiB 72.22 1.03 56 osd.688
689 hdd 0.45799 1.00000 9.10TiB 7.78TiB 1.31TiB 85.55 1.22 65 osd.689
690 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.77TiB 80.58 1.14 61 osd.690
691 hdd 0.45799 0.70000 9.10TiB 8.63TiB 476GiB 94.89 1.35 70 osd.691
692 hdd 0.45799 1.00000 9.10TiB 6.25TiB 2.84TiB 68.75 0.98 53 osd.692
693 hdd 0.45799 1.00000 9.10TiB 6.47TiB 2.62TiB 71.17 1.01 54 osd.693
694 hdd 0.45799 1.00000 9.10TiB 7.37TiB 1.73TiB 81.02 1.15 62 osd.694
695 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.97TiB 78.35 1.11 60 osd.695
696 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.98TiB 78.22 1.11 59 osd.696
697 hdd 0.45799 1.00000 9.10TiB 6.58TiB 2.52TiB 72.30 1.03 54 osd.697
670 ssd 0.48000 1.00000 447GiB 18.7GiB 428GiB 4.18 0.06 68 osd.670
671 ssd 0.48000 1.00000 447GiB 20.6GiB 426GiB 4.61 0.07 64 osd.671
672 ssd 0.48000 1.00000 447GiB 22.2GiB 425GiB 4.97 0.07 61 osd.672
673 ssd 0.48000 1.00000 447GiB 22.2GiB 425GiB 4.98 0.07 65 osd.673
-65 12.91180 - 220TiB 172TiB 48.2TiB 78.10 1.11 - host node-08
702 hdd 0.45799 1.00000 9.10TiB 6.78TiB 2.31TiB 74.58 1.06 57 osd.702
703 hdd 0.45799 1.00000 9.10TiB 6.71TiB 2.39TiB 73.75 1.05 57 osd.703
704 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.99TiB 78.15 1.11 60 osd.704
705 hdd 0.45799 1.00000 9.10TiB 6.47TiB 2.62TiB 71.16 1.01 54 osd.705
706 hdd 0.45799 1.00000 9.10TiB 6.46TiB 2.63TiB 71.05 1.01 55 osd.706
707 hdd 0.45799 1.00000 9.10TiB 6.79TiB 2.31TiB 74.63 1.06 57 osd.707
708 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.55TiB 82.98 1.18 63 osd.708
709 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.76TiB 80.64 1.15 63 osd.709
710 hdd 0.45799 1.00000 9.10TiB 8.11TiB 1012GiB 89.13 1.27 69 osd.710
711 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.97TiB 78.32 1.11 60 osd.711
712 hdd 0.45799 1.00000 9.10TiB 7.32TiB 1.78TiB 80.45 1.14 61 osd.712
713 hdd 0.45799 1.00000 9.10TiB 6.81TiB 2.28TiB 74.89 1.06 58 osd.713
714 hdd 0.45799 1.00000 9.10TiB 7.43TiB 1.66TiB 81.71 1.16 61 osd.714
715 hdd 0.45799 1.00000 9.10TiB 7.14TiB 1.96TiB 78.44 1.11 60 osd.715
716 hdd 0.45799 1.00000 9.10TiB 6.79TiB 2.31TiB 74.65 1.06 58 osd.716
717 hdd 0.45799 1.00000 9.10TiB 7.00TiB 2.10TiB 76.96 1.09 59 osd.717
718 hdd 0.45799 1.00000 9.10TiB 7.56TiB 1.54TiB 83.07 1.18 64 osd.718
719 hdd 0.45799 1.00000 9.10TiB 8.08TiB 1.02TiB 88.82 1.26 68 osd.719
720 hdd 0.45799 1.00000 9.10TiB 6.59TiB 2.51TiB 72.43 1.03 56 osd.720
721 hdd 0.45799 1.00000 9.10TiB 7.95TiB 1.14TiB 87.45 1.24 65 osd.721
722 hdd 0.45799 1.00000 9.10TiB 6.79TiB 2.30TiB 74.68 1.06 56 osd.722
723 hdd 0.45799 1.00000 9.10TiB 7.00TiB 2.10TiB 76.95 1.09 59 osd.723
724 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.66TiB 81.80 1.16 61 osd.724
725 hdd 0.45799 1.00000 9.10TiB 7.42TiB 1.67TiB 81.63 1.16 61 osd.725
698 ssd 0.48000 1.00000 447GiB 28.1GiB 419GiB 6.28 0.09 64 osd.698
699 ssd 0.48000 1.00000 447GiB 22.3GiB 425GiB 4.99 0.07 67 osd.699
700 ssd 0.48000 1.00000 447GiB 29.7GiB 417GiB 6.64 0.09 63 osd.700
701 ssd 0.48000 1.00000 447GiB 22.0GiB 425GiB 4.93 0.07 69 osd.701
-78 12.91180 - 220TiB 176TiB 44.1TiB 79.97 1.14 - host node-10
730 hdd 0.45799 1.00000 9.10TiB 7.45TiB 1.65TiB 81.90 1.16 63 osd.730
731 hdd 0.45799 1.00000 9.10TiB 7.43TiB 1.67TiB 81.66 1.16 61 osd.731
732 hdd 0.45799 1.00000 9.10TiB 7.74TiB 1.35TiB 85.11 1.21 62 osd.732
733 hdd 0.45799 1.00000 9.10TiB 6.90TiB 2.20TiB 75.81 1.08 58 osd.733
734 hdd 0.45799 1.00000 9.10TiB 7.31TiB 1.79TiB 80.34 1.14 58 osd.734
735 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.98TiB 78.27 1.11 62 osd.735
736 hdd 0.45799 1.00000 9.10TiB 6.67TiB 2.43TiB 73.33 1.04 55 osd.736
737 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.99TiB 78.16 1.11 57 osd.737
738 hdd 0.45799 1.00000 9.10TiB 7.66TiB 1.44TiB 84.22 1.20 64 osd.738
739 hdd 0.45799 1.00000 9.10TiB 7.19TiB 1.91TiB 79.02 1.12 63 osd.739
740 hdd 0.45799 1.00000 9.10TiB 6.90TiB 2.20TiB 75.81 1.08 59 osd.740
741 hdd 0.45799 1.00000 9.10TiB 6.45TiB 2.65TiB 70.91 1.01 55 osd.741
742 hdd 0.45799 1.00000 9.10TiB 7.66TiB 1.43TiB 84.23 1.20 65 osd.742
743 hdd 0.45799 1.00000 9.10TiB 7.32TiB 1.77TiB 80.49 1.14 60 osd.743
744 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.77TiB 80.56 1.14 62 osd.744
745 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.86TiB 79.53 1.13 63 osd.745
746 hdd 0.45799 1.00000 9.10TiB 7.10TiB 1.99TiB 78.10 1.11 59 osd.746
747 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.88TiB 79.34 1.13 60 osd.747
748 hdd 0.45799 1.00000 9.10TiB 8.10TiB 1021GiB 89.04 1.27 67 osd.748
749 hdd 0.45799 1.00000 9.10TiB 7.66TiB 1.44TiB 84.21 1.20 65 osd.749
750 hdd 0.45799 1.00000 9.10TiB 7.66TiB 1.44TiB 84.19 1.20 65 osd.750
751 hdd 0.45799 1.00000 9.10TiB 7.54TiB 1.56TiB 82.84 1.18 62 osd.751
752 hdd 0.45799 1.00000 9.10TiB 7.48TiB 1.62TiB 82.23 1.17 61 osd.752
753 hdd 0.45799 1.00000 9.10TiB 7.66TiB 1.44TiB 84.19 1.20 63 osd.753
726 ssd 0.48000 1.00000 447GiB 21.8GiB 425GiB 4.88 0.07 66 osd.726
727 ssd 0.48000 1.00000 447GiB 19.9GiB 427GiB 4.45 0.06 69 osd.727
728 ssd 0.48000 1.00000 447GiB 30.2GiB 417GiB 6.76 0.10 65 osd.728
729 ssd 0.48000 1.00000 447GiB 25.0GiB 422GiB 5.59 0.08 65 osd.729
-80 12.91180 - 220TiB 172TiB 47.9TiB 78.22 1.11 - host node-12
758 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.99TiB 78.15 1.11 59 osd.758
759 hdd 0.45799 1.00000 9.10TiB 6.66TiB 2.43TiB 73.26 1.04 55 osd.759
760 hdd 0.45799 1.00000 9.10TiB 6.46TiB 2.63TiB 71.07 1.01 54 osd.760
761 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.88TiB 79.36 1.13 62 osd.761
762 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.66TiB 81.79 1.16 60 osd.762
763 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.63TiB 82.06 1.17 62 osd.763
764 hdd 0.45799 1.00000 9.10TiB 7.64TiB 1.45TiB 84.03 1.19 62 osd.764
765 hdd 0.45799 1.00000 9.10TiB 7.38TiB 1.72TiB 81.11 1.15 59 osd.765
766 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.64TiB 81.97 1.16 63 osd.766
767 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.40 1.13 60 osd.767
768 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.55TiB 82.96 1.18 62 osd.768
769 hdd 0.45799 1.00000 9.10TiB 6.79TiB 2.30TiB 74.71 1.06 59 osd.769
770 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.98TiB 78.21 1.11 60 osd.770
771 hdd 0.45799 1.00000 9.10TiB 7.26TiB 1.84TiB 79.79 1.13 59 osd.771
772 hdd 0.45799 1.00000 9.10TiB 6.24TiB 2.85TiB 68.65 0.98 53 osd.772
773 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.39 1.13 60 osd.773
774 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.42 1.13 61 osd.774
775 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.98TiB 78.28 1.11 60 osd.775
776 hdd 0.45799 1.00000 9.10TiB 7.64TiB 1.45TiB 84.05 1.19 64 osd.776
777 hdd 0.45799 1.00000 9.10TiB 6.91TiB 2.18TiB 76.00 1.08 57 osd.777
778 hdd 0.45799 1.00000 9.10TiB 7.10TiB 1.99TiB 78.10 1.11 58 osd.778
779 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.77TiB 80.54 1.14 61 osd.779
780 hdd 0.45799 1.00000 9.10TiB 7.01TiB 2.09TiB 77.06 1.10 60 osd.780
781 hdd 0.45799 1.00000 9.10TiB 7.45TiB 1.65TiB 81.86 1.16 63 osd.781
754 ssd 0.48000 1.00000 447GiB 21.3GiB 426GiB 4.75 0.07 63 osd.754
755 ssd 0.48000 1.00000 447GiB 27.4GiB 420GiB 6.14 0.09 67 osd.755
756 ssd 0.48000 1.00000 447GiB 22.8GiB 424GiB 5.10 0.07 65 osd.756
757 ssd 0.48000 1.00000 447GiB 19.6GiB 427GiB 4.39 0.06 65 osd.757
-82 12.91180 - 220TiB 173TiB 46.7TiB 78.77 1.12 - host node-14
786 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.88TiB 79.37 1.13 60 osd.786
787 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.97TiB 78.31 1.11 61 osd.787
788 hdd 0.45799 1.00000 9.10TiB 7.57TiB 1.52TiB 83.25 1.18 64 osd.788
789 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.98TiB 78.22 1.11 60 osd.789
790 hdd 0.45799 1.00000 9.10TiB 7.21TiB 1.88TiB 79.29 1.13 62 osd.790
791 hdd 0.45799 1.00000 9.10TiB 6.91TiB 2.19TiB 75.92 1.08 58 osd.791
792 hdd 0.45799 1.00000 9.10TiB 6.41TiB 2.68TiB 70.49 1.00 57 osd.792
793 hdd 0.45799 1.00000 9.10TiB 7.86TiB 1.23TiB 86.46 1.23 65 osd.793
794 hdd 0.45799 1.00000 9.10TiB 7.68TiB 1.41TiB 84.46 1.20 65 osd.794
795 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.41 1.13 62 osd.795
796 hdd 0.45799 1.00000 9.10TiB 7.24TiB 1.85TiB 79.64 1.13 63 osd.796
797 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.65TiB 81.81 1.16 62 osd.797
798 hdd 0.45799 1.00000 9.10TiB 6.47TiB 2.63TiB 71.10 1.01 54 osd.798
799 hdd 0.45799 1.00000 9.10TiB 8.07TiB 1.02TiB 88.77 1.26 66 osd.799
800 hdd 0.45799 1.00000 9.10TiB 6.49TiB 2.60TiB 71.37 1.01 56 osd.800
801 hdd 0.45799 1.00000 9.10TiB 7.68TiB 1.41TiB 84.47 1.20 64 osd.801
802 hdd 0.45799 1.00000 9.10TiB 7.07TiB 2.03TiB 77.72 1.10 61 osd.802
803 hdd 0.45799 1.00000 9.10TiB 6.67TiB 2.43TiB 73.32 1.04 56 osd.803
804 hdd 0.45799 1.00000 9.10TiB 6.69TiB 2.40TiB 73.58 1.05 57 osd.804
805 hdd 0.45799 1.00000 9.10TiB 7.75TiB 1.35TiB 85.18 1.21 62 osd.805
806 hdd 0.45799 1.00000 9.10TiB 7.47TiB 1.62TiB 82.15 1.17 63 osd.806
807 hdd 0.45799 1.00000 9.10TiB 7.21TiB 1.88TiB 79.29 1.13 60 osd.807
808 hdd 0.45799 1.00000 9.10TiB 7.42TiB 1.68TiB 81.57 1.16 62 osd.808
809 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.40 1.13 60 osd.809
782 ssd 0.48000 1.00000 447GiB 24.2GiB 423GiB 5.40 0.08 67 osd.782
783 ssd 0.48000 1.00000 447GiB 20.6GiB 426GiB 4.61 0.07 67 osd.783
784 ssd 0.48000 1.00000 447GiB 23.4GiB 424GiB 5.22 0.07 68 osd.784
785 ssd 0.48000 1.00000 447GiB 19.5GiB 428GiB 4.37 0.06 67 osd.785
-84 12.91180 - 220TiB 180TiB 40.5TiB 81.59 1.16 - host node-16
814 hdd 0.45799 1.00000 9.10TiB 7.76TiB 1.33TiB 85.36 1.21 64 osd.814
815 hdd 0.45799 1.00000 9.10TiB 7.45TiB 1.65TiB 81.88 1.16 63 osd.815
816 hdd 0.45799 1.00000 9.10TiB 7.34TiB 1.76TiB 80.67 1.15 62 osd.816
817 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.55TiB 82.95 1.18 62 osd.817
818 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.64TiB 82.01 1.17 65 osd.818
819 hdd 0.45799 1.00000 9.10TiB 7.16TiB 1.94TiB 78.71 1.12 63 osd.819
820 hdd 0.45799 0.89999 9.10TiB 8.41TiB 701GiB 92.48 1.31 69 osd.820
821 hdd 0.45799 1.00000 9.10TiB 7.45TiB 1.65TiB 81.90 1.16 63 osd.821
822 hdd 0.45799 1.00000 9.10TiB 7.36TiB 1.74TiB 80.91 1.15 61 osd.822
823 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.41 1.13 59 osd.823
824 hdd 0.45799 1.00000 9.10TiB 7.10TiB 2.00TiB 78.01 1.11 57 osd.824
825 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.54TiB 83.02 1.18 63 osd.825
826 hdd 0.45799 1.00000 9.10TiB 7.54TiB 1.55TiB 82.92 1.18 63 osd.826
827 hdd 0.45799 1.00000 9.10TiB 6.99TiB 2.11TiB 76.84 1.09 59 osd.827
828 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.63TiB 82.03 1.17 64 osd.828
829 hdd 0.45799 1.00000 9.10TiB 6.99TiB 2.11TiB 76.81 1.09 56 osd.829
830 hdd 0.45799 1.00000 9.10TiB 7.77TiB 1.33TiB 85.41 1.21 65 osd.830
831 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.55TiB 82.97 1.18 61 osd.831
832 hdd 0.45799 1.00000 9.10TiB 7.34TiB 1.75TiB 80.75 1.15 64 osd.832
833 hdd 0.45799 1.00000 9.10TiB 7.26TiB 1.84TiB 79.78 1.13 60 osd.833
834 hdd 0.45799 0.89999 9.10TiB 8.32TiB 796GiB 91.45 1.30 70 osd.834
835 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.86TiB 79.54 1.13 61 osd.835
836 hdd 0.45799 1.00000 9.10TiB 7.21TiB 1.88TiB 79.31 1.13 59 osd.836
837 hdd 0.45799 1.00000 9.10TiB 7.99TiB 1.11TiB 87.83 1.25 66 osd.837
810 ssd 0.48000 1.00000 447GiB 17.0GiB 430GiB 3.80 0.05 66 osd.810
811 ssd 0.48000 1.00000 447GiB 18.9GiB 428GiB 4.22 0.06 65 osd.811
812 ssd 0.48000 1.00000 447GiB 23.2GiB 424GiB 5.18 0.07 64 osd.812
813 ssd 0.48000 1.00000 447GiB 18.4GiB 429GiB 4.12 0.06 63 osd.813
-8 16.49963 - 317TiB 6.43TiB 310TiB 2.03 0.03 - host node-98
34 hdd 0.54999 1.00000 10.9TiB 9.92GiB 10.9TiB 0.09 0.00 0 osd.34
35 hdd 0.54999 1.00000 10.9TiB 9.24GiB 10.9TiB 0.08 0.00 0 osd.35
36 hdd 0.54999 1.00000 10.9TiB 348GiB 10.6TiB 3.12 0.04 3 osd.36
37 hdd 0.54999 1.00000 10.9TiB 234GiB 10.7TiB 2.09 0.03 2 osd.37
38 hdd 0.54999 1.00000 10.9TiB 235GiB 10.7TiB 2.10 0.03 2 osd.38
39 hdd 0.54999 1.00000 10.9TiB 8.64GiB 10.9TiB 0.08 0.00 0 osd.39
40 hdd 0.54999 1.00000 10.9TiB 337GiB 10.6TiB 3.01 0.04 2 osd.40
41 hdd 0.54999 1.00000 10.9TiB 8.66GiB 10.9TiB 0.08 0.00 0 osd.41
42 hdd 0.54999 1.00000 10.9TiB 2.22TiB 8.69TiB 20.38 0.29 1 osd.42
43 hdd 0.54999 1.00000 10.9TiB 235GiB 10.7TiB 2.10 0.03 2 osd.43
44 hdd 0.54999 1.00000 10.9TiB 9.53GiB 10.9TiB 0.09 0.00 0 osd.44
45 hdd 0.54999 1.00000 10.9TiB 235GiB 10.7TiB 2.10 0.03 2 osd.45
46 hdd 0.54999 1.00000 10.9TiB 118GiB 10.8TiB 1.05 0.01 1 osd.46
47 hdd 0.54999 1.00000 10.9TiB 9.59GiB 10.9TiB 0.09 0.00 0 osd.47
48 hdd 0.54999 1.00000 10.9TiB 8.72GiB 10.9TiB 0.08 0.00 0 osd.48
49 hdd 0.54999 1.00000 10.9TiB 123GiB 10.8TiB 1.10 0.02 1 osd.49
50 hdd 0.54999 1.00000 10.9TiB 235GiB 10.7TiB 2.10 0.03 2 osd.50
51 hdd 0.54999 1.00000 10.9TiB 9.53GiB 10.9TiB 0.09 0.00 0 osd.51
52 hdd 0.54999 1.00000 10.9TiB 143GiB 10.8TiB 1.28 0.02 0 osd.52
53 hdd 0.54999 1.00000 10.9TiB 461GiB 10.5TiB 4.12 0.06 4 osd.53
54 hdd 0.54999 1.00000 10.9TiB 9.10GiB 10.9TiB 0.08 0.00 0 osd.54
55 hdd 0.54999 1.00000 10.9TiB 9.17GiB 10.9TiB 0.08 0.00 0 osd.55
56 hdd 0.54999 1.00000 10.9TiB 8.24GiB 10.9TiB 0.07 0.00 0 osd.56
57 hdd 0.54999 1.00000 10.9TiB 11.7GiB 10.9TiB 0.11 0.00 0 osd.57
58 hdd 0.54999 1.00000 10.9TiB 122GiB 10.8TiB 1.09 0.02 1 osd.58
59 hdd 0.54999 1.00000 10.9TiB 123GiB 10.8TiB 1.10 0.02 1 osd.59
60 hdd 0.54999 1.00000 10.9TiB 347GiB 10.6TiB 3.10 0.04 3 osd.60
61 hdd 0.54999 1.00000 10.9TiB 685GiB 10.2TiB 6.13 0.09 6 osd.61
62 hdd 0.54999 1.00000 10.9TiB 122GiB 10.8TiB 1.09 0.02 1 osd.62
63 hdd 0.54999 1.00000 10.9TiB 234GiB 10.7TiB 2.10 0.03 2 osd.63
-7 134.71361 - 2.45PiB 1.77PiB 698TiB 72.18 1.03 - rack odd01
-49 25.61932 - 440TiB 351TiB 89.6TiB 79.64 1.13 - host node-01
388 hdd 0.36699 1.00000 7.28TiB 5.69TiB 1.59TiB 78.13 1.11 47 osd.388
389 hdd 0.36699 1.00000 7.28TiB 5.90TiB 1.38TiB 81.01 1.15 48 osd.389
390 hdd 0.36699 0.89999 7.28TiB 5.58TiB 1.70TiB 76.65 1.09 46 osd.390
391 hdd 0.36699 1.00000 7.28TiB 6.13TiB 1.14TiB 84.30 1.20 53 osd.391
392 hdd 0.36699 1.00000 7.28TiB 6.57TiB 726GiB 90.26 1.28 55 osd.392
393 hdd 0.36699 1.00000 7.28TiB 5.36TiB 1.91TiB 73.70 1.05 46 osd.393
394 hdd 0.36699 1.00000 7.28TiB 5.27TiB 2.01TiB 72.38 1.03 44 osd.394
395 hdd 0.36699 1.00000 7.28TiB 5.28TiB 2.00TiB 72.51 1.03 44 osd.395
396 hdd 0.36699 1.00000 7.28TiB 6.40TiB 898GiB 87.95 1.25 51 osd.396
397 hdd 0.36699 1.00000 7.28TiB 5.90TiB 1.37TiB 81.11 1.15 49 osd.397
398 hdd 0.36699 1.00000 7.28TiB 6.37TiB 926GiB 87.57 1.24 51 osd.398
399 hdd 0.36699 1.00000 7.28TiB 6.24TiB 1.04TiB 85.73 1.22 52 osd.399
400 hdd 0.36699 1.00000 7.28TiB 6.15TiB 1.12TiB 84.56 1.20 51 osd.400
401 hdd 0.36699 0.89999 7.28TiB 5.27TiB 2.01TiB 72.44 1.03 44 osd.401
402 hdd 0.36699 1.00000 7.28TiB 5.28TiB 2.00TiB 72.55 1.03 44 osd.402
403 hdd 0.36699 1.00000 7.28TiB 5.46TiB 1.82TiB 75.02 1.07 45 osd.403
404 hdd 0.36699 1.00000 7.28TiB 5.73TiB 1.54TiB 78.80 1.12 50 osd.404
405 hdd 0.36699 1.00000 7.28TiB 5.95TiB 1.33TiB 81.77 1.16 50 osd.405
406 hdd 0.36699 1.00000 7.28TiB 5.80TiB 1.47TiB 79.73 1.13 49 osd.406
407 hdd 0.36699 1.00000 7.28TiB 6.34TiB 958GiB 87.14 1.24 52 osd.407
408 hdd 0.36699 1.00000 7.28TiB 6.03TiB 1.24TiB 82.89 1.18 53 osd.408
409 hdd 0.36699 1.00000 7.28TiB 5.59TiB 1.69TiB 76.84 1.09 48 osd.409
410 hdd 0.36699 1.00000 7.28TiB 5.06TiB 2.21TiB 69.58 0.99 43 osd.410
411 hdd 0.36699 1.00000 7.28TiB 5.91TiB 1.36TiB 81.28 1.15 51 osd.411
412 hdd 0.36699 1.00000 7.28TiB 5.05TiB 2.23TiB 69.34 0.99 41 osd.412
413 hdd 0.36699 1.00000 7.28TiB 5.82TiB 1.46TiB 80.00 1.14 50 osd.413
414 hdd 0.36699 1.00000 7.28TiB 6.34TiB 956GiB 87.17 1.24 52 osd.414
415 hdd 0.36699 1.00000 7.28TiB 5.59TiB 1.69TiB 76.78 1.09 46 osd.415
416 hdd 0.36699 1.00000 7.28TiB 5.51TiB 1.77TiB 75.73 1.08 48 osd.416
417 hdd 0.36699 1.00000 7.28TiB 5.84TiB 1.43TiB 80.30 1.14 50 osd.417
418 hdd 0.36699 1.00000 7.28TiB 5.79TiB 1.49TiB 79.56 1.13 47 osd.418
419 hdd 0.36699 1.00000 7.28TiB 6.11TiB 1.16TiB 84.00 1.19 51 osd.419
420 hdd 0.36699 1.00000 7.28TiB 5.04TiB 2.24TiB 69.26 0.98 43 osd.420
421 hdd 0.36699 1.00000 7.28TiB 5.25TiB 2.03TiB 72.11 1.02 43 osd.421
422 hdd 0.36699 1.00000 7.28TiB 6.42TiB 875GiB 88.26 1.25 51 osd.422
423 hdd 0.36699 1.00000 7.28TiB 6.53TiB 764GiB 89.75 1.28 55 osd.423
424 hdd 0.36699 1.00000 7.28TiB 5.34TiB 1.94TiB 73.36 1.04 43 osd.424
425 hdd 0.36699 1.00000 7.28TiB 5.99TiB 1.29TiB 82.29 1.17 48 osd.425
426 hdd 0.36699 1.00000 7.28TiB 6.24TiB 1.03TiB 85.79 1.22 53 osd.426
427 hdd 0.36699 1.00000 7.28TiB 5.47TiB 1.80TiB 75.20 1.07 46 osd.427
428 hdd 0.36699 1.00000 7.28TiB 5.90TiB 1.37TiB 81.11 1.15 49 osd.428
429 hdd 0.36699 1.00000 7.28TiB 5.59TiB 1.69TiB 76.82 1.09 49 osd.429
430 hdd 0.36699 1.00000 7.28TiB 6.40TiB 901GiB 87.90 1.25 51 osd.430
431 hdd 0.36699 1.00000 7.28TiB 5.91TiB 1.37TiB 81.23 1.15 51 osd.431
432 hdd 0.36699 1.00000 7.28TiB 6.10TiB 1.18TiB 83.85 1.19 51 osd.432
433 hdd 0.36699 1.00000 7.28TiB 5.76TiB 1.51TiB 79.21 1.13 47 osd.433
434 hdd 0.36699 1.00000 7.28TiB 5.50TiB 1.77TiB 75.63 1.07 47 osd.434
435 hdd 0.36699 1.00000 7.28TiB 5.80TiB 1.47TiB 79.76 1.13 47 osd.435
436 hdd 0.36699 1.00000 7.28TiB 5.85TiB 1.42TiB 80.45 1.14 47 osd.436
437 hdd 0.36699 1.00000 7.28TiB 6.03TiB 1.24TiB 82.91 1.18 49 osd.437
438 hdd 0.36699 1.00000 7.28TiB 5.60TiB 1.68TiB 76.96 1.09 48 osd.438
439 hdd 0.36699 1.00000 7.28TiB 6.33TiB 972GiB 86.96 1.24 51 osd.439
440 hdd 0.36699 1.00000 7.28TiB 5.82TiB 1.46TiB 80.00 1.14 48 osd.440
441 hdd 0.36699 1.00000 7.28TiB 5.83TiB 1.45TiB 80.08 1.14 49 osd.441
442 hdd 0.36699 1.00000 7.28TiB 6.35TiB 955GiB 87.19 1.24 51 osd.442
443 hdd 0.36699 1.00000 7.28TiB 6.05TiB 1.23TiB 83.11 1.18 52 osd.443
444 hdd 0.36699 1.00000 7.28TiB 5.58TiB 1.70TiB 76.66 1.09 47 osd.444
445 hdd 0.36699 1.00000 7.28TiB 6.38TiB 917GiB 87.69 1.25 53 osd.445
446 hdd 0.36699 1.00000 7.28TiB 5.74TiB 1.53TiB 78.92 1.12 49 osd.446
447 hdd 0.36699 1.00000 7.28TiB 6.22TiB 1.06TiB 85.44 1.21 49 osd.447
448 ssd 0.89999 1.00000 894GiB 30.9GiB 863GiB 3.46 0.05 121 osd.448
449 ssd 0.89999 1.00000 894GiB 38.7GiB 856GiB 4.33 0.06 120 osd.449
450 ssd 0.89999 1.00000 894GiB 35.7GiB 858GiB 3.99 0.06 119 osd.450
451 ssd 0.89999 1.00000 894GiB 41.5GiB 853GiB 4.64 0.07 118 osd.451
-46 12.91174 - 220TiB 175TiB 44.9TiB 79.60 1.13 - host node-03
30 hdd 0.45798 1.00000 9.10TiB 7.88TiB 1.21TiB 86.65 1.23 64 osd.30
31 hdd 0.45798 1.00000 9.10TiB 7.46TiB 1.63TiB 82.05 1.17 63 osd.31
32 hdd 0.45798 1.00000 9.10TiB 7.01TiB 2.09TiB 77.02 1.09 59 osd.32
33 hdd 0.45798 1.00000 9.10TiB 7.32TiB 1.78TiB 80.44 1.14 59 osd.33
454 hdd 0.45799 1.00000 9.10TiB 7.57TiB 1.53TiB 83.19 1.18 62 osd.454
455 hdd 0.45799 1.00000 9.10TiB 7.57TiB 1.52TiB 83.27 1.18 64 osd.455
456 hdd 0.45799 1.00000 9.10TiB 7.79TiB 1.30TiB 85.66 1.22 64 osd.456
457 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.55TiB 82.98 1.18 63 osd.457
458 hdd 0.45799 1.00000 9.10TiB 6.50TiB 2.60TiB 71.45 1.02 56 osd.458
459 hdd 0.45799 1.00000 9.10TiB 7.32TiB 1.77TiB 80.50 1.14 61 osd.459
460 hdd 0.45799 1.00000 9.10TiB 7.89TiB 1.21TiB 86.73 1.23 67 osd.460
461 hdd 0.45799 1.00000 9.10TiB 6.73TiB 2.37TiB 73.95 1.05 57 osd.461
462 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.66TiB 81.79 1.16 64 osd.462
463 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.66TiB 81.76 1.16 61 osd.463
464 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.42 1.13 58 osd.464
465 hdd 0.45799 1.00000 9.10TiB 6.79TiB 2.31TiB 74.65 1.06 56 osd.465
466 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.98TiB 78.24 1.11 59 osd.466
467 hdd 0.45799 1.00000 9.10TiB 6.95TiB 2.15TiB 76.40 1.09 59 osd.467
468 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.86TiB 79.52 1.13 62 osd.468
469 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.99TiB 78.17 1.11 60 osd.469
470 hdd 0.45799 1.00000 9.10TiB 7.67TiB 1.42TiB 84.38 1.20 65 osd.470
471 hdd 0.45799 1.00000 9.10TiB 7.07TiB 2.03TiB 77.68 1.10 58 osd.471
472 hdd 0.45799 1.00000 9.10TiB 6.94TiB 2.16TiB 76.27 1.08 61 osd.472
473 hdd 0.45799 1.00000 9.10TiB 7.53TiB 1.56TiB 82.82 1.18 62 osd.473
28 ssd 0.48000 1.00000 447GiB 19.2GiB 428GiB 4.30 0.06 61 osd.28
29 ssd 0.48000 1.00000 447GiB 12.3GiB 435GiB 2.76 0.04 63 osd.29
452 ssd 0.48000 1.00000 447GiB 29.3GiB 418GiB 6.56 0.09 68 osd.452
453 ssd 0.48000 1.00000 447GiB 14.0GiB 433GiB 3.13 0.04 61 osd.453
-5 12.91180 - 220TiB 175TiB 45.4TiB 79.38 1.13 - host node-05
4 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.87TiB 79.49 1.13 60 osd.4
5 hdd 0.45799 1.00000 9.10TiB 7.24TiB 1.85TiB 79.61 1.13 61 osd.5
6 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.63TiB 82.06 1.17 64 osd.6
7 hdd 0.45799 1.00000 9.10TiB 7.65TiB 1.44TiB 84.13 1.20 63 osd.7
8 hdd 0.45799 1.00000 9.10TiB 7.43TiB 1.67TiB 81.64 1.16 60 osd.8
9 hdd 0.45799 1.00000 9.10TiB 7.45TiB 1.65TiB 81.88 1.16 62 osd.9
10 hdd 0.45799 1.00000 9.10TiB 6.94TiB 2.16TiB 76.26 1.08 60 osd.10
11 hdd 0.45799 1.00000 9.10TiB 7.88TiB 1.22TiB 86.59 1.23 65 osd.11
12 hdd 0.45799 1.00000 9.10TiB 7.02TiB 2.07TiB 77.22 1.10 62 osd.12
13 hdd 0.45799 1.00000 9.10TiB 7.00TiB 2.10TiB 76.94 1.09 57 osd.13
14 hdd 0.45799 1.00000 9.10TiB 7.69TiB 1.41TiB 84.51 1.20 63 osd.14
15 hdd 0.45799 1.00000 9.10TiB 6.82TiB 2.28TiB 74.96 1.07 58 osd.15
16 hdd 0.45799 1.00000 9.10TiB 7.64TiB 1.45TiB 84.04 1.19 63 osd.16
17 hdd 0.45799 1.00000 9.10TiB 7.45TiB 1.64TiB 81.94 1.16 64 osd.17
18 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.98TiB 78.19 1.11 59 osd.18
19 hdd 0.45799 1.00000 9.10TiB 7.24TiB 1.85TiB 79.65 1.13 61 osd.19
20 hdd 0.45799 1.00000 9.10TiB 7.21TiB 1.89TiB 79.25 1.13 60 osd.20
21 hdd 0.45799 1.00000 9.10TiB 7.68TiB 1.42TiB 84.40 1.20 62 osd.21
22 hdd 0.45799 1.00000 9.10TiB 6.81TiB 2.28TiB 74.89 1.06 59 osd.22
23 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.55TiB 82.99 1.18 62 osd.23
24 hdd 0.45799 1.00000 9.10TiB 7.04TiB 2.05TiB 77.44 1.10 63 osd.24
25 hdd 0.45799 1.00000 9.10TiB 6.81TiB 2.29TiB 74.86 1.06 57 osd.25
26 hdd 0.45799 1.00000 9.10TiB 7.29TiB 1.80TiB 80.16 1.14 61 osd.26
27 hdd 0.45799 1.00000 9.10TiB 6.94TiB 2.16TiB 76.27 1.08 58 osd.27
0 ssd 0.48000 1.00000 447GiB 26.4GiB 421GiB 5.90 0.08 68 osd.0
1 ssd 0.48000 1.00000 447GiB 23.2GiB 424GiB 5.18 0.07 67 osd.1
2 ssd 0.48000 1.00000 447GiB 18.7GiB 428GiB 4.18 0.06 64 osd.2
3 ssd 0.48000 1.00000 447GiB 21.9GiB 425GiB 4.89 0.07 63 osd.3
-53 12.91180 - 220TiB 176TiB 43.9TiB 80.06 1.14 - host node-07
478 hdd 0.45799 1.00000 9.10TiB 7.02TiB 2.08TiB 77.19 1.10 59 osd.478
479 hdd 0.45799 1.00000 9.10TiB 7.72TiB 1.38TiB 84.86 1.21 62 osd.479
480 hdd 0.45799 1.00000 9.10TiB 7.24TiB 1.86TiB 79.59 1.13 60 osd.480
481 hdd 0.45799 1.00000 9.10TiB 6.92TiB 2.18TiB 76.07 1.08 57 osd.481
482 hdd 0.45799 1.00000 9.10TiB 6.91TiB 2.18TiB 76.00 1.08 59 osd.482
483 hdd 0.45799 1.00000 9.10TiB 7.75TiB 1.35TiB 85.17 1.21 63 osd.483
484 hdd 0.45799 1.00000 9.10TiB 7.34TiB 1.75TiB 80.73 1.15 62 osd.484
485 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.87TiB 79.45 1.13 62 osd.485
486 hdd 0.45799 1.00000 9.10TiB 7.66TiB 1.43TiB 84.27 1.20 65 osd.486
487 hdd 0.45799 1.00000 9.10TiB 8.11TiB 1006GiB 89.20 1.27 67 osd.487
488 hdd 0.45799 1.00000 9.10TiB 7.14TiB 1.95TiB 78.52 1.12 59 osd.488
489 hdd 0.45799 1.00000 9.10TiB 7.17TiB 1.93TiB 78.79 1.12 60 osd.489
490 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.65TiB 81.85 1.16 64 osd.490
491 hdd 0.45799 1.00000 9.10TiB 6.34TiB 2.75TiB 69.75 0.99 54 osd.491
492 hdd 0.45799 1.00000 9.10TiB 6.93TiB 2.16TiB 76.22 1.08 57 osd.492
493 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.97TiB 78.35 1.11 61 osd.493
494 hdd 0.45799 1.00000 9.10TiB 7.25TiB 1.85TiB 79.70 1.13 61 osd.494
495 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.86TiB 79.51 1.13 61 osd.495
496 hdd 0.45799 1.00000 9.10TiB 7.40TiB 1.69TiB 81.37 1.16 62 osd.496
497 hdd 0.45799 1.00000 9.10TiB 7.35TiB 1.75TiB 80.81 1.15 65 osd.497
498 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.42 1.13 61 osd.498
499 hdd 0.45799 1.00000 9.10TiB 7.65TiB 1.45TiB 84.10 1.20 63 osd.499
500 hdd 0.45799 1.00000 9.10TiB 7.81TiB 1.28TiB 85.91 1.22 63 osd.500
501 hdd 0.45799 1.00000 9.10TiB 8.11TiB 1009GiB 89.17 1.27 67 osd.501
474 ssd 0.48000 1.00000 447GiB 26.5GiB 421GiB 5.93 0.08 66 osd.474
475 ssd 0.48000 1.00000 447GiB 21.5GiB 426GiB 4.81 0.07 62 osd.475
476 ssd 0.48000 1.00000 447GiB 18.8GiB 428GiB 4.21 0.06 64 osd.476
477 ssd 0.48000 1.00000 447GiB 16.7GiB 430GiB 3.73 0.05 65 osd.477
-77 12.91180 - 220TiB 174TiB 45.6TiB 79.29 1.13 - host node-09
506 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.97TiB 78.31 1.11 59 osd.506
507 hdd 0.45799 1.00000 9.10TiB 6.68TiB 2.42TiB 73.40 1.04 59 osd.507
508 hdd 0.45799 1.00000 9.10TiB 7.54TiB 1.55TiB 82.91 1.18 63 osd.508
509 hdd 0.45799 1.00000 9.10TiB 6.72TiB 2.38TiB 73.88 1.05 58 osd.509
510 hdd 0.45799 1.00000 9.10TiB 8.08TiB 1.02TiB 88.79 1.26 66 osd.510
511 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.76TiB 80.60 1.15 61 osd.511
512 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.77TiB 80.57 1.14 62 osd.512
513 hdd 0.45799 1.00000 9.10TiB 6.81TiB 2.29TiB 74.87 1.06 61 osd.513
514 hdd 0.45799 1.00000 9.10TiB 7.17TiB 1.92TiB 78.87 1.12 58 osd.514
515 hdd 0.45799 1.00000 9.10TiB 7.66TiB 1.44TiB 84.21 1.20 64 osd.515
516 hdd 0.45799 1.00000 9.10TiB 7.67TiB 1.42TiB 84.35 1.20 63 osd.516
517 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.97TiB 78.37 1.11 60 osd.517
518 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.77TiB 80.58 1.15 62 osd.518
519 hdd 0.45799 1.00000 9.10TiB 6.91TiB 2.18TiB 75.98 1.08 58 osd.519
520 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.86TiB 79.53 1.13 62 osd.520
521 hdd 0.45799 1.00000 9.10TiB 8.22TiB 902GiB 90.32 1.28 67 osd.521
522 hdd 0.45799 1.00000 9.10TiB 7.55TiB 1.54TiB 83.05 1.18 63 osd.522
523 hdd 0.45799 1.00000 9.10TiB 6.90TiB 2.19TiB 75.89 1.08 58 osd.523
524 hdd 0.45799 1.00000 9.10TiB 7.42TiB 1.68TiB 81.57 1.16 59 osd.524
525 hdd 0.45799 1.00000 9.10TiB 6.74TiB 2.35TiB 74.12 1.05 58 osd.525
526 hdd 0.45799 1.00000 9.10TiB 7.34TiB 1.76TiB 80.70 1.15 61 osd.526
527 hdd 0.45799 1.00000 9.10TiB 7.35TiB 1.75TiB 80.77 1.15 63 osd.527
528 hdd 0.45799 1.00000 9.10TiB 7.48TiB 1.61TiB 82.28 1.17 62 osd.528
529 hdd 0.45799 1.00000 9.10TiB 6.68TiB 2.42TiB 73.44 1.04 55 osd.529
502 ssd 0.48000 1.00000 447GiB 22.0GiB 425GiB 4.92 0.07 70 osd.502
503 ssd 0.48000 1.00000 447GiB 16.3GiB 431GiB 3.64 0.05 63 osd.503
504 ssd 0.48000 1.00000 447GiB 23.5GiB 424GiB 5.25 0.07 66 osd.504
505 ssd 0.48000 1.00000 447GiB 20.8GiB 426GiB 4.65 0.07 66 osd.505
-79 12.91180 - 211TiB 168TiB 42.8TiB 79.69 1.13 - host node-11
530 hdd 0.45799 1.00000 9.10TiB 7.15TiB 1.95TiB 78.57 1.12 61 osd.530
531 hdd 0.45799 1.00000 9.10TiB 6.79TiB 2.31TiB 74.60 1.06 58 osd.531
532 hdd 0.45799 1.00000 9.10TiB 7.75TiB 1.34TiB 85.25 1.21 64 osd.532
533 hdd 0.45799 1.00000 9.10TiB 8.09TiB 1.00TiB 88.99 1.26 67 osd.533
534 hdd 0.45799 1.00000 9.10TiB 7.70TiB 1.40TiB 84.66 1.20 64 osd.534
535 hdd 0.45799 1.00000 9.10TiB 7.01TiB 2.08TiB 77.11 1.10 60 osd.535
536 hdd 0.45799 0 0B 0B 0B 0 0 0 osd.536
537 hdd 0.45799 1.00000 9.10TiB 7.04TiB 2.06TiB 77.37 1.10 60 osd.537
538 hdd 0.45799 1.00000 9.10TiB 7.33TiB 1.76TiB 80.63 1.15 61 osd.538
539 hdd 0.45799 1.00000 9.10TiB 7.32TiB 1.78TiB 80.45 1.14 59 osd.539
540 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.39 1.13 60 osd.540
541 hdd 0.45799 1.00000 9.10TiB 7.86TiB 1.23TiB 86.44 1.23 64 osd.541
542 hdd 0.45799 1.00000 9.10TiB 6.89TiB 2.21TiB 75.73 1.08 57 osd.542
543 hdd 0.45799 1.00000 9.10TiB 8.00TiB 1.10TiB 87.93 1.25 64 osd.543
544 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.99TiB 78.15 1.11 58 osd.544
549 hdd 0.45799 1.00000 9.10TiB 7.51TiB 1.59TiB 82.53 1.17 64 osd.549
550 hdd 0.45799 1.00000 9.10TiB 7.10TiB 2.00TiB 78.05 1.11 61 osd.550
551 hdd 0.45799 1.00000 9.10TiB 7.48TiB 1.61TiB 82.28 1.17 62 osd.551
552 hdd 0.45799 1.00000 9.10TiB 7.36TiB 1.74TiB 80.88 1.15 62 osd.552
553 hdd 0.45799 1.00000 9.10TiB 7.01TiB 2.08TiB 77.11 1.10 60 osd.553
554 hdd 0.45799 1.00000 9.10TiB 7.11TiB 1.98TiB 78.21 1.11 59 osd.554
555 hdd 0.45799 1.00000 9.10TiB 6.90TiB 2.19TiB 75.90 1.08 58 osd.555
556 hdd 0.45799 1.00000 9.10TiB 7.37TiB 1.73TiB 81.00 1.15 63 osd.556
557 hdd 0.45799 1.00000 9.10TiB 6.89TiB 2.20TiB 75.80 1.08 58 osd.557
545 ssd 0.48000 1.00000 447GiB 29.0GiB 418GiB 6.48 0.09 68 osd.545
546 ssd 0.48000 1.00000 447GiB 22.0GiB 425GiB 4.92 0.07 64 osd.546
547 ssd 0.48000 1.00000 447GiB 24.1GiB 423GiB 5.39 0.08 68 osd.547
548 ssd 0.48000 1.00000 447GiB 27.4GiB 420GiB 6.12 0.09 63 osd.548
-81 12.91180 - 220TiB 175TiB 45.3TiB 79.43 1.13 - host node-13
562 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.87TiB 79.49 1.13 59 osd.562
563 hdd 0.45799 1.00000 9.10TiB 7.39TiB 1.71TiB 81.22 1.15 60 osd.563
564 hdd 0.45799 1.00000 9.10TiB 7.00TiB 2.09TiB 76.98 1.09 58 osd.564
565 hdd 0.45799 1.00000 9.10TiB 7.68TiB 1.42TiB 84.41 1.20 64 osd.565
566 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.87TiB 79.40 1.13 58 osd.566
567 hdd 0.45799 1.00000 9.10TiB 7.48TiB 1.62TiB 82.23 1.17 62 osd.567
568 hdd 0.45799 1.00000 9.10TiB 7.10TiB 1.99TiB 78.11 1.11 60 osd.568
569 hdd 0.45799 1.00000 9.10TiB 7.37TiB 1.72TiB 81.04 1.15 59 osd.569
570 hdd 0.45799 1.00000 9.10TiB 6.74TiB 2.35TiB 74.14 1.05 56 osd.570
571 hdd 0.45799 1.00000 9.10TiB 8.21TiB 907GiB 90.26 1.28 67 osd.571
572 hdd 0.45799 1.00000 9.10TiB 7.65TiB 1.45TiB 84.06 1.19 63 osd.572
573 hdd 0.45799 1.00000 9.10TiB 7.22TiB 1.88TiB 79.34 1.13 60 osd.573
574 hdd 0.45799 1.00000 9.10TiB 7.24TiB 1.86TiB 79.56 1.13 60 osd.574
575 hdd 0.45799 1.00000 9.10TiB 7.35TiB 1.75TiB 80.78 1.15 61 osd.575
576 hdd 0.45799 1.00000 9.10TiB 7.65TiB 1.45TiB 84.09 1.19 61 osd.576
577 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.96TiB 78.41 1.11 59 osd.577
578 hdd 0.45799 1.00000 9.10TiB 6.81TiB 2.28TiB 74.90 1.06 57 osd.578
579 hdd 0.45799 1.00000 9.10TiB 7.79TiB 1.30TiB 85.65 1.22 65 osd.579
580 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.96TiB 78.44 1.11 60 osd.580
581 hdd 0.45799 1.00000 9.10TiB 6.71TiB 2.39TiB 73.74 1.05 56 osd.581
582 hdd 0.45799 1.00000 9.10TiB 7.43TiB 1.67TiB 81.64 1.16 62 osd.582
583 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.96TiB 78.41 1.11 59 osd.583
584 hdd 0.45799 1.00000 9.10TiB 6.67TiB 2.42TiB 73.36 1.04 56 osd.584
585 hdd 0.45799 1.00000 9.10TiB 7.36TiB 1.74TiB 80.88 1.15 62 osd.585
558 ssd 0.48000 1.00000 447GiB 22.2GiB 425GiB 4.96 0.07 65 osd.558
559 ssd 0.48000 1.00000 447GiB 17.9GiB 429GiB 4.00 0.06 63 osd.559
560 ssd 0.48000 1.00000 447GiB 27.6GiB 420GiB 6.17 0.09 68 osd.560
561 ssd 0.48000 1.00000 447GiB 18.1GiB 429GiB 4.05 0.06 66 osd.561
-83 12.91180 - 220TiB 176TiB 43.9TiB 80.03 1.14 - host node-15
590 hdd 0.45799 1.00000 9.10TiB 6.90TiB 2.20TiB 75.81 1.08 58 osd.590
591 hdd 0.45799 1.00000 9.10TiB 7.80TiB 1.30TiB 85.71 1.22 65 osd.591
592 hdd 0.45799 1.00000 9.10TiB 7.43TiB 1.66TiB 81.74 1.16 62 osd.592
593 hdd 0.45799 1.00000 9.10TiB 7.21TiB 1.89TiB 79.23 1.13 58 osd.593
594 hdd 0.45799 1.00000 9.10TiB 7.45TiB 1.65TiB 81.88 1.16 64 osd.594
595 hdd 0.45799 1.00000 9.10TiB 7.36TiB 1.74TiB 80.89 1.15 60 osd.595
596 hdd 0.45799 1.00000 9.10TiB 6.39TiB 2.71TiB 70.22 1.00 55 osd.596
597 hdd 0.45799 1.00000 9.10TiB 7.59TiB 1.51TiB 83.42 1.19 62 osd.597
598 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.86TiB 79.52 1.13 63 osd.598
599 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.87TiB 79.43 1.13 62 osd.599
600 hdd 0.45799 1.00000 9.10TiB 7.13TiB 1.97TiB 78.36 1.11 59 osd.600
601 hdd 0.45799 1.00000 9.10TiB 7.06TiB 2.04TiB 77.60 1.10 59 osd.601
602 hdd 0.45799 1.00000 9.10TiB 7.32TiB 1.77TiB 80.51 1.14 60 osd.602
603 hdd 0.45799 1.00000 9.10TiB 6.89TiB 2.20TiB 75.79 1.08 59 osd.603
604 hdd 0.45799 1.00000 9.10TiB 7.03TiB 2.06TiB 77.32 1.10 60 osd.604
605 hdd 0.45799 1.00000 9.10TiB 7.79TiB 1.31TiB 85.62 1.22 64 osd.605
606 hdd 0.45799 1.00000 9.10TiB 7.21TiB 1.88TiB 79.30 1.13 59 osd.606
607 hdd 0.45799 1.00000 9.10TiB 7.58TiB 1.51TiB 83.36 1.18 62 osd.607
608 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.63TiB 82.03 1.17 60 osd.608
609 hdd 0.45799 1.00000 9.10TiB 7.46TiB 1.64TiB 81.98 1.16 62 osd.609
610 hdd 0.45799 1.00000 9.10TiB 7.54TiB 1.56TiB 82.84 1.18 62 osd.610
611 hdd 0.45799 1.00000 9.10TiB 7.76TiB 1.33TiB 85.34 1.21 63 osd.611
612 hdd 0.45799 1.00000 9.10TiB 7.56TiB 1.54TiB 83.10 1.18 64 osd.612
613 hdd 0.45799 1.00000 9.10TiB 7.65TiB 1.44TiB 84.15 1.20 64 osd.613
586 ssd 0.48000 1.00000 447GiB 21.4GiB 426GiB 4.78 0.07 63 osd.586
587 ssd 0.48000 1.00000 447GiB 21.9GiB 425GiB 4.89 0.07 65 osd.587
588 ssd 0.48000 1.00000 447GiB 30.4GiB 417GiB 6.80 0.10 70 osd.588
589 ssd 0.48000 1.00000 447GiB 18.4GiB 429GiB 4.12 0.06 62 osd.589
-85 12.91180 - 220TiB 179TiB 40.6TiB 81.56 1.16 - host node-17
618 hdd 0.45799 1.00000 9.10TiB 7.99TiB 1.10TiB 87.87 1.25 67 osd.618
619 hdd 0.45799 1.00000 9.10TiB 7.89TiB 1.21TiB 86.71 1.23 67 osd.619
620 hdd 0.45799 1.00000 9.10TiB 6.82TiB 2.28TiB 74.95 1.06 57 osd.620
621 hdd 0.45799 1.00000 9.10TiB 7.57TiB 1.52TiB 83.24 1.18 63 osd.621
622 hdd 0.45799 1.00000 9.10TiB 7.00TiB 2.09TiB 77.00 1.09 57 osd.622
623 hdd 0.45799 1.00000 9.10TiB 7.98TiB 1.12TiB 87.73 1.25 65 osd.623
624 hdd 0.45799 1.00000 9.10TiB 7.80TiB 1.29TiB 85.77 1.22 66 osd.624
625 hdd 0.45799 1.00000 9.10TiB 7.03TiB 2.06TiB 77.33 1.10 60 osd.625
626 hdd 0.45799 1.00000 9.10TiB 7.81TiB 1.29TiB 85.84 1.22 64 osd.626
627 hdd 0.45799 1.00000 9.10TiB 7.80TiB 1.29TiB 85.79 1.22 64 osd.627
628 hdd 0.45799 1.00000 9.10TiB 8.19TiB 925GiB 90.06 1.28 64 osd.628
629 hdd 0.45799 1.00000 9.10TiB 7.23TiB 1.87TiB 79.47 1.13 60 osd.629
630 hdd 0.45799 1.00000 9.10TiB 6.89TiB 2.20TiB 75.79 1.08 57 osd.630
631 hdd 0.45799 1.00000 9.10TiB 7.65TiB 1.45TiB 84.08 1.19 63 osd.631
632 hdd 0.45799 1.00000 9.10TiB 7.32TiB 1.77TiB 80.49 1.14 60 osd.632
633 hdd 0.45799 1.00000 9.10TiB 7.58TiB 1.52TiB 83.32 1.18 64 osd.633
634 hdd 0.45799 1.00000 9.10TiB 7.12TiB 1.97TiB 78.30 1.11 59 osd.634
635 hdd 0.45799 1.00000 9.10TiB 7.34TiB 1.75TiB 80.73 1.15 64 osd.635
636 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.66TiB 81.75 1.16 61 osd.636
637 hdd 0.45799 1.00000 9.10TiB 7.21TiB 1.88TiB 79.31 1.13 60 osd.637
638 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.65TiB 81.81 1.16 62 osd.638
639 hdd 0.45799 1.00000 9.10TiB 7.77TiB 1.33TiB 85.41 1.21 64 osd.639
640 hdd 0.45799 1.00000 9.10TiB 7.06TiB 2.04TiB 77.63 1.10 60 osd.640
641 hdd 0.45799 1.00000 9.10TiB 7.44TiB 1.65TiB 81.81 1.16 62 osd.641
614 ssd 0.48000 1.00000 447GiB 22.6GiB 424GiB 5.06 0.07 65 osd.614
615 ssd 0.48000 1.00000 447GiB 20.1GiB 427GiB 4.49 0.06 65 osd.615
616 ssd 0.48000 1.00000 447GiB 22.0GiB 425GiB 4.91 0.07 67 osd.616
617 ssd 0.48000 1.00000 447GiB 26.0GiB 421GiB 5.81 0.08 70 osd.617
-12 5.79991 - 317TiB 60.8TiB 256TiB 19.21 0.27 - host node-99
64 hdd 0.20000 1.00000 10.9TiB 1.83TiB 9.08TiB 16.80 0.24 14 osd.64
65 hdd 0.20000 1.00000 10.9TiB 2.37TiB 8.55TiB 21.68 0.31 18 osd.65
66 hdd 0.20000 1.00000 10.9TiB 2.57TiB 8.35TiB 23.54 0.33 21 osd.66
67 hdd 0.20000 1.00000 10.9TiB 2.36TiB 8.56TiB 21.59 0.31 19 osd.67
68 hdd 0.20000 1.00000 10.9TiB 1.14TiB 9.78TiB 10.43 0.15 9 osd.68
69 hdd 0.20000 1.00000 10.9TiB 2.53TiB 8.38TiB 23.21 0.33 17 osd.69
70 hdd 0.20000 1.00000 10.9TiB 2.29TiB 8.62TiB 20.99 0.30 19 osd.70
71 hdd 0.20000 1.00000 10.9TiB 1.88TiB 9.03TiB 17.24 0.25 14 osd.71
72 hdd 0.20000 1.00000 10.9TiB 2.91TiB 8.00TiB 26.68 0.38 22 osd.72
73 hdd 0.20000 1.00000 10.9TiB 2.87TiB 8.05TiB 26.28 0.37 24 osd.73
74 hdd 0.20000 1.00000 10.9TiB 1.77TiB 9.14TiB 16.23 0.23 14 osd.74
75 hdd 0.20000 1.00000 10.9TiB 2.52TiB 8.40TiB 23.08 0.33 18 osd.75
76 hdd 0.20000 1.00000 10.9TiB 2.37TiB 8.54TiB 21.75 0.31 16 osd.76
77 hdd 0.20000 1.00000 10.9TiB 2.24TiB 8.68TiB 20.52 0.29 18 osd.77
78 hdd 0.20000 1.00000 10.9TiB 2.56TiB 8.36TiB 23.43 0.33 21 osd.78
79 hdd 0.20000 1.00000 10.9TiB 1.66TiB 9.25TiB 15.25 0.22 13 osd.79
80 hdd 0.20000 1.00000 10.9TiB 2.21TiB 8.70TiB 20.28 0.29 16 osd.80
81 hdd 0.20000 1.00000 10.9TiB 1.75TiB 9.17TiB 16.04 0.23 14 osd.81
82 hdd 0.20000 1.00000 10.9TiB 1.70TiB 9.22TiB 15.54 0.22 13 osd.82
83 hdd 0.20000 1.00000 10.9TiB 1.69TiB 9.23TiB 15.44 0.22 14 osd.83
84 hdd 0.20000 1.00000 10.9TiB 2.67TiB 8.25TiB 24.46 0.35 21 osd.84
85 hdd 0.20000 1.00000 10.9TiB 1.65TiB 9.27TiB 15.12 0.21 13 osd.85
86 hdd 0.20000 1.00000 10.9TiB 1.04TiB 9.87TiB 9.57 0.14 7 osd.86
87 hdd 0.20000 1.00000 10.9TiB 1.72TiB 9.20TiB 15.77 0.22 13 osd.87
88 hdd 0.20000 1.00000 10.9TiB 2.28TiB 8.64TiB 20.85 0.30 17 osd.88
89 hdd 0.20000 1.00000 10.9TiB 2.21TiB 8.71TiB 20.25 0.29 16 osd.89
90 hdd 0.20000 1.00000 10.9TiB 2.05TiB 8.87TiB 18.74 0.27 16 osd.90
91 hdd 0.20000 1.00000 10.9TiB 1.96TiB 8.96TiB 17.96 0.26 14 osd.91
92 hdd 0.20000 1.00000 10.9TiB 2.01TiB 8.91TiB 18.40 0.26 15 osd.92
TOTAL 4.70PiB 3.30PiB 1.40PiB 70.37
MIN/MAX VAR: 0.00/1.35 STDDEV: 30.44
--
Graham Allan
Minnesota Supercomputing Institute - gta@xxxxxxx
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
