Hi all,
We are using cephfs to make a copy of another fs via rsync, and
also use snapshots.
I'm seeing this issue now and then when I try to delete files on
cephFS:
[root@osd001 ~]# rm -f /mnt/ceph/backups/osd00*
rm: cannot remove
‘/mnt/ceph/backups/osd001.gigalith.os-3eea7740.1542483’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd001.gigalith.os-b2f21740.1557247’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd001.gigalith.os-ca3be740.1549780’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd002.gigalith.os-1b437740.1173950’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd002.gigalith.os-92186740.1169503’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd002.gigalith.os-e9260740.1178280’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd003.gigalith.os-2dec5740.2025571’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd003.gigalith.os-e5f94740.2029993’: No
space left on device
rm: cannot remove
‘/mnt/ceph/backups/osd004.gigalith.os-f4a9740.364609’: No space
left on device
The cluster is healthy at this moment, and we have certainly
enough space (see also osd df below)
[root@osd001 ~]# ceph -s
cluster:
id: 92bfcf0a-1d39-43b3-b60f-44f01b630e47
health: HEALTH_OK
services:
mon: 3 daemons, quorum mds01,mds02,mds03
mgr: mds02(active), standbys: mds03, mds01
mds: ceph_fs-2/2/2 up
{0=mds01=up:active,1=mds02=up:active}, 1 up:standby
osd: 536 osds: 536 up, 536 in
data:
pools: 3 pools, 3328 pgs
objects: 451.5 M objects, 762 TiB
usage: 1.1 PiB used, 2.0 PiB / 3.2 PiB avail
pgs: 1280 active+clean
1138 active+clean+snaptrim_wait
899 active+clean+snaptrim
9 active+clean+scrubbing+deep
2 active+clean+scrubbing
io:
client: 0 B/s wr, 0 op/s rd, 0 op/s wr
There is also nothing in the mds log.
We tuned the mds already before:
[mds]
mds_cache_memory_limit=21474836480
mds_log_max_expiring=200
mds_log_max_segments=200
mds_max_purge_files=2560
mds_max_purge_ops=327600
mds_max_purge_ops_per_pg=20
I tried restarting the mds, flushing the mds journals, and do a
remount on the client, but that does not help - after some time it
just works again..
What can I do to debug / tune this further ?
Thanks!!
Kenneth
ceph osd df :
ID CLASS WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR
PGS
546 ssd 0.14699 1.00000 151 GiB 67 GiB 84 GiB 44.30 1.23 512
547 ssd 0.14699 1.00000 151 GiB 68 GiB 83 GiB 45.27 1.26 512
0 ssd 0.14699 1.00000 151 GiB 66 GiB 85 GiB 43.88 1.22 515
1 ssd 0.14699 1.00000 151 GiB 66 GiB 85 GiB 43.65 1.21 509
2 ssd 0.14699 1.00000 151 GiB 67 GiB 84 GiB 44.53 1.24 511
3 ssd 0.14699 1.00000 151 GiB 67 GiB 84 GiB 44.39 1.23 513
540 fast 0.14799 1.00000 151 GiB 3.1 GiB 148 GiB 2.05 0.06 0
541 fast 0.14799 1.00000 151 GiB 3.1 GiB 148 GiB 2.05 0.06 0
528 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.50 1.07 31
529 hdd 3.63899 1.00000 3.6 TiB 2.1 TiB 1.6 TiB 56.96 1.58 42
530 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.85 1.11 31
531 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.91 1.11 30
532 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.75 1.19 34
533 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.60 0.99 31
534 hdd 3.63899 1.00000 3.6 TiB 2.2 TiB 1.4 TiB 61.22 1.70 46
535 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.02 1.03 33
536 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.89 1.11 30
537 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.35 0.87 24
538 hdd 3.63899 1.00000 3.6 TiB 2.3 TiB 1.4 TiB 62.68 1.74 53
539 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.27 1.43 40
542 hdd 3.63899 1.00000 3.6 TiB 2.2 TiB 1.5 TiB 59.81 1.66 46
543 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.27 1.15 35
544 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.58 0.99 28
545 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.73 0.91 28
520 fast 0.14799 1.00000 151 GiB 3.8 GiB 147 GiB 2.53 0.07 0
522 fast 0.14799 1.00000 151 GiB 3.8 GiB 147 GiB 2.53 0.07 0
496 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.41 1.35 35
498 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.6 TiB 29.88 0.83 27
500 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.6 TiB 55.49 1.54 43
502 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.48 1.07 31
504 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.6 TiB 29.90 0.83 24
510 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.16 0.95 28
512 hdd 3.63899 1.00000 3.6 TiB 955 GiB 2.7 TiB 25.64 0.71 22
514 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.03 1.03 31
516 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.73 1.19 37
518 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.39 1.35 38
524 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.60 0.99 28
525 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.7 TiB 52.69 1.47 45
527 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.14 1.23 35
513 fast 0.14799 1.00000 151 GiB 6.1 GiB 145 GiB 4.03 0.11 0
515 fast 0.14799 1.00000 151 GiB 6.1 GiB 145 GiB 4.03 0.11 0
492 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.14 1.23 34
493 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 46.95 1.31 33
494 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.03 1.03 28
495 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.28 1.15 34
497 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.75 0.91 31
499 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.75 0.91 28
501 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.55 1.27 36
503 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.58 0.99 28
505 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.7 TiB 52.67 1.47 38
507 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.59 1.27 33
509 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.28 1.15 37
511 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.33 0.87 26
517 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.21 0.95 27
519 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.18 0.95 29
521 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.77 0.91 28
523 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.14 1.23 34
486 fast 0.14799 1.00000 151 GiB 1.1 GiB 150 GiB 0.73 0.02 0
487 fast 0.14799 1.00000 151 GiB 1.1 GiB 150 GiB 0.73 0.02 0
56 hdd 3.63869 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 46.96 1.31 34
473 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.48 1.07 31
475 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.27 1.43 43
478 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.73 1.19 34
479 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.57 1.27 34
480 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.12 1.23 35
481 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.38 1.35 36
482 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.86 1.11 30
483 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 39.84 1.11 31
484 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.30 1.15 33
485 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.82 1.39 39
488 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.27 1.15 32
489 hdd 3.63899 1.00000 3.6 TiB 2.4 TiB 1.3 TiB 65.51 1.82 50
490 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.40 1.35 38
491 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.87 1.11 32
468 fast 0.14799 1.00000 151 GiB 3.8 GiB 147 GiB 2.53 0.07 0
469 fast 0.14799 1.00000 151 GiB 3.8 GiB 147 GiB 2.53 0.07 0
456 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.69 1.19 31
458 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 47.00 1.31 38
459 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.16 0.95 28
460 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.6 TiB 29.88 0.83 26
461 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.60 1.27 35
462 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.49 0.79 24
463 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.03 1.03 31
464 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.74 0.91 26
465 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.85 1.39 39
466 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.71 1.19 34
467 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.25 1.43 40
470 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.65 0.99 30
472 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 46.94 1.31 39
474 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.43 1.07 31
476 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.33 0.87 24
447 fast 0.14799 1.00000 151 GiB 6.1 GiB 145 GiB 4.03 0.11 0
449 fast 0.14799 1.00000 151 GiB 6.1 GiB 145 GiB 4.03 0.11 0
153 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.41 1.35 39
155 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.73 1.19 33
427 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.6 TiB 55.48 1.54 40
429 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.50 0.79 27
431 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.81 1.39 38
433 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.01 1.03 30
435 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 46.99 1.31 36
437 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 47.01 1.31 40
439 hdd 3.63899 1.00000 3.6 TiB 2.1 TiB 1.6 TiB 56.92 1.58 43
441 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.55 1.27 34
443 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.50 0.79 24
445 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.77 0.91 26
451 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.02 1.03 26
453 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.61 0.99 31
454 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 47.02 1.31 38
455 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.85 1.39 38
442 fast 0.14799 1.00000 151 GiB 1.1 GiB 150 GiB 0.73 0.02 0
444 fast 0.14799 1.00000 151 GiB 1.1 GiB 150 GiB 0.73 0.02 0
150 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.87 1.11 29
151 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.61 1.27 36
152 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.76 1.19 32
154 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.62 0.99 27
426 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.87 1.11 32
428 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.27 1.43 40
430 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.7 TiB 54.10 1.51 43
432 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 29.93 0.83 25
434 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.30 1.15 30
436 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.30 1.15 31
438 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.04 1.03 30
440 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.90 1.39 40
446 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.32 1.15 32
448 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.90 1.11 34
450 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.6 TiB 55.53 1.54 41
452 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.31 1.15 37
138 fast 0.14799 1.00000 151 GiB 6.1 GiB 145 GiB 4.03 0.11 0
140 fast 0.14799 1.00000 151 GiB 6.1 GiB 145 GiB 4.03 0.11 0
114 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.97 1.11 31
116 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.32 0.95 29
118 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 30.05 0.84 23
120 hdd 3.63899 1.00000 3.6 TiB 1015 GiB 2.6 TiB 27.23 0.76 23
122 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.86 1.19 34
124 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.90 0.92 25
126 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 30.08 0.84 27
128 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.3 TiB 37.16 1.03 29
130 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.27 1.15 31
132 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.40 1.15 33
134 hdd 3.63899 1.00000 3.6 TiB 856 GiB 2.8 TiB 22.97 0.64 18
136 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 46.99 1.31 34
142 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.97 1.39 37
144 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.62 1.07 28
146 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.48 0.79 25
148 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.14 1.23 33
139 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.61 0.16 0
141 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.61 0.16 0
115 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.30 1.15 32
117 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.61 0.99 29
119 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.57 0.99 29
121 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.43 1.07 30
123 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.27 1.43 38
125 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.70 1.19 35
127 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.85 1.39 39
129 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.02 1.03 31
131 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.36 0.87 24
133 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.03 1.03 30
135 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.53 1.27 37
137 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.41 1.35 37
143 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.43 1.35 38
145 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.20 0.95 24
147 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.23 1.43 41
108 fast 0.14799 1.00000 151 GiB 8.2 GiB 143 GiB 5.42 0.15 0
109 fast 0.14799 1.00000 151 GiB 8.2 GiB 143 GiB 5.42 0.15 0
96 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.19 0.95 28
97 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.76 1.19 38
98 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.69 1.19 32
99 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.77 0.91 29
100 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.7 TiB 52.65 1.46 42
101 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.31 1.15 37
102 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.86 1.11 29
103 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.20 0.95 26
104 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.69 1.19 34
106 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.58 0.99 29
107 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.69 1.19 35
110 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.24 1.43 37
111 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.86 1.11 31
112 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.6 TiB 29.90 0.83 24
113 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.29 1.15 36
90 fast 0.14799 1.00000 151 GiB 5.8 GiB 145 GiB 3.87 0.11 0
91 fast 0.14799 1.00000 151 GiB 5.8 GiB 145 GiB 3.87 0.11 0
78 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.72 1.19 32
79 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.56 1.27 33
80 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.17 1.23 33
81 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 29.94 0.83 26
82 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.85 1.11 33
83 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.86 1.11 32
84 hdd 3.63899 1.00000 3.6 TiB 850 GiB 2.8 TiB 22.81 0.63 19
85 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.00 1.03 30
86 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.56 1.27 37
87 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.02 1.03 29
88 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.31 0.87 23
89 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.12 1.23 37
92 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.61 0.99 30
93 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.14 0.95 26
94 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.47 1.07 30
95 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.04 1.03 35
36 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.61 0.16 0
37 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.61 0.16 0
24 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.6 TiB 55.48 1.54 41
25 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.16 1.23 36
26 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.17 0.95 26
27 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.32 1.15 33
28 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.76 0.91 29
29 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.27 1.43 38
30 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.7 TiB 52.63 1.46 40
31 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.43 1.35 41
32 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.44 1.07 32
33 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.12 1.23 36
34 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 46.99 1.31 39
35 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.62 0.99 28
38 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.56 1.27 37
40 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.7 TiB 54.07 1.50 39
41 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.33 0.87 27
72 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.61 0.16 0
73 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.62 0.16 0
60 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.35 0.87 24
61 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.49 0.79 22
62 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.78 0.91 26
63 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.20 0.95 27
64 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 39.84 1.11 31
65 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.90 1.11 35
66 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.18 0.95 28
67 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.82 1.39 37
68 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 39.84 1.11 29
69 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.14 1.23 33
70 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.82 1.39 43
71 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.74 1.19 34
74 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.60 0.99 28
75 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.54 1.27 36
76 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.54 1.27 34
77 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.83 1.39 41
54 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.61 0.16 0
55 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.61 0.16 0
42 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.30 1.15 30
43 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 34.16 0.95 29
44 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.1 TiB 42.69 1.19 33
45 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.52 1.27 34
46 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 36.99 1.03 31
47 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.47 0.79 20
48 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.7 TiB 52.69 1.47 40
49 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.37 0.87 26
50 hdd 3.63899 1.00000 3.6 TiB 1.6 TiB 2.0 TiB 44.13 1.23 32
51 hdd 3.63899 1.00000 3.6 TiB 1.2 TiB 2.4 TiB 32.75 0.91 25
52 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 37.02 1.03 27
53 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.54 1.27 34
57 hdd 3.63899 1.00000 3.6 TiB 1.4 TiB 2.2 TiB 38.45 1.07 31
58 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.1 TiB 41.31 1.15 34
59 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.87 1.11 31
18 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.60 0.16 0
19 fast 0.14799 1.00000 151 GiB 8.5 GiB 143 GiB 5.60 0.16 0
6 hdd 3.63899 1.00000 3.6 TiB 1.3 TiB 2.3 TiB 35.59 0.99 28
7 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 2.0 TiB 45.57 1.27 37
8 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.8 TiB 49.83 1.39 39
10 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.6 TiB 55.54 1.55 44
11 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.44 1.35 39
12 hdd 3.63899 1.00000 3.6 TiB 1.9 TiB 1.8 TiB 51.25 1.43 41
13 hdd 3.63899 1.00000 3.6 TiB 1.5 TiB 2.2 TiB 39.85 1.11 31
14 hdd 3.63899 1.00000 3.6 TiB 1.7 TiB 1.9 TiB 46.98 1.31 37
15 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.6 TiB 55.53 1.54 43
16 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.48 0.79 25
17 hdd 3.63899 1.00000 3.6 TiB 954 GiB 2.7 TiB 25.61 0.71 21
20 hdd 3.63899 1.00000 3.6 TiB 1.1 TiB 2.5 TiB 31.30 0.87 27
21 hdd 3.63899 1.00000 3.6 TiB 1.0 TiB 2.6 TiB 28.49 0.79 24
22 hdd 3.63899 1.00000 3.6 TiB 1.8 TiB 1.9 TiB 48.44 1.35 38
23 hdd 3.63899 1.00000 3.6 TiB 2.0 TiB 1.7 TiB 54.10 1.50 40
4 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.28 0.95 66
5 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.68 1.13 76
156 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.73 0.94 70
157 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.19 1.03 69
158 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.24 0.84 55
159 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.23 0.84 54
160 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.79 1.05 72
161 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.81 0.86 63
162 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.22 0.84 62
163 hdd 8.91019 1.00000 8.9 TiB 2.0 TiB 6.9 TiB 22.69 0.63 53
164 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.92 0.78 52
165 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.8 TiB 35.47 0.99 67
166 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.97 0.89 65
548 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.06 0.81 64
549 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.39 0.87 58
550 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.64 1.02 68
551 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.20 1.03 76
552 hdd 8.91019 1.00000 8.9 TiB 4.0 TiB 4.9 TiB 44.79 1.25 81
167 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.38 0.87 65
168 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.69 1.13 78
169 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.70 0.94 62
170 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.82 0.86 57
171 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 38.36 1.07 72
172 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.80 0.86 57
173 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.63 1.02 70
174 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.40 0.87 58
176 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 38.38 1.07 73
178 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 63
181 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 28.48 0.79 58
184 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.89 0.97 66
187 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.30 0.95 65
190 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.65 0.82 58
193 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 39.52 1.10 76
196 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 39.52 1.10 73
199 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.20 1.03 69
202 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.86 0.97 71
175 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 42.43 1.18 77
177 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.40 0.87 58
179 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.07 0.81 60
182 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 28.48 0.79 55
185 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.76 1.05 75
188 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.54 0.91 66
191 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.77 1.05 70
194 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.92 0.78 58
197 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.96 0.89 64
200 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.80 0.86 58
203 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.63 1.02 71
205 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.71 0.94 66
207 hdd 8.91019 1.00000 8.9 TiB 3.9 TiB 5.0 TiB 43.62 1.21 85
209 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.77 1.05 72
211 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.97 0.89 62
213 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.68 0.83 53
215 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 35.49 0.99 70
217 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.30 0.95 69
180 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.04 1.00 72
183 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.64 0.82 58
186 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.88 0.97 65
189 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.69 0.94 65
192 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.31 0.95 70
195 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 42.45 1.18 79
198 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.71 0.94 61
201 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.21 0.84 54
204 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.8 TiB 35.45 0.99 73
206 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.96 0.89 61
208 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.92 0.78 55
210 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 64
212 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.04 1.00 65
214 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.07 0.81 59
216 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 38.95 1.08 75
218 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.79 0.86 62
219 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 39.53 1.10 77
220 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 38.92 1.08 75
221 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.39 0.87 63
222 hdd 8.91019 1.00000 8.9 TiB 2.4 TiB 6.5 TiB 26.74 0.74 54
223 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.63 0.82 53
224 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.40 0.87 65
225 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.39 0.87 63
226 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.8 TiB 35.46 0.99 69
227 hdd 8.91019 1.00000 8.9 TiB 2.2 TiB 6.7 TiB 24.40 0.68 51
229 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.14 0.92 62
232 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.74 1.05 75
236 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.71 0.94 62
240 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.12 0.92 58
243 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.04 1.00 70
247 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.30 0.95 66
250 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.05 0.81 56
259 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.81 0.86 69
268 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 42.99 1.20 86
278 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 43.04 1.20 78
289 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.21 1.04 71
254 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.62 1.02 66
263 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.68 0.94 63
271 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.80 0.86 59
282 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.03 1.00 74
292 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.53 0.91 66
300 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.20 1.03 72
303 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.70 0.94 65
311 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 43.01 1.20 79
314 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.89 0.97 68
335 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.23 0.84 58
343 hdd 8.91019 1.00000 8.9 TiB 2.0 TiB 6.9 TiB 22.68 0.63 45
350 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.8 TiB 35.46 0.99 68
359 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.37 0.87 62
368 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.88 0.97 70
377 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.54 0.91 64
386 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.79 1.05 73
395 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.14 0.92 66
410 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.69 1.13 80
230 hdd 8.91019 1.00000 8.9 TiB 3.7 TiB 5.2 TiB 41.86 1.16 78
234 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.39 0.87 66
237 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 38.94 1.08 68
241 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.82 0.86 65
244 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.03 1.00 70
248 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.10 1.12 76
251 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.32 0.95 70
255 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.80 0.86 56
260 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 64
264 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.30 0.95 68
269 hdd 8.91019 1.00000 8.9 TiB 3.7 TiB 5.2 TiB 41.25 1.15 76
273 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.87 0.97 70
279 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.11 0.92 64
284 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.70 0.94 67
290 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.30 0.95 62
295 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.8 TiB 35.45 0.99 77
301 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.55 0.91 62
306 hdd 8.91019 1.00000 8.9 TiB 3.7 TiB 5.2 TiB 41.86 1.16 77
312 hdd 8.91019 1.00000 8.9 TiB 4.0 TiB 4.9 TiB 44.78 1.25 79
342 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.07 0.81 57
351 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.02 1.00 70
360 hdd 8.91019 1.00000 8.9 TiB 4.1 TiB 4.8 TiB 46.50 1.29 85
370 hdd 8.91019 1.00000 8.9 TiB 2.4 TiB 6.5 TiB 26.75 0.74 55
379 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.73 0.94 71
387 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.8 TiB 35.45 0.99 74
396 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 69
401 hdd 8.91019 1.00000 8.9 TiB 2.3 TiB 6.6 TiB 26.17 0.73 57
404 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 28.48 0.79 55
411 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.81 0.86 59
412 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.64 1.02 69
413 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.92 0.78 52
414 hdd 8.91019 1.00000 8.9 TiB 3.9 TiB 5.0 TiB 44.18 1.23 84
415 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.09 1.12 73
416 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.89 0.78 52
417 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.96 0.89 58
418 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.56 0.91 64
231 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.1 TiB 31.99 0.89 63
238 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.61 1.02 72
245 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.56 0.91 63
253 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.80 0.86 58
261 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 43.00 1.20 80
270 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 42.99 1.20 84
281 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 38.93 1.08 75
291 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.82 0.86 65
302 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.22 0.84 60
313 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.71 0.94 68
337 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.23 0.84 55
345 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.30 0.95 64
352 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 64
361 hdd 8.91019 1.00000 8.9 TiB 4.1 TiB 4.8 TiB 45.91 1.28 83
369 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.56 0.91 63
378 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.08 0.81 62
388 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.07 0.81 56
397 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.11 0.92 65
228 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.29 0.95 67
235 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.91 0.78 52
242 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.42 0.87 59
249 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.38 0.87 61
257 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.72 0.94 65
266 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.92 0.78 52
276 hdd 8.91019 1.00000 8.9 TiB 3.7 TiB 5.2 TiB 41.85 1.16 79
286 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.92 0.78 56
297 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.25 0.84 58
308 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.06 1.00 68
333 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.09 1.12 72
340 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.64 1.02 74
349 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 65
358 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.81 0.86 64
367 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 43.00 1.20 79
376 hdd 8.91019 1.00000 8.9 TiB 2.2 TiB 6.7 TiB 24.42 0.68 49
385 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.13 1.12 77
394 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.99 0.89 66
233 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 38.36 1.07 72
239 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 38.96 1.08 74
246 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.60 1.02 74
252 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.40 0.87 56
262 hdd 8.91019 1.00000 8.9 TiB 2.0 TiB 6.9 TiB 22.69 0.63 45
272 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.72 0.94 67
283 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.14 0.92 65
294 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.21 1.04 72
305 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.57 0.91 60
316 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 42.99 1.20 83
338 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.54 0.91 64
347 hdd 8.91019 1.00000 8.9 TiB 2.3 TiB 6.6 TiB 25.59 0.71 51
356 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.20 1.03 73
365 hdd 8.91019 1.00000 8.9 TiB 2.4 TiB 6.5 TiB 27.33 0.76 50
373 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.88 0.97 64
381 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.93 0.78 57
389 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.08 0.81 56
398 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 42.44 1.18 83
285 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.60 1.02 69
296 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.16 0.92 65
307 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 39.55 1.10 76
325 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 38.37 1.07 74
336 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 38.93 1.08 75
346 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.86 0.97 65
355 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.70 0.94 65
363 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.62 1.02 70
372 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.29 0.95 69
382 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.11 1.12 74
390 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.52 0.90 67
399 hdd 8.91019 1.00000 8.9 TiB 3.7 TiB 5.2 TiB 41.85 1.16 81
402 hdd 8.91019 1.00000 8.9 TiB 2.3 TiB 6.6 TiB 26.18 0.73 51
405 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 43.00 1.20 82
406 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.0 TiB 32.55 0.91 67
407 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.28 0.95 69
408 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.87 0.97 64
409 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.81 0.86 62
256 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 65
265 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.20 1.03 71
274 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.8 TiB 35.46 0.99 66
275 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.9 TiB 34.28 0.95 64
287 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.87 0.97 69
299 hdd 8.91019 1.00000 8.9 TiB 3.9 TiB 5.0 TiB 44.18 1.23 86
309 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 37.20 1.03 74
328 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.14 0.92 62
331 hdd 8.91019 1.00000 8.9 TiB 2.4 TiB 6.5 TiB 27.32 0.76 54
339 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 39.53 1.10 80
348 hdd 8.91019 1.00000 8.9 TiB 2.6 TiB 6.3 TiB 29.65 0.82 54
357 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.40 0.87 63
366 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.05 1.00 67
375 hdd 8.91019 1.00000 8.9 TiB 2.9 TiB 6.1 TiB 31.99 0.89 63
384 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.89 0.97 69
393 hdd 8.91019 1.00000 8.9 TiB 2.3 TiB 6.6 TiB 26.16 0.73 51
400 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.82 0.86 62
403 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.78 1.05 71
258 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.79 1.05 72
267 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 6.0 TiB 33.13 0.92 65
277 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.90 0.97 74
280 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.79 1.05 70
288 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 38.35 1.07 69
293 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.23 0.84 63
298 hdd 8.91019 1.00000 8.9 TiB 3.9 TiB 5.0 TiB 44.20 1.23 83
310 hdd 8.91019 1.00000 8.9 TiB 2.1 TiB 6.8 TiB 23.83 0.66 50
317 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 28.47 0.79 56
319 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.22 0.84 61
321 hdd 8.91019 1.00000 8.9 TiB 3.4 TiB 5.5 TiB 37.78 1.05 71
323 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.95 0.89 65
326 hdd 8.91019 1.00000 8.9 TiB 2.5 TiB 6.4 TiB 27.91 0.78 53
329 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.96 0.89 64
332 hdd 8.91019 1.00000 8.9 TiB 3.1 TiB 5.8 TiB 34.86 0.97 68
341 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.41 0.87 65
353 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.71 0.94 66
362 hdd 8.91019 1.00000 8.9 TiB 3.5 TiB 5.4 TiB 39.52 1.10 71
304 hdd 8.91019 1.00000 8.9 TiB 3.9 TiB 5.0 TiB 44.14 1.23 84
315 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.63 1.02 69
318 hdd 8.91019 1.00000 8.9 TiB 3.8 TiB 5.1 TiB 42.43 1.18 75
320 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.62 1.02 70
322 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.05 1.00 68
324 hdd 8.91019 1.00000 8.9 TiB 2.2 TiB 6.7 TiB 25.00 0.70 48
327 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.98 0.89 64
330 hdd 8.91019 1.00000 8.9 TiB 2.7 TiB 6.2 TiB 30.24 0.84 59
334 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.60 1.02 70
344 hdd 8.91019 1.00000 8.9 TiB 3.6 TiB 5.3 TiB 40.11 1.12 74
354 hdd 8.91019 1.00000 8.9 TiB 2.4 TiB 6.5 TiB 27.33 0.76 53
364 hdd 8.91019 1.00000 8.9 TiB 3.2 TiB 5.7 TiB 36.04 1.00 68
371 hdd 8.91019 1.00000 8.9 TiB 2.8 TiB 6.1 TiB 31.97 0.89 59
374 hdd 8.91019 1.00000 8.9 TiB 2.3 TiB 6.6 TiB 26.16 0.73 53
380 hdd 8.91019 1.00000 8.9 TiB 3.3 TiB 5.6 TiB 36.61 1.02 70
383 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.69 0.94 64
391 hdd 8.91019 1.00000 8.9 TiB 2.2 TiB 6.7 TiB 24.40 0.68 47
392 hdd 8.91019 1.00000 8.9 TiB 3.0 TiB 5.9 TiB 33.72 0.94 62
TOTAL 3.2 PiB 1.1 PiB 2.0 PiB 35.95
MIN/MAX VAR: 0.02/1.82 STDDEV: 10.50
