Uneven data distribution with even pg distribution after rebalancing

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi List,
   The enviroment is:
   Ceph 12.2.4
   Balancer module on and in upmap mode
   Failure domain is per host, 2 OSD per host
   EC k=4 m=2
   PG distribution is almost even before and after the rebalancing.


   After marking out one of the osd,I noticed a lot of the data was moving into the other osd on the same host .

   Ceph osd df result is(osd.20 and osd.21 are in the same host and osd.20 was marked out):

ID CLASS WEIGHT  REWEIGHT SIZE  USE   AVAIL %USE  VAR  PGS
19   hdd 9.09560  1.00000 9313G 7079G 2233G 76.01 1.00 135
21   hdd 9.09560  1.00000 9313G 8123G 1190G 87.21 1.15 135
22   hdd 9.09560  1.00000 9313G 7026G 2287G 75.44 1.00 133
23   hdd 9.09560  1.00000 9313G 7026G 2286G 75.45 1.00 134
   
   I am using RBD only so the objects should all be 4m .I don't understand why osd 21 got significant more data 
with the same pg as other osds.
   Is this behavior expected or I misconfiged something or  some kind of bug?
   
   Thanks


2018-06-25
shadow_lin 
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux