Re: HEALTH_WARN # requests are blocked > 32 sec

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



ceph health detail


2013/11/25 Michael <michael@xxxxxxxxxxxxxxxxxx>
Hi,

Any ideas on troubleshooting a "requests are blocked" when all of the nodes appear to be running OK?
Nothing gets reported in  /var/log/ceph/ceph.log as everything is active+clean throughout the event. All of the nodes can be accessed and all report the warning while they are blocking.

root@srv-8:~# ceph -w
    cluster ab3f7bc0-4cf7-4489-9cde-1af11d68a834
     health HEALTH_WARN 151 requests are blocked > 32 sec
     monmap e5: 3 mons at {srv-10=#:6789/0,srv-11=#:6789/0,srv-12=#:6789/0}, election epoch 398, quorum 0,1,2 srv-10,srv-11,srv-12
     mdsmap e182: 1/1/1 up {0=srv-195-8-125-10=up:active}
     osdmap e12081: 9 osds: 9 up, 9 in
      pgmap v4454492: 1864 pgs, 4 pools, 244 GB data, 1555 kobjects
            488 GB used, 6494 GB / 6982 GB avail
                1864 active+clean
  client io 18656 B/s wr, 1 op/s

2013-11-25 13:55:10.080698 mon.0 [INF] pgmap v4454490: 1864 pgs: 1864 active+clean; 244 GB data, 488 GB used, 6494 GB / 6982 GB avail; 10378 B/s wr, 1 op/s
2013-11-25 13:55:11.165616 mon.0 [INF] pgmap v4454491: 1864 pgs: 1864 active+clean; 244 GB data, 488 GB used, 6494 GB / 6982 GB avail; 37331 B/s wr, 4 op/s
2013-11-25 13:55:13.078688 mon.0 [INF] pgmap v4454492: 1864 pgs: 1864 active+clean; 244 GB data, 488 GB used, 6494 GB / 6982 GB avail; 18656 B/s wr, 1 op/s

All reads seem to get prevented from happening while it's going on.

root@srv-10:~# ceph -v
ceph version 0.72.1 (4d923861868f6a15dcb33fef7f50f674997322de)

Seems to happen for periods of a couple of minutes then wake up again.

Thanks much,
-Michael
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--
С уважением, Фасихов Ирек Нургаязович
Моб.: +79229045757
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux