Re: Ceph OSD perf metrics missing

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I stumbled on this problem earlier, port 9926 isn't being opened. See also thread "Grafana dashboards is missing data".
A tracker is already opened to fix the issue: https://tracker.ceph.com/issues/67975

> Op 25-11-2024 13:44 CET schreef Kilian Ries <mail@xxxxxxxxxxxxxx>:
> 
>  
> Prometheus metrics seem to be broken, too:
> 
> 
> ceph_osd_op_r_latency_sum
> 
> ceph_osd_op_w_latency_sum
> 
> 
> Both of them for example are not reported by the ceph mgr metrics exporter:
> 
> 
> curl http://192.168.XXX.XXX:9283/metrics |grep ceph_osd_
> 
> 
> 
> I get some merics like "ceph_osd_commit_latency_ms" or "ceph_osd_apply_latency_ms" but none of the "op_r / op_w" metrics. Do the lable names have switched and my grafana dashboard is outdated? Or are they missing at the exporter level?
> 
> 
> Thanks
> 
> 
> 
> 
> ________________________________
> Von: Kilian Ries
> Gesendet: Montag, 25. November 2024 13:37:16
> An: ceph-users@xxxxxxx
> Betreff: AW: Ceph OSD perf metrics missing
> 
> 
> Any ideas? Still facing the problem ...
> 
> ________________________________
> Von: Kilian Ries
> Gesendet: Mittwoch, 23. Oktober 2024 13:59:06
> An: ceph-users@xxxxxxx
> Betreff: Ceph OSD perf metrics missing
> 
> 
> Hi,
> 
> 
> i'm running a Ceph v18.2.4 cluster. I'm trying to build some latency monitoring with the
> 
> 
> ceph daemon osd.4 perf dump
> 
> 
> cli command. On most of the OSDs i get all the metrics i need. On some OSDs i only get zero values:
> 
> 
> osd.op_latency.avgcount: 0
> 
> 
> I already tried restarting the OSD process which didn't help. I also tried to reset the metrics via
> 
> 
> ceph daemon osd.4 perf reset all
> 
> 
> but that didn't help either. How can that be that some OSDs don't show values here? How can i fix that?
> 
> 
> Thanks
> 
> Regards,
> 
> Kilian
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux