Re: mimic - troubleshooting prometheus

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



The prometheus plugin currently skips histogram perf counters. The representation in ceph is not compatible with prometheus' approach (iirc). However I believe most, if not all of the perf counters should be exported as long running averages. Look for metric pair that are named some_metric_name_sum and some_metric_name_count.

HTH,
Jan

On Fri, Aug 24, 2018 at 01:47:40PM -0400, Steven Vacaroaia wrote:
  Hi,
  Any idea/suggestions for troubleshooting prometheus ?
  what logs /commands are available to find out why OSD servers specific
  data ( IOPS, disk and network data) is not scrapped but cluster
  specific data ( pools, capacity ..etc) is ?
  Increasing log level for MGR showed only the following
  2018-08-24 13:46:23.395 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_r_latency_out_bytes_histogram, type
  2018-08-24 13:46:23.395 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_rw_latency_out_bytes_histogram, type
  2018-08-24 13:46:23.395 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_rw_latency_in_bytes_histogram, type
  2018-08-24 13:46:23.395 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_w_latency_in_bytes_histogram, type
  2018-08-24 13:46:23.395 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_r_latency_out_bytes_histogram, type
  2018-08-24 13:46:23.396 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_rw_latency_out_bytes_histogram, type
  2018-08-24 13:46:23.396 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_rw_latency_in_bytes_histogram, type
  2018-08-24 13:46:23.396 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_w_latency_in_bytes_histogram, type
  2018-08-24 13:46:23.396 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_r_latency_out_bytes_histogram, type
  2018-08-24 13:46:23.397 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_rw_latency_out_bytes_histogram, type
  2018-08-24 13:46:23.397 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_rw_latency_in_bytes_histogram, type
  2018-08-24 13:46:23.397 7f73d54ce700 20 mgr[prometheus] ignoring
  osd.op_w_latency_in_bytes_histogram, type

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


--
Jan Fajerski
Engineer Enterprise Storage
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton,
HRB 21284 (AG Nürnberg)
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux