Re: units of metrics

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Jan 14, 2020 at 12:30 AM Stefan Kooman <stefan@xxxxxx> wrote:
Quoting Robert LeBlanc (robert@xxxxxxxxxxxxx):
> The link that you referenced above is no longer available, do you have a
> new link?. We upgraded from 12.2.8 to 12.2.12 and the MDS metrics all
> changed, so I'm trying to may the old values to the new values. Might just
> have to look in the code. :(

I cannot recall that the metrics have ever changed between 12.2.8 and
12.2.12. Anyways, it depends on what module you use to collect the
metrics if the right metrics are even there. See this issue:
https://tracker.ceph.com/issues/41881

Yes, I agree that the metrics should not change within a major version, but here is the difference. We are using diamond and the CephCollector, but I verified with the admin socket and dumping the perf counters manually

Metrics collected with 12.2.8:
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_client_request 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_server_request 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_request 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_session 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_slave_request 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink 0 1578955818
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.cap_revoke_eviction 0 1578955878

Metrics collected with 12.2.12: (much more clear and descriptive which is good)
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_client_request 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.dispatch_server_request 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_request 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_client_session 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.handle_slave_request 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_create_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getattr_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_getfilelock_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_link_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookup_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookuphash_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupino_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupname_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupparent_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lookupsnap_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_lssnap_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mkdir_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mknod_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_mksnap_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_open_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_readdir_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rename_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_renamesnap_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmdir_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmsnap_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_rmxattr_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setattr_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setdirlayout_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setfilelock_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setlayout_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_setxattr_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_symlink_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink_latency.avgcount 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink_latency.avgtime 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.req_unlink_latency.sum 0 1578955878
servers.mds01.CephCollector.ceph.mds.mds01.mds_server.cap_revoke_eviction 0 1578955938

We were plotting:
req_create
req_getattr
req_readdir
req_lookupino
req_open
req_unlink

We were graphing these as ops, but using the new avgcount, we are getting very different values, so I'm wondering if we are choosing the wrong new value, or we misunderstood what the old value really was and have been plotting it wrong all this time.

Thanks, 

----------------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904  C70E E654 3BB2 FA62 B9F1
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux