Re: Ceph OSD journal utilization

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

On Mon, 20 Jun 2016 12:20:30 -0400 Jonathan Proulx wrote:

> On Mon, Jun 20, 2016 at 04:02:04PM +0000, David Turner wrote:
> :If you want to watch what a disk is doing while you watch it, use
> iostat on the journal device.  If you want to see it's patterns at all
> times of the day, use sar.  Neither of these are ceph specific commands,
> just Linux tools that can watch your disk utilization, speeds, etc
> (among other things.  Both tools are well documented and easy to use.
> 
> For spot testing, like watching disk I/O during stress testing iostat
> as mentioned above is something I use frequently.
> 
> Sar is a simple way to pull historic load info from a single host, but
> I find it a bit combersome at even my modest scale.
> 
> We use http://munin-monitoring.org/ to do visual trending of many
> different server statistics including disk throughput, latency,
> utilization etc...this is a bit old school and there are plenty of
> other opensource ways of gathering and dispalying performance metrics. 
> 
> None of this is ceph specific and I agree there's no reason it should
> be.
>
The OP asked specifically about provisioning, so Nick's answer about using
the Ceph counters to see how much of the journal is used is the correct
one.
And incidentally in the current "Criteria for Ceph journal sizing" are
some pertinent points about this.

As for utilization in terms of IOPS and bandwidth, I find atop a very good
tool for spot (live) monitoring/analysis.
For longterm (and retrospective) analysis, collectd with graphics by
graphite/grafana or mumin are quite useful.
 
Christian

> -Jon
> 
> :________________________________
> :From: ceph-users [ceph-users-bounces@xxxxxxxxxxxxxx] on behalf of EP
> Komarla [Ep.Komarla@xxxxxxxxxxxxxxx] :Sent: Friday, June 17, 2016 5:13 PM
> :To: ceph-users@xxxxxxxxxxxxxx
> :Subject:  Ceph OSD journal utilization
> :
> :Hi,
> :
> :I am looking for a way to monitor the utilization of OSD journals – by
> observing the utilization pattern over time, I can determine if I have
> over provisioned them or not. Is there a way to do this? : :When I
> googled on this topic, I saw one similar request about 4 years back.  I
> am wondering if there is some traction on this topic since
> then. : :Thanks a lot. :
> :- epk
> :
> :Legal Disclaimer:
> :The information contained in this message may be privileged and
> confidential. It is intended to be read only by the individual or entity
> to whom it is addressed or by their designee. If the reader of this
> message is not the intended recipient, you are on notice that any
> distribution of this message, in any form, is strictly prohibited. If
> you have received this message in error, please immediately notify the
> sender and delete or destroy any copy of this message!
> 
> :_______________________________________________
> :ceph-users mailing list
> :ceph-users@xxxxxxxxxxxxxx
> :http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
> 


-- 
Christian Balzer        Network/Systems Engineer                
chibi@xxxxxxx   	Global OnLine Japan/Rakuten Communications
http://www.gol.com/
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux