Show IOps per VM/client to find heavy users...

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Dan,

thank you very much for the script, will check it out...no thortling so
far, but I guess it will have to be done...

This seems to read only gziped logs? so since read only I guess it is safe
to run it on proudction cluster now... ?
The script will also check for mulitply OSDs as far as I can understadn,
not just osd.0 given in script comment ?

Thanks a lot.
Andrija




On 8 August 2014 15:44, Dan Van Der Ster <daniel.vanderster at cern.ch> wrote:

>  Hi,
> Here?s what we do to identify our top RBD users.
>
>  First, enable log level 10 for the filestore so you can see all the IOs
> coming from the VMs. Then use a script like this (used on a dumpling
> cluster):
>
>
> https://github.com/cernceph/ceph-scripts/blob/master/tools/rbd-io-stats.pl
>
>  to summarize the osd logs and identify the top clients.
>
>  Then its just a matter of scripting to figure out the ops/sec per
> volume, but for us at least the main use-case has been to identify who is
> responsible for a new peak in overall ops ? and daily-granular statistics
> from the above script tends to suffice.
>
>  BTW, do you throttle your clients? We found that its absolutely
> necessary, since without a throttle just a few active VMs can eat up the
> entire iops capacity of the cluster.
>
>  Cheers, Dan
>
> -- Dan van der Ster || Data & Storage Services || CERN IT Department --
>
>
>  On 08 Aug 2014, at 13:51, Andrija Panic <andrija.panic at gmail.com> wrote:
>
>  Hi,
>
>  we just had some new clients, and have suffered very big degradation in
> CEPH performance for some reasons (we are using CloudStack).
>
>  I'm wondering if there is way to monitor OP/s or similar usage by client
> connected, so we can isolate the heavy client ?
>
>  Also, what is the general best practice to monitor these kind of changes
> in CEPH ? I'm talking about R/W or OP/s change or similar...
>
>  Thanks,
> --
>
> Andrija Pani?
>
>   _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>


-- 

Andrija Pani?
--------------------------------------
  http://admintweets.com
--------------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ceph.com/pipermail/ceph-users-ceph.com/attachments/20140808/600279a0/attachment.htm>


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux