Re: Transmit rate metric based per bucket

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Well in fact it does.

For example in our setup we are parsing the bucket name from the URL. It’s a bit tricky as a client could use both the domain name and path base styles, but that is not an issue for us.

Alternatively you can parse and analyse logs directly from RGWs which have the bucket information without URL parsing needed.

Ondrej

> On 3. 7. 2023, at 9:58, Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx> wrote:
> 
> Hi,
> 
> Yeah, I'm using haproxy but that doesn't have the bucket information :/ 
> 
> Istvan Szabo
> Staff Infrastructure Engineer
> ---------------------------------------------------
> Agoda Services Co., Ltd.
> e: istvan.szabo@xxxxxxxxx
> ---------------------------------------------------
> 
> -----Original Message-----
> From: Ondřej Kukla <ondrej@xxxxxxx> 
> Sent: Monday, July 3, 2023 2:25 PM
> To: Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx>
> Subject: Re:  Transmit rate metric based per bucket
> 
> Email received from the internet. If in doubt, don't click any link nor open any attachment !
> ________________________________
> 
> Hello, Istvan,
> 
> As far as I’m avare there is no way to do it directly on the RGW. What you can do is using a LB in front of the RGWs something like Nginx or HAProxy.
> 
> Then just collect the LB logs using ELK stack, Loki etc. and sum the body bytes sent per request type and bucket.
> 
> Ondrej
> 
>> On 20. 6. 2023, at 7:01, Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx> wrote:
>> 
>> Hello,
>> 
>> I'd like to know is there a way to query some metrics/logs in octopus (or if has newer version I'm interested for the future too) about the bandwidth used in the bucket for put/get operations?
>> 
>> Thank you
>> 
>> ________________________________
>> This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses.
>> _______________________________________________
>> ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an 
>> email to ceph-users-leave@xxxxxxx
> 
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux