Re: Workload that delete 100 M object daily via lifecycle

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Index pool distributed over a large number of NVMe OSDs?  Multiple, dedicated RGW instances that only run LC?

> On Jul 18, 2023, at 12:08, Peter Grandi <pg@xxxxxxxxxxxxxxxxxxxx> wrote:
> 
>>>> On Mon, 17 Jul 2023 19:19:34 +0700, Ha Nguyen Van
>>>> <hanv@xxxxxxxxxxxxxxx> said:
> 
>> [...] S3 workload, that will need to delete 100M file daily [...]
> 
> So many people seem to think that distributed (or even local)
> filesystems (and in particular their metadata servers) can
> sustain the same workload as high volume transactional DBMSes.
> 
> PS 100m deletions per day given 86,400 second per day means on
> average (what about peaks?) around 1,200 committed deletions per
> second (across the traditional 3 metadata OSDs) sustained on the
> metadata server, that may not leave a lot of time for file
> creation, writing or reading. :-)
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux