Re: RGW uploaded objects integrity

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I have had many cases of corrupt objects in my radosgw cluster. Until now I have looked at it as a software (my software) bug, still unresolved as the incidence as lowered a lot.



Regards,

Webert Lima
DevOps Engineer at MAV Tecnologia
Belo Horizonte - Brasil
IRC NICK - WebertRLZ

On Thu, Dec 7, 2017 at 3:11 PM, Robert Stanford <rstanford8896@xxxxxxxxx> wrote:

I did some benchmarking with cosbench and found that successful uploads (as shown in the output report) was not 100% unless I used the "hashCheck=True" flag in the cosbench configuration file.  Under high load, the percent successful was significantly lower (say, 80%).

Has anyone dealt with object integrity issues at high throughputs, when using RGW?  Any suggestions on ensuring what goes in to the cluster is the same as what comes out?  Do we have to manually check the integrity of the objects we upload, like cosbench does, every time?

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux