Re: [EXTERNAL] Re: RGW Bucket Notifications and MultiPart Uploads

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



yes, that would work. you would get a "404" until the object is fully
uploaded.

On Tue, Jul 19, 2022 at 6:00 PM Mark Selby <mselby@xxxxxxxxxx> wrote:

> If you can that would be great. As it is likely to be a while before we
> make the 16 -> 17 switch.
>
>
>
> Question: If I receive the 1st put notification for the partial object
> and I check RGW to see if the object actually exists – do you know if RGW
> will tell me that it is missing until the
> ObjectCreated:CompleteMultipartUpload is sent?
>
>
>
> I was thinking as a stop gap I could add some code to just check for the
> objects existence in RGW before taking any action?
>
>
>
> Thanks very much for taking the time out to answer this.
>
>
>
> --
>
> Mark Selby
>
> Sr Linux Administrator, The Voleon Group
>
> mselby@xxxxxxxxxx
>
>
>
>  This email is subject to important conditions and disclosures that are
> listed on this web page: https://voleon.com/disclaimer/.
>
>
>
>
>
> *From: *Yuval Lifshitz <ylifshit@xxxxxxxxxx>
> *Date: *Monday, July 18, 2022 at 9:33 PM
> *To: *Mark Selby <mselby@xxxxxxxxxx>
> *Cc: *"ceph-users@xxxxxxx" <ceph-users@xxxxxxx>
> *Subject: *[EXTERNAL] Re:  RGW Bucket Notifications and
> MultiPart Uploads
>
>
>
> *CAUTION:* This email originated from outside of the organization. Use
> caution when opening attachments or links.
>
>
>
> Hi Mark,
>
> It is in quincy but wasn't backported to pacific yet.
>
> I can do this backport, but I'm not sure when is the next pacific release.
>
>
>
> Yuval
>
>
>
> On Tue, Jul 19, 2022 at 5:04 AM Mark Selby <mselby@xxxxxxxxxx> wrote:
>
> I am trying to use RGW Bucket Notifications to trigger events on object
> creation and have into a bit of an issue when multipart uploads come into
> play for large objects.
>
>
>
> With a small object only a single notification is generated ->
> ObjectCreated:Put
>
>
>
> When a multipart upload is performed a string of Notifications are sent:
>
> ObjectCreated:Post
>
> ObjectCreated:Put
>
> ObjectCreated:Put
>
> ObjectCreated:Put
>
>
>
> ObjectCreated:CompleteMultipartUpload
>
>
>
> I can ignore the Post, but all of the Put notifications look the same as a
> single part upload message but the object will not actually be created
> until the CompleteMultipartUpload notification happens.
>
>
>
> There is this is https://tracker.ceph.com/issues/51520
> <https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftracker.ceph.com%2Fissues%2F51520&data=05%7C01%7Cmselby%40voleon.com%7Cc79d203d6c6e42084ef408da693fc775%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637938019913112991%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Hyc5Y3Xl5HdFr2mmXHHMa1df1gNC4tvMIkeGhW2lOlY%3D&reserved=0>
> that seems to fix this issue – I can not tell if this was actually
> backported or not. Does anyone know if this actually was backported?
>
>
>
> Thanks!
>
>
>
> --
>
> Mark Selby
>
> Sr Linux Administrator, The Voleon Group
>
> mselby@xxxxxxxxxx
>
>
>
>  This email is subject to important conditions and disclosures that are
> listed on this web page: https://voleon.com/disclaimer/
> <https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fvoleon.com%2Fdisclaimer%2F&data=05%7C01%7Cmselby%40voleon.com%7Cc79d203d6c6e42084ef408da693fc775%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637938019913271960%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=o%2Bujqo%2BTJJZhUQ8NJv%2BxDU2M2czwxBbkf4wXCIfMBQk%3D&reserved=0>
> .
>
>
>
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
>
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux