Re: RGW S3 Compatibility

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks for the insight. Managing one Ceph Cluster has been a handful among all the other initiatives we're taking, I couldn't imagine running two right now. My other alternatives are getting the Ceph Dashboard up in Proxmox or managing RGW via CLI in Terminal?

If the latter is an option, this would be a perfect opportunity to develop a TUI application for Ceph. Something similar to Lazydocker, Lazygit, CTOP, etc... thoughts?

Regards, 
   

 Anthony Fecarotta
 Founder & President
 phone-icon  anthony@xxxxxxxxxxx
 
phone-icon  224-339-1182  phone-icon  (855) 625-0300

 phone-icon  1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181
 phone-icon  www.linehaul.ai

linehaul.ai logo
linkedin icon


On Fri, Jan 31, 2025 at 1:16 AM Jens Galsgaard <jens@xxxxxxxxxxxxx> wrote:

Hi Anthony,

 

RGW in ProxMox (PM) has been answered somewhere in the PM community forum; basically, PM has no use for RGW so it’s not included. There are people who have varying success in setting up the ceph dashboard in PM and trying to get RGW in that way.

You’d be better of creating another ceph cluster and use that for your S3 needs.

It’s a great learning experience and you can start with vm’s and eventually move out of those.

 

Venlig hilsen - Mit freundlichen Grüßen - Kind Regards,
Jens Galsgaard

Gitservice.dk
Mob: +45 28864340

 

Fra: Anthony Fecarotta <anthony@xxxxxxxxxxx>
Sendt: Friday, 31 January 2025 05.24
Til: Anthony D'Atri <aad@xxxxxxxxxxxxxx>
Cc: ceph-users@xxxxxxx
Emne: Re: RGW S3 Compatibility

 

Thanks, Anthony, I appreciate the inline responses. I'm not sure what the etiquette is here, if I am to reply all or not, so please let me know for future reference.

  • Yes, by buckets I was referring to implementations.
  • As for the compatibility, I have a great example to reference. There is an open-source alternative to Notion, named Outline, and the screenshot below is directly from their self-hosting documentation (https://docs.getoutline.com/s/hosting/doc/file-storage-N4M0T6Ypu7):
     

     I look at this and see that Ceph isn't even mentioned, so I decided this will not be the app that I test creating Rados Gateway.
  • Proxmox has a great UI for Ceph, with the exception that there is absolutely no reference to RGW, other than the documentation perhaps.
  • My setup is all Dell PowerEdge R740s running SAS SSDs 12Gbps, and each of them has a large Enterprise NVME. I have each SAS SSD configured  as an OSD with the NVMe designated as the block.db. My performance is a mess now, that might be a topic for another thread.  I would love to utilize the Rados Gateway for new software  I am developing for our business.

 

Regards, 

   

 Anthony Fecarotta
 Founder & President
 phone-icon  anthony@xxxxxxxxxxx
 
phone-icon  224-339-1182  phone-icon  (855) 625-0300
 phone-icon  1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181
 phone-icon  www.linehaul.ai

linehaul.ai logo

linkedin icon

 

 

On Thu, Jan 30, 2025 at 6:26PM Anthony D'Atri <aad@xxxxxxxxxxxxxx> wrote:



> On Jan 30, 2025, at 7:09PM, Anthony Fecarotta <anthony@xxxxxxxxxxx> wrote:
>
> Hello,
>
> Our company has a five node Proxmox cluster that recently implemented Ceph.

Groovy.  Welcome to Cephland.


> We utilize multiple open-source applications that prefer (not require) S3
> storage.

This is increasingly common.

> Now that we are running Ceph, are we able to simply create a Ceph
> Object Gateway with the S3 API?

Yes, I believe so, though my Proxmox experience is limited.

> I have read that not all S3 buckets share the same compatibility.

By buckets do you mean implementations?  That would be true.  Ceph RGW is compatible with the majority of AWS S3 behaviors, most clients and libraries slot right in by specifying the endpoint.

What storage drives do you have?  If you have mutliple, like SSDs and HDDs, TLC and QLC SSDs you’ll want to assign pools specifically.

>
> Regards,
>
>
> * Anthony Fecarotta*
> Founder & President
> [image: phone-icon]  anthony@xxxxxxxxxxx
> [image: phone-icon]  224-339-1182  [image: phone-icon]  (855) 625-0300
> [image: phone-icon]  1 Mid America Plz Flr 3 Oakbrook Terrace, IL 60181
> [image: phone-icon]  www.linehaul.ai
> [image: linehaul.ai logo] <http://www.linehaul.ai/>
> [image: linkedin icon] <https://www.linkedin.com/in/anthony-fec/>
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux