Re: s3 compatible interface

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi, maybe I should have mentioned the zipper project as well, watched both IBM and SUSE presentations at FOSDEM 2023.

I personally follow the zipper project with great interest.

Joachim


___________________________________

Ceph Foundation Member

Am 21.03.23 um 01:27 schrieb Matt Benjamin:
Hi Chris,

This looks useful.  Note for this thread:  this *looks like* it's using the
zipper dbstore backend?  Yes, that's coming in Reef.  We think of dbstore
as mostly the zipper reference driver, but it can be useful as a standalone
setup, potentially.

But there's now a prototype of a posix file filter that can be stacked on
dbstore (or rados, I guess)--not yet merged, and iiuc post-Reef.  That's
the project Daniel was describing.  The posix/gpfs filter is aiming for
being thin and fast and horizontally scalable.

The s3gw project that Clyso and folks were writing about is distinct from
both of these.  I *think* it's truthful to say that s3gw is its own
thing--a hybrid backing store with objects in files, but also metadata
atomicity from an embedded db--plus interesting orchestration.

Matt

On Mon, Mar 20, 2023 at 3:45 PM Chris MacNaughton <
chris.macnaughton@xxxxxxxxxxxxx> wrote:

On 3/20/23 12:02, Frank Schilder wrote:

Hi Marc,

I'm also interested in an S3 service that uses a file system as a back-end. I looked at the documentation of https://github.com/aquarist-labs/s3gw and have to say that it doesn't make much sense to me. I don't see this kind of gateway anywhere there. What I see is a build of a rados gateway that can be pointed at a ceph cluster. That's not a gateway to an FS.

Did I misunderstand your actual request or can you point me to the part of the documentation where it says how to spin up an S3 interface using a file system for user data?

The only thing I found is https://s3gw-docs.readthedocs.io/en/latest/helm-charts/#local-storage, but it sounds to me that this is not where the user data will be going.

Thanks for any hints and best regards,


for testing you can try: https://github.com/aquarist-labs/s3gw

Yes indeed, that looks like it can be used with a simple fs backend.

Hey,

(Re-sending this email from a mailing-list subscribed email)

I was playing around with RadosGW's file backend (coming in Reef, zipper)
a few months back and ended up making this docker container that just works
to setup things:
https://github.com/ChrisMacNaughton/ceph-rgw-docker; published (still,
maybe for a while?) at https://hub.docker.com/r/iceyec/ceph-rgw-zipper

Chris
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux