Re: ceph object merge file pieces

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



we are trying to copycat  qiniu cloud api because our products heavily rely on them but in some circumstances we want a private cloud solution,
 users(our own developers) still need to split files and our api server will reveive requests and send to ceph through rgw
are u suggesting this link
https://github.com/s3tools/s3cmd/blob/58cdded161386d4c7dff366245cbb07c87aac3ba/S3/MultiPart.py
------------------ Original ------------------
Date:  Mon, Sep 19, 2016 04:22 PM
To:  "王海生-软件研发部"<wanghaisheng@xxxxxxxxxxxxxxxx>;
Cc:  "ceph-users"<ceph-users@xxxxxxxxxxxxxx>;
Subject:  Re: [ceph-users] ceph object merge file pieces
 
On Mon, Sep 19, 2016 at 4:20 PM, 王海生-软件研发部
<wanghaisheng@xxxxxxxxxxxxxxxx> wrote:
> yes  we are building top of radosgw .using a nginx to wrap a speficial api
> over the underlying interfaces

I got your idea. You can implement s3 multi part upload in the
specifial api, so it will be transparent to your users

>
>
> ------------------ Original ------------------
> From:  "Haomai Wang"<haomai@xxxxxxxx>;
> Date:  Mon, Sep 19, 2016 04:18 PM
> To:  "王海生-软件研发部"<wanghaisheng@xxxxxxxxxxxxxxxx>;
> Cc:  "ceph-users"<ceph-users@xxxxxxxxxxxxxx>;
> Subject:  Re: [ceph-users] ceph object merge file pieces
>
> On Mon, Sep 19, 2016 at 4:10 PM, 王海生-软件研发部
> <wanghaisheng@xxxxxxxxxxxxxxxx> wrote:
>> Dear all
>> we have setup a ceph cluster using object storage, there is a case in our
>> product, where client can upload large file ,right now we are thinking
>> split
>> large file into serveral pieces and send it to ceph,can i send each piece
>> to
>> ceph ,get the object id and at last merge these pieces into one obejct ?
>> of course we can save these pieces into temp files during our nginx server
>> reveive them, and then merge these pieces into one and post into ceph
>> obejct
>> storage and get one obejct id
>> thx very much
>
> are you uses radosgw? you could use multi-parted upload way to achieve your
> goal
>
>>
>>
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux