Re: [Ceph-community] Consultation about ceph storage cluster architecture

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I think he needs the “gateway” servers because he wishes to expose the storage to clients which won’t speak Ceph natively. I’m not sure I would entirely trust that windows port of CephFS and there are also security concerns with allowing end users to talk directly to Ceph. There’s also future stuff like CephFS snapshots, which Samba can then wrap around to provide previous versions directly into windows explorer.

 

You probably also don’t want to use CephFS at this point, there are several outstanding points that means that it’s going to require a bit more work than you ideally want to have to go through if you want to export it HA over NFS and SMB reliably. There were some posts about a year ago (I think??) which covered some of the issues using CTDB with CephFS in a HA fashion. Mainly around timeouts in CephFS and how they match up to what CTDB expects.

 

Currently the simplest and most reliable way is like the blog article linked, to export NFS+SMB on a filesystem over a RBD. This will require the use of Pacemaker for HA and that’s a whole separate topic in itself to get right.

 

From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of David Turner
Sent: 20 January 2017 19:08
To: John Petrini <jpetrini@xxxxxxxxxxxx>; Joao Eduardo Luis <joao@xxxxxxx>
Cc: ceph-users@xxxxxxxxxxxxxx; hen shmuel <henshsh@xxxxxxxxx>
Subject: Re: [Ceph-community] Consultation about ceph storage cluster architecture

 

CephFS does not require a central NFS server.  Any Linux server can mount the CephFS volume at the same time.  There is also a windows client for CephFS (https://drupal.star.bnl.gov/STAR/blog/mpoat/cephfs-client-windows-based-dokan-060).  I don't see the need for the NFS/SMB server or complicated HA setup.  What you do need to make sure is HA is the MDS service.  It is not natively HA, but there are several guides to work around that.


David Turner | Cloud Operations Engineer | StorageCraft Technology Corporation
380 Data Drive Suite 300 | Draper | Utah | 84020
Office: 801.871.2760 | Mobile: 385.224.2943


If you are not the intended recipient of this message or received it erroneously, please notify the sender and delete it, together with any attachments, and be advised that any dissemination or copying of this message is prohibited.



From: ceph-users [ceph-users-bounces@xxxxxxxxxxxxxx] on behalf of John Petrini [jpetrini@xxxxxxxxxxxx]
Sent: Friday, January 20, 2017 10:41 AM
To: Joao Eduardo Luis
Cc: ceph-users@xxxxxxxxxxxxxx; hen shmuel
Subject: Re: [Ceph-community] Consultation about ceph storage cluster architecture

Here's a really good write up on how to cluster NFS servers backed by RBD volumes. It could be adapted to use CephFS with relative ease.

 


___

John Petrini

NOC Systems Administrator   //   CoreDial, LLC   //   coredial.com   //   Image removed by sender. Twitter   Image removed by sender. LinkedIn   Image removed by sender. Google Plus   Image removed by sender. Blog 
Hillcrest I, 751 Arbor Way, Suite 150, Blue Bell PA, 19422 
P: 215.297.4400 x232   //   F: 215.297.4401   //   E: jpetrini@xxxxxxxxxxxx

Image removed by sender. Exceptional people. Proven Processes. Innovative Technology. Discover CoreDial - watch our video

The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission,  dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer.

 

On Fri, Jan 20, 2017 at 12:35 PM, Joao Eduardo Luis <joao@xxxxxxx> wrote:

Hi,

This email is better suited for the 'ceph-users' list (CC'ed).

You'll likely find more answers there.

  -Joao

On 01/20/2017 04:33 PM, hen shmuel wrote:

im new to Ceph and i want to build ceph storage cluster at my work site,
to provide NAS services to are clients, as NFS to are linux servers
clients, and as CIFS to are windows servers clients, to my understanding
in order to do that with ceph i need to:

 1. build a full ceph storage cluster
 2. create CephFS "volumes" on my ceph cluster
 3. mount the CephFS to a linux server that will be used as a "gateway"
    for export the CephFS as NFS to linux servers and as CIFS to windows
    servers
 4. on my linux "gateway" server i need to install NFS server and SMB
    Server to do the export part
 5. in order to overcome the "single point of failure" with this linux
    "gateway" server in will need to build a cluster of them and use
    clustered NFS Server and CTBD or something like that


i wanted to know if i understand it properly and if this is the right
way to do that or if there is a simplified way to achieved NAS services
like i want.

thanks for any help!



_______________________________________________
Ceph-community mailing list
Ceph-community@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-community-ceph.com


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

 


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux