Re: Need advice with setup planning

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello Salsa,

Amazing! Where were you 3 months ago? Only problem is that I think we have no moer budget for this so I can't get approval for software license.

We where here and on some Ceph days as well. We do provide a completely free version but with limited features (no HA, LDAP,...) but with the benefit of not having to worry about the installation, upgrades and a lot of day-to-day stuff.
Therefore you don't need to pay us a single cent to benefit from a tested Ceph software stack (from OS, libs, userspace, ...). You can install and manage everything needed for Ceph to provide RBD, for example to consume with proxmox, and every extended feature can still be used using the command line as you would do without our software. 

Please keep in mind that our license always includes support that you would need to pay otherwise (using your own time, or pay someone else).

The service is critical and we are afraid that the network might be congested and QoS for the end user degrades

If the service is critical, a 10G network would be the choice. However, one of our test clusters with 11 systems do have a dual 1GbE that works perfectly fine. It just needs to be configured correctly using a good hash policy (we use layer3+4 in our software)
and of course will never achieve the full performance. 

Btw. a brand new single port 10G card only costs ~40€ (used from 6€), dual port starting from ~80€ (used from 20€). If it is critical storage system, that little money should always be possible to spend.

Great! Thanks for the help and congratulations on that demo. It is the best I've used and the easiest ceph setup I've found. As feedback, the last part of the demo tutorial is not 100% compatible with the master branch from github. 
 
Thanks for the feedback, we do need to update the videos to the newest version but our time is unfortunately limited :/

--
Martin Verges
Managing director

Mobile: +49 174 9335695
E-Mail: martin.verges@xxxxxxxx
Chat: https://t.me/MartinVerges

croit GmbH, Freseniusstr. 31h, 81247 Munich
CEO: Martin Verges - VAT-ID: DE310638492
Com. register: Amtsgericht Munich HRB 231263

Web: https://croit.io
YouTube: https://goo.gl/PGE1Bx


Am Fr., 20. Sept. 2019 um 18:34 Uhr schrieb Martin Verges <martin.verges@xxxxxxxx>:
Hello Salsa,

I have tested Ceph using VMs but never got to put it to use and had a lot of trouble to get it to install.
if you want to get rid of all the troubles from installing to day2day operations, you could consider using https://croit.io/croit-virtual-demo

- Use 2 HDDs for SO using RAID 1 (I've left 3.5TB unallocated in case I can use it later for storage)
- Install CentOS 7.7
Is ok, but won't be necessary if you choose croit as we boot from the network and don't install a operating system.

- Use 2 vLANs, one for ceph internal usage and another for external access. Since they've 4 network adapters, I'll try to bond them in pairs to speed up network (1Gb).
If there is no internal policy that forces you to do seperate networks, you can use a simple 1 vlan setup and bond 4*1GbE. Otherwise it's ok.
 
- I'll try to use ceph-ansible for installation. I failed to use it on lab, but it seems more recommended.
- Install Ceph Nautilus
Ultra easy with croit, maybe look at our videos on youtube - https://www.youtube.com/playlist?list=PL1g9zo59diHDSJgkZcMRUq6xROzt_YKox
 
- Each server will host OSD, MON, MGR and MDS.
ok, but you should use ssd for metadata.
 
- One VM for ceph-admin: This wil be used to run ceph-ansible and maybe to host some ceph services later
perfect for croit ;)
 
- I'll have to serve samba, iscsi and probably NFS too. Not sure how or on which servers.
Just put it on the servers as well, with croit it is just a click away and everything is included in our interface.
If not using croit, you can still install it on the same systems and configure it by hand/script.

--
Martin Verges
Managing director

Mobile: +49 174 9335695
E-Mail: martin.verges@xxxxxxxx
Chat: https://t.me/MartinVerges

croit GmbH, Freseniusstr. 31h, 81247 Munich
CEO: Martin Verges - VAT-ID: DE310638492
Com. register: Amtsgericht Munich HRB 231263

Web: https://croit.io
YouTube: https://goo.gl/PGE1Bx


Am Fr., 20. Sept. 2019 um 18:14 Uhr schrieb Salsa <salsa@xxxxxxxxxxxxxx>:
I have tested Ceph using VMs but never got to put it to use and had a lot of trouble to get it to install.

Now I've been asked to do a production setup using 3 servers (Dell R740) with 12 4TB each.

My plan is this:
- Use 2 HDDs for SO using RAID 1 (I've left 3.5TB unallocated in case I can use it later for storage)
- Install CentOS 7.7
- Use 2 vLANs, one for ceph internal usage and another for external access. Since they've 4 network adapters, I'll try to bond them in pairs to speed up network (1Gb).
- I'll try to use ceph-ansible for installation. I failed to use it on lab, but it seems more recommended.
- Install Ceph Nautilus
- Each server will host OSD, MON, MGR and MDS.
- One VM for ceph-admin: This wil be used to run ceph-ansible and maybe to host some ceph services later
- I'll have to serve samba, iscsi and probably NFS too. Not sure how or on which servers.

Am I missing anything? Am I doing anything "wrong"?

I searched for some actual guidance on setup but I couldn't find anything complete, like a good tutorial or reference based on possible use-cases.

So, is there any suggestions you could share or links and references I should take a look?

Thanks;

--
Salsa

Sent with ProtonMail Secure Email.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux