Re: Ceph Supermicro hardware recommendation

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I ended up destroying the EC pool and starting over.  It was killing all of my OSD machines, and I couldn't keep anything working right with EC in use.  So, no core dumps and I'm not in a place to reproduce easily anymore.  This was with Giant on Ubuntu 14.04.

On Thu Feb 12 2015 at 7:07:38 AM Mark Nelson <mnelson@xxxxxxxxxx> wrote:
On 02/08/2015 10:41 PM, Scott Laird wrote:
> Does anyone have a good recommendation for per-OSD memory for EC?  My EC
> test blew up in my face when my OSDs suddenly spiked to 10+ GB per OSD
> process as soon as any reconstruction was needed.  Which (of course)
> caused OSDs to OOM, which meant more reconstruction, which fairly
> immediately led to a dead cluster.  This was with Giant.  Is this typical?

Doh, that shouldn't happen.  Can you reproduce it?  Would be especially
nice if we could get a core dump or if you could make it happen under
valgrind.  If the CPUs are spinning, even a perf report might prove useful.

>
> On Fri Feb 06 2015 at 2:41:50 AM Mohamed Pakkeer <mdfakkeer@xxxxxxxxx
> <mailto:mdfakkeer@xxxxxxxxx>> wrote:
>
>     Hi all,
>
>     We are building EC cluster with cache tier for CephFS. We are
>     planning to use the following 1U chassis along with Intel SSD DC
>     S3700 for cache tier. It has 10 * 2.5" slots. Could you recommend a
>     suitable Intel processor and amount of RAM to cater 10 * SSDs?.
>
>     http://www.supermicro.com/products/system/1U/1028/SYS-1028R-WTRT.cfm
>
>
>     Regards
>
>     K.Mohamed Pakkeer
>
>
>
>     On Fri, Feb 6, 2015 at 2:57 PM, Stephan Seitz
>     <s.seitz@xxxxxxxxxxxxxxxxxxx <mailto:s.seitz@heinlein-support.de>>
>     wrote:
>
>         Hi,
>
>         Am Dienstag, den 03.02.2015, 15:16 +0000 schrieb Colombo Marco:
>         > Hi all,
>         >  I have to build a new Ceph storage cluster, after i‘ve read the
>         > hardware recommendations and some mail from this mailing list i would
>         > like to buy these servers:
>
>         just FYI:
>
>         SuperMicro already focuses on ceph with a productline:
>         http://www.supermicro.com/solutions/datasheet_Ceph.pdf
>         http://www.supermicro.com/solutions/storage_ceph.cfm
>
>
>
>         regards,
>
>
>         Stephan Seitz
>
>         --
>
>         Heinlein Support GmbH
>         Schwedter Str. 8/9b, 10119 Berlin
>
>         http://www.heinlein-support.de
>
>         Tel: 030 / 405051-44
>         Fax: 030 / 405051-19
>
>         Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht
>         Berlin-Charlottenburg,
>         Geschäftsführer: Peer Heinlein -- Sitz: Berlin
>
>
>         _______________________________________________
>         ceph-users mailing list
>         ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxx.com>
>         http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
>
>     --
>     Thanks & Regards
>     K.Mohamed Pakkeer
>     Mobile- 0091-8754410114
>
>     _________________________________________________
>     ceph-users mailing list
>     ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxx.com>
>     http://lists.ceph.com/__listinfo.cgi/ceph-users-ceph.__com
>     <http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com>
>
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux