Hi Noah, the current content of the web page http://ceph.com/docs/master/cephfs/hadoop shows a configuration parameter ceph.object.size. Is it the CEPH equivalent to the "HDFS block size" parameter which I have been looking for? Does the parameter ceph.object.size apply to version 0.56.1? I would be interested in setting this parameter to values higher than 64MB, e.g. 256MB or 512MB similar to the values I have used for HDFS for increasing the performance of the TeraSort benchmark. Would these values be allowed and would they at all make sense for the mechanisms used in CEPH? Regards, Jutta. - jutta.lachfeld@xxxxxxxxxxxxxx, Fujitsu Technology Solutions PBG PDG ES&S SWE SOL 4, "Infrastructure Solutions", MchD 5B, Tel. ..49-89-3222-2705, Company Details: http://de.ts.fujitsu.com/imprint > -----Original Message----- > From: Noah Watkins [mailto:jayhawk@xxxxxxxxxxx] > Sent: Thursday, December 13, 2012 9:33 PM > To: Gregory Farnum > Cc: Cameron Bahar; Sage Weil; Lachfeld, Jutta; ceph-devel@xxxxxxxxxxxxxxx; Noah > Watkins; Joe Buck > Subject: Re: Usage of CEPH FS versa HDFS for Hadoop: TeraSort benchmark > performance comparison issue > > The bindings use the default Hadoop settings (e.g. 64 or 128 MB > chunks) when creating new files. The chunk size can also be specified on a per-file basis > using the same interface as Hadoop. Additionally, while Hadoop doesn't provide an > interface to configuration parameters beyond chunk size, we will also let users fully > configure for any Ceph striping strategy. http://ceph.com/docs/master/dev/file-striping/ > > -Noah > > On Thu, Dec 13, 2012 at 12:27 PM, Gregory Farnum <greg@xxxxxxxxxxx> wrote: > > On Thu, Dec 13, 2012 at 12:23 PM, Cameron Bahar <cbahar@xxxxxxxxx> wrote: > >> Is the chunk size tunable in A Ceph cluster. I don't mean dynamic, but even statically > configurable when a cluster is first installed? > > > > Yeah. You can set chunk size on a per-file basis; you just can't > > change it once the file has any data written to it. > > In the context of Hadoop the question is just if the bindings are > > configured correctly to do so automatically. > > -Greg > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-devel" > > in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo > > info at http://vger.kernel.org/majordomo-info.html ��.n��������+%������w��{.n����z��u���ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f
