Re: Why does mkcephfs take approximately 30 seconds per osd on ceph 0.51?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, 18 Sep 2012, Tren Blackburn wrote:
> Hi List;
> 
> I've been working with ceph 0.51 lately, and have noticed this for a
> while now, but it hasn't been a big enough issue for me to report.
> However today I'm turning up a 192 OSD cluster, and 30 seconds per OSD
> adds up pretty quick. For some reason it's taking 30 seconds between
> checking the OSD for a pre-existing store:
> 
> 2012-09-18 13:53:28.400590 7fe895d25780 -1 filestore(/var/ceph/disk11)
> could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such
> file or directory
> 
> And then actually creating the new store:
> 
> 2012-09-18 13:53:57.371396 7fe895d25780 -1 created object store
> /var/ceph/disk11 journal /dev/mapper/vg-journal.disk11 for osd.34 fsid
> bca82801-04d7-402e-917f-8023a4b161a8
> 2012-09-18 13:53:57.371449 7fe895d25780 -1 auth: error reading file:
> /var/ceph/disk11/keyring: can't open /var/ceph/disk11/keyring: (2) No
> such file or directory
> 2012-09-18 13:53:57.371527 7fe895d25780 -1 created new key in keyring
> /var/ceph/disk11/keyring
> 
> I can provide many examples as I'm watching it slowly plod through
> currently. Also, the horse power of the server makes no difference.
> The servers in question here are dual E5-2600's with 96GB ram and
> 12x2TB drives.
> 
> What information can I provide to help debug this? Or is this an
> already known issue?

If you add -x to the #!/bin/bash line in mkcephfs we can see exactly which 
command(s) are going slow...

sage

> 
> Thanks in advance!
> 
> t.
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@xxxxxxxxxxxxxxx
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> 
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux