I do not have a separate partition for OSD. As this is just an experimental node, the OSD data is stored on the disk in a folder (/var/lib/ceph/osd/ceph-0). I deleted that folder, and re-created it. Also disabled selinux, and ran sudo mkcephfs again. It gave the same error. Just for the record, my underlying FS is ext4.
Thanks,
Varun
--
Varun Chandramouli
Birla Institute of Technology & Science
http://in.linkedin.com/in/chandramoulivarun
On Thu, Feb 21, 2013 at 6:25 AM, Wales Wang <wormwang@xxxxxxxxx> wrote:
pls disable the selinux and clear the OSD's partition
I fixed a issue of BtrFS, mkcephfs create some directory , but them can not remove by rm .
Wales Wang
在 2013-2-21，上午6:42，Noah Watkins <jayhawk@xxxxxxxxxxx> 写道：
> Varun,
>
> It isn't clear from the log where exactly the problem is cropping up. Would you mind trying to use the stable Bobtail release?
>
> - Noah
>
> On Feb 20, 2013, at 5:54 AM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote:
>
>> Hi All,
>>
>> I still am unable to remove the error which I have been getting. I tried re-building ceph, but the same error persists. Someone please help me out.
>>
>> Thanks a lot
>> Varun
>>
>> On Mon, Feb 18, 2013 at 11:05 PM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote:
>> Noah,
>>
>> Thanks, turns out I had indeed changed the wrong file. Anyways, now I have changed the correct file. Since the output was too big to be captured and pasted here, I am attaching the file. Hope its ok.
>>
>> Varun
>>
>>
>> On Mon, Feb 18, 2013 at 10:49 PM, Noah Watkins <jayhawk@xxxxxxxxxxx> wrote:
>>
>> On Feb 18, 2013, at 9:06 AM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote:
>>
>>> Hi Noah,
>>>
>>> I made the change (added -x to !/bin/sh -x and uncommented it) to the mkcephfs file available in the source code, /home/varunc/ceph/src/mkcephfs in my case), and the output was what I pasted. find / -name mkcephfs did not return any other location for the file, so I guess there is only one mkcephfs script on my machine. Is there some other file I should be modifying?
>>
>> To make sure you are editing the correct file, run
>>
>> #> which mkcephfs
>>
>> which will print the full path to the script being run.
>>
>> The first few lines of the top of the script should look like (with the #):
>>
>> #!/bin/sh -x
>> #
>> # mkcephfs
>> #
>> # This tool is designed to be flexible. There are two ways to go:
>>
>> If for some reason it is still not working, you can add an echo statement to confirm:
>>
>> #!/bin/sh
>>
>> set -x
>> echo "I should be seeing this"
>>
>> #
>> # mkcephfs
>> #
>> # This tool is designed to be flexible. There are two ways to go:
>>
>> -Noah
>>
>>>
>>> Varun
>>>
>>> On Mon, Feb 18, 2013 at 9:24 PM, Noah Watkins <jayhawk@xxxxxxxxxxx> wrote:
>>> Varun,
>>>
>>> Are you sure the "-x" made it into the installed mkcephfs script that you are running? The output should be very large and verbose. Here are the first few lines of output--each command should be echoed to the terminal:
>>>
>>> nwatkins@kyoto:~/projects/ceph/ceph/src$ ./mkcephfs -a -c ceph.conf
>>> + set -e
>>> + dirname ./mkcephfs
>>> + [ . = . ]
>>> + [ /home/nwatkins/projects/ceph/ceph/src != /etc/init.d ]
>>> + BINDIR=.
>>>
>>> .. and on and on and on and on and on
>>>
>>> On Feb 18, 2013, at 2:58 AM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote:
>>>
>>>> Hi Sam,
>>>>
>>>> I tried doing what you said. I added -x to 1st line of mkcephfs, and ran the command again. It again gave the same error:
>>>>
>>>> root@varunc5-virtual-machine:/usr/local/bin# mkcephfs -a -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.keyring
>>>> temp dir is /tmp/mkcephfs.bErzjDo3P9
>>>> preparing monmap in /tmp/mkcephfs.bErzjDo3P9/monmap
>>>> /usr/local/bin/monmaptool --create --clobber --add a 10.72.148.217:6789 --print /tmp/mkcephfs.bErzjDo3P9/monmap
>>>> /usr/local/bin/monmaptool: monmap file /tmp/mkcephfs.bErzjDo3P9/monmap
>>>> /usr/local/bin/monmaptool: generated fsid a63961e3-4aac-4f98-808f-c35bfd52dbfd
>>>> epoch 0
>>>> fsid a63961e3-4aac-4f98-808f-c35bfd52dbfd
>>>> last_changed 2013-02-18 16:23:37.112440
>>>> created 2013-02-18 16:23:37.112440
>>>> 0: 10.72.148.217:6789/0 mon.a
>>>> /usr/local/bin/monmaptool: writing epoch 0 to /tmp/mkcephfs.bErzjDo3P9/monmap (1 monitors)
>>>> Building generic osdmap from /tmp/mkcephfs.bErzjDo3P9/conf
>>>> /usr/local/bin/osdmaptool: osdmap file '/tmp/mkcephfs.bErzjDo3P9/osdmap'
>>>> /usr/local/bin/osdmaptool: writing epoch 1 to /tmp/mkcephfs.bErzjDo3P9/osdmap
>>>> Generating admin key at /tmp/mkcephfs.bErzjDo3P9/keyring.admin
>>>> creating /tmp/mkcephfs.bErzjDo3P9/keyring.admin
>>>> Building initial monitor keyring
>>>> cat: /tmp/mkcephfs.bErzjDo3P9/key.*: No such file or directory
>>>>
>>>> I am pasting my ceph.conf file here:
>>>>
>>>> [global]
>>>> auth cluster required = cephx
>>>> auth service required = cephx
>>>> auth client required = cephx
>>>>
>>>> [osd]
>>>> osd journal size = 1000
>>>> filestore xattr use omap = true
>>>> osd data = ""> >>>>
>>>> [mon.a]
>>>> host = varunc5-virtual-machine
>>>> mon addr = 10.72.148.217:6789
>>>> mon data = ""> >>>>
>>>> [mds.a]
>>>> host = varunc5-virtual-machine
>>>> mds data = ""> >>>>
>>>> [osd.0]
>>>> host = varunc5-virtual-machine
>>>>
>>>> Is there something that I am doing wrong? Please let me know.
>>>>
>>>> Thanks,
>>>> Varun
>>>>
>>>> On Fri, Feb 15, 2013 at 10:42 PM, Sam Lang <sam.lang@xxxxxxxxxxx> wrote:
>>>> On Fri, Feb 15, 2013 at 10:53 AM, Varun Chandramouli
>>>> <varun.c37@xxxxxxxxx> wrote:
>>>>> No, that is the entire output.
>>>>
>>>> Hi Varun,
>>>>
>>>> I don't immediately see how that error is occurring. Could you:
>>>>
>>>> 1. Add a -x to the first line of mkcephfs:
>>>> #!/bin/sh -x
>>>>
>>>> 2. Rerun it and send us the output
>>>> 3. Send us your ceph.conf
>>>>
>>>> Thanks!
>>>> -sam
>>>>
>>>>>
>>>>>
>>>>> On Fri, Feb 15, 2013 at 10:20 PM, Noah Watkins <jayhawk@xxxxxxxxxxx> wrote:
>>>>>>
>>>>>>
>>>>>> On Feb 15, 2013, at 8:28 AM, Varun Chandramouli <varun.c37@xxxxxxxxx>
>>>>>> wrote:
>>>>>>
>>>>>>> Generating admin key at /tmp/mkcephfs.Pqu0j1MQsc/keyring.admin
>>>>>>> creating /tmp/mkcephfs.Pqu0j1MQsc/keyring.admin
>>>>>>> Building initial monitor keyring
>>>>>>> cat: /tmp/mkcephfs.Pqu0j1MQsc/key.*: No such file or directory
>>>>>>
>>>>>> There might be an issue with mkcephfs in master. Is there more to this
>>>>>> output after the last line?
>>>>>>
>>>>>> - Noah
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Varun Chandramouli
>>>>> Birla Institute of Technology & Science
>>>>> http://in.linkedin.com/in/chandramoulivarun
>>>>>
>>>>> _______________________________________________
>>>>> ceph-users mailing list
>>>>> ceph-users@xxxxxxxxxxxxxx
>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>>
>>>>
>>>>
>>>> --
>>>> Varun Chandramouli
>>>> Birla Institute of Technology & Science
>>>> http://in.linkedin.com/in/chandramoulivarun
>>>> _______________________________________________
>>>> ceph-users mailing list
>>>> ceph-users@xxxxxxxxxxxxxx
>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>>
>>>
>>>
>>> --
>>> Varun Chandramouli
>>> Birla Institute of Technology & Science
>>> http://in.linkedin.com/in/chandramoulivarun
>>
>>
>>
>>
>> --
>> Varun Chandramouli
>> Birla Institute of Technology & Science
>> http://in.linkedin.com/in/chandramoulivarun
>>
>>
>>
>> --
>> Varun Chandramouli
>> Birla Institute of Technology & Science
>> http://in.linkedin.com/in/chandramoulivarun
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Varun Chandramouli
Birla Institute of Technology & Science
http://in.linkedin.com/in/chandramoulivarun
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
