|
CEPH-DEPLOY EVALUATION ON CEPH VERSION 61.7 ADMINNODE: root@ubuntuceph900athf1:~# ceph -v ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff) root@ubuntuceph900athf1:~# SERVERNODE: root@ubuntuceph700athf1:/etc/ceph# ceph -v ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff) root@ubuntuceph700athf1:/etc/ceph# ===============================================================: Trial-1 of using ceph-deploy results: (http://ceph.com/docs/next/start/quick-ceph-deploy/) My trial-1 scenario is using ceph-deploy to replace 2 OSD's (osd.2 and OSD.11) of a ceph node. Obesrvation: ceph-deploy creating a symbolic-links ceph-0-->ceph-2 dir and ceph-1--->ceph-11 dir. I did not ran into any errors or issue in this trials. once concern: --ceph deploy did not update linux fstab of mount point of osd data. ======================================================================================= Trial 2: (http://ceph.com/docs/next/start/quick-ceph-deploy/) I notice my node did not have any contents in /var/lib/ceph/boostrap-{osd}|{mds} . Result: FAILURE TO MOVE FORWARD BEYOND THIS STEP Tip from
http://ceph.com/docs/next/start/quick-ceph-deploy/ If you don’t have these keyrings, you may not have created a monitor successfully,
or you may have a problem with your network connection. Ensure that you complete this step such that you have the foregoing keyrings before proceeding further. Tip from (http://ceph.com/docs/next/start/quick-ceph-deploy/: You may repeat this procedure. If it fails, check to see if the /var/lib/ceph/boostrap-{osd}|{mds} directories on the server node have keyrings.
If they do not have keyrings, try adding the monitor again; then, return to this step. My WORKAROUND1: COPIED CONTENTS OF /var/lib/ceph/boostrap-{osd}|{mds} FROM ANOTHER NODE
My WORKAROUND2: USED CREATE A NEW CLUSTER PROCEDURE with CEPH-DEPLOY to create missing keyrings. =============================: TRIAL-3: Attemp to build a new cluster/1-Node using ceph deploy: RESULT FAILED TO GO BEYOND THE ERROR LOGS BELOW: root@ubuntuceph900athf1:~/my-cluster# ceph-deploy osd prepare ubuntuceph700athf1:sde1:/var/lib/ceph/journal/osd.0.journal ceph-disk-prepare -- /dev/sde1 /var/lib/ceph/journal/osd.0.journal returned 1 meta-data="" isize=2048 agcount=4, agsize=30524098 blks = sectsz=512 attr=2, projid32bit=0 data = bsize=4096 blocks=122096390, imaxpct=25 = sunit=0 swidth=0 blks naming =version 2 bsize=4096 ascii-ci=0 log =internal log bsize=4096 blocks=59617, version=2 = sectsz=512 sunit=0 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data umount: /var/lib/ceph/tmp/mnt.iMsc1G: device is busy. (In some cases useful info about processes that use the device is found by lsof(8) or fuser(1)) ceph-disk: Unmounting filesystem failed: Command '['/bin/umount', '--', '/var/lib/ceph/tmp/mnt.iMsc1G']' returned non-zero exit status 1 ceph-deploy: Failed to create 1 OSDs root@ubuntuceph900athf1:~/my-cluster# ceph-deploy osd prepare ubuntuceph700athf1:sde1 ceph-disk-prepare -- /dev/sde1 returned 1 meta-data="" isize=2048 agcount=4, agsize=30524098 blks = sectsz=512 attr=2, projid32bit=0 data = bsize=4096 blocks=122096390, imaxpct=25 = sunit=0 swidth=0 blks naming =version 2 bsize=4096 ascii-ci=0 log =internal log bsize=4096 blocks=59617, version=2 = sectsz=512 sunit=0 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 umount: /var/lib/ceph/tmp/mnt.0JxBp1: device is busy. (In some cases useful info about processes that use the device is found by lsof(8) or fuser(1)) ceph-disk: Unmounting filesystem failed: Command '['/bin/umount', '--', '/var/lib/ceph/tmp/mnt.0JxBp1']' returned non-zero exit status 1 ceph-deploy: Failed to create 1 OSDs root@ubuntuceph900athf1:~/my-cluster# ceph-deploy osd prepare ubuntuceph700athf1:sde1 ceph-disk-prepare -- /dev/sde1 returned 1 ceph-disk: Error: Device is mounted: /dev/sde1 ceph-deploy: Failed to create 1 OSDs Attempted on the local node: root@ubuntuceph700athf1:/etc/ceph# ceph-deploy osd prepare ubuntuceph700athf1:sde1:/var/lib/ceph/journal/osd.0.journal ceph-disk-prepare -- /dev/sde1 /var/lib/ceph/journal/osd.0.journal returned 1 ceph-disk: Error: Device is mounted: /dev/sde1 /dev/sde1 on /var/lib/ceph/tmp/mnt.GzZLAr type xfs (rw,noatime) RESULT: ceph-deploy complaints that osd drive is mounted, it was not mounted prior to running command, ceph-deploy mounted it, then complains that its mounted. root@ubuntuceph700athf1:/etc/ceph# ceph-deploy osd prepare ubuntuceph700athf1:sdf1:/var/lib/ceph/journal/osd.1.journal ceph-disk-prepare -- /dev/sdf1 /var/lib/ceph/journal/osd.1.journal returned 1 meta-data="" isize=2048 agcount=4, agsize=30524098 blks = sectsz=512 attr=2, projid32bit=0 data = bsize=4096 blocks=122096390, imaxpct=25 = sunit=0 swidth=0 blks naming =version 2 bsize=4096 ascii-ci=0 log =internal log bsize=4096 blocks=59617, version=2 = sectsz=512 sunit=0 blks, lazy-count=1 realtime =none extsz=4096 blocks=0, rtextents=0 WARNING:ceph-disk:OSD will not be hot-swappable if journal is not the same device as the osd data umount: /var/lib/ceph/tmp/mnt.BxJFZa: device is busy. (In some cases useful info about processes that use the device is found by lsof(8) or fuser(1)) ceph-disk: Unmounting filesystem failed: Command '['/bin/umount', '--', '/var/lib/ceph/tmp/mnt.BxJFZa']' returned non-zero exit status 1 ceph-deploy: Failed to create 1 OSDs root@ubuntuceph700athf1:/etc/ceph# RESULT: ceph-deploy complaints that osd drive is mounted, it was not mounted prior to running command, ceph-deploy mounted it, then complains that its mounted. |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
