Did a few more tests :
Older Ceph server with a pveceph create osd command (
(pveceph create osd /dev/sdb
equivalent to
ceph-disk prepare --zap-disk --fs-type xfs --cluster ceph --cluster-uuid
a5c0cfed-...4bf939ed70 /dev/sdb )
sgdisk --print /dev/sdd
Disk /dev/sdd: 2930277168 sectors, 1.4 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 638646CF-......-62296C871132
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 2930277134
Partitions will be aligned on 2048-sector boundaries
Total free space is 2014 sectors (1007.0 KiB)
Number Start (sector) End (sector) Size Code Name
1 10487808 2930277134 1.4 TiB F800 ceph data
2 2048 10487807 5.0 GiB F802 ceph journal
On a newer ceph server ( dpkg -l : 12.2.0-pve1 version)
sgdisk --print /dev/sdb
Disk /dev/sdb: 1465149168 sectors, 698.6 GiB
Logical sector size: 512 bytes
Disk identifier (GUID): D63886B6-0.....26-BCBCD6FFCA3C
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 1465149134
Partitions will be aligned on 2048-sector boundaries
Total free space is 2014 sectors (1007.0 KiB)
Number Start (sector) End (sector) Size Code Name
1 2048 206847 100.0 MiB F800 ceph data
2 206848 1465149134 698.5 GiB FFFF ceph block
Related to the cep-osd.admin log , i think i used a osd creation process
leading to a bluestore osd (instead of a filestore one).
And seems that afterward the ceph server is unable to use the new
bluestore :
( bluestore(/dev/sdb2) _read_bdev_label unable to decode label at offset
102: buffer::malformed_input: void
bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode
past end of struct encoding
)
just before trying to use it as a filestore one :
( probe_block_device_fsid /dev/sdb2 is filestore )
Tried to use the --bluestore 0 flag when creating the osd, but the flag
is unknown.
thanks by advance for any hint.
Being ready to do a few more tests.
Best regards.
Le 08/09/2017 à 17:25, Phil Schwarz a écrit :
Hi,
any help would be really useful.
Does anyone got a clue with my issue ?
Thanks by advance.
Best regards;
Le 05/09/2017 à 20:25, Phil Schwarz a écrit :
Hi,
I come back with same issue as seen in previous thread ( link given)
trying to a 2TB SATA as OSD:
Using proxmox GUI or CLI (command given) give the same (bad) result.
Didn't want to use a direct 'ceph osd create', thus bypassing pxmfs
redundant filesystem.
I tried to build an OSD woth same disk on another machine (stronger one
with Opteron QuadCore), failing at the same time.
Sorry for crossposting, but i think, i fail against the pveceph wrapper.
Any help or clue would be really useful..
Thanks
Best regards.
-- Link to previous thread (but same problem):
https://www.mail-archive.com/ceph-users@xxxxxxxxxxxxxx/msg38897.html
-- commands :
fdisk /dev/sdc ( mklabel msdos, w, q)
ceph-disk zap /dev/sdc
pveceph createosd /dev/sdc
-- dpkg -l
dpkg -l |grep ceph
ii ceph 12.1.2-pve1 amd64
distributed storage and file system
ii ceph-base 12.1.2-pve1 amd64 common
ceph daemon libraries and management tools
ii ceph-common 12.1.2-pve1 amd64 common
utilities to mount and interact with a ceph storage cluster
ii ceph-mgr 12.1.2-pve1 amd64
manager for the ceph distributed storage system
ii ceph-mon 12.1.2-pve1 amd64
monitor server for the ceph storage system
ii ceph-osd 12.1.2-pve1 amd64 OSD
server for the ceph storage system
ii libcephfs1 10.2.5-7.2 amd64 Ceph
distributed file system client library
ii libcephfs2 12.1.2-pve1 amd64 Ceph
distributed file system client library
ii python-cephfs 12.1.2-pve1 amd64 Python
2 libraries for the Ceph libcephfs library
-- tail -f /var/log/ceph/ceph-osd.admin.log
2017-09-03 18:28:20.856641 7fad97e45e00 0 ceph version 12.1.2
(cd7bc3b11cdbe6fa94324b7322fb2a4716a052a7) luminous (rc), process
(unknown), pid 5493
2017-09-03 18:28:20.857104 7fad97e45e00 -1 bluestore(/dev/sdc2)
_read_bdev_label unable to decode label at offset 102:
buffer::malformed_input: void
bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode
past end of struct encoding
2017-09-03 18:28:20.857200 7fad97e45e00 1 journal _open /dev/sdc2 fd 4:
2000293007360 bytes, block size 4096 bytes, directio = 0, aio = 0
2017-09-03 18:28:20.857366 7fad97e45e00 1 journal close /dev/sdc2
2017-09-03 18:28:20.857431 7fad97e45e00 0 probe_block_device_fsid
/dev/sdc2 is filestore, 00000000-0000-0000-0000-000000000000
2017-09-03 18:28:21.937285 7fa5766a5e00 0 ceph version 12.1.2
(cd7bc3b11cdbe6fa94324b7322fb2a4716a052a7) luminous (rc), process
(unknown), pid 5590
2017-09-03 18:28:21.944189 7fa5766a5e00 -1 bluestore(/dev/sdc2)
_read_bdev_label unable to decode label at offset 102:
buffer::malformed_input: void
bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode
past end of struct encoding
2017-09-03 18:28:21.944305 7fa5766a5e00 1 journal _open /dev/sdc2 fd 4:
2000293007360 bytes, block size 4096 bytes, directio = 0, aio = 0
2017-09-03 18:28:21.944527 7fa5766a5e00 1 journal close /dev/sdc2
2017-09-03 18:28:21.944588 7fa5766a5e00 0 probe_block_device_fsid
/dev/sdc2 is filestore, 00000000-0000-0000-0000-000000000000
_______________________________________________
pve-user mailing list
pve-user@xxxxxxxxxxxxxxx
https://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
