Re: Proxmox 4.4, Ceph hammer, OSD cache link...

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I come back here.

> I've recently added a host to my ceph cluster, using proxmox 'helpers'
> to add OSD, eg:
> 
> 	pveceph createosd /dev/sdb -journal_dev /dev/sda5
> 
> and now i've:
> 
>  root@blackpanther:~# ls -la /var/lib/ceph/osd/ceph-12
>  totale 60
>  drwxr-xr-x   3 root root   199 nov 21 17:02 .
>  drwxr-xr-x   6 root root  4096 nov 21 23:08 ..
>  -rw-r--r--   1 root root   903 nov 21 17:02 activate.monmap
>  -rw-r--r--   1 root root     3 nov 21 17:02 active
>  -rw-r--r--   1 root root    37 nov 21 17:02 ceph_fsid
>  drwxr-xr-x 432 root root 12288 dic  1 18:21 current
>  -rw-r--r--   1 root root    37 nov 21 17:02 fsid
>  lrwxrwxrwx   1 root root     9 nov 21 17:02 journal -> /dev/sda5
>  -rw-------   1 root root    57 nov 21 17:02 keyring
>  -rw-r--r--   1 root root    21 nov 21 17:02 magic
>  -rw-r--r--   1 root root     6 nov 21 17:02 ready
>  -rw-r--r--   1 root root     4 nov 21 17:02 store_version
>  -rw-r--r--   1 root root    53 nov 21 17:02 superblock
>  -rw-r--r--   1 root root     0 nov 21 17:02 sysvinit
>  -rw-r--r--   1 root root     3 nov 21 17:02 whoami
> 
> and all works as expected, only i suposed to find as a journal not the
> device (/dev/sda5) but the uuid (/dev/disk/by-uuid/<UUID>).
> 
> But seems that the cache partition does not have an UUID associated:
> 
>   root@blackpanther:~# ls -la /dev/disk/by-uuid/ | grep sda5
>   root@blackpanther:~# blkid /dev/sda5
>   /dev/sda5: PARTUUID="a222c6bf-05"
> 
> I'm a but ''puzzled'' because if i've to add a disk ''before'' sda, all
> device name will change with, i suppose, unexpected result.
> 
> I'm missing something? Thanks.

I was forced to change some journal, using some partition (MBR); i've
stopped osd, flushed old journal, changed symplink and then do a
'journal format':

 root@deadpool:/var/lib/ceph/osd/ceph-6# ls -la
 totale 64
 drwxr-xr-x   3 root root   199 feb  6 17:45 .
 drwxr-xr-x   6 root root  4096 dic 14  2016 ..
 -rw-r--r--   1 root root   751 dic 14  2016 activate.monmap
 -rw-r--r--   1 root root     3 dic 14  2016 active
 -rw-r--r--   1 root root    37 dic 14  2016 ceph_fsid
 drwxr-xr-x 378 root root 20480 feb  6 17:12 current
 -rw-r--r--   1 root root    37 dic 14  2016 fsid
 lrwxrwxrwx   1 root root     9 feb  6 17:45 journal -> /dev/sda5
 -rw-------   1 root root    56 dic 14  2016 keyring
 -rw-r--r--   1 root root    21 dic 14  2016 magic
 -rw-r--r--   1 root root     6 dic 14  2016 ready
 -rw-r--r--   1 root root     4 dic 14  2016 store_version
 -rw-r--r--   1 root root    53 dic 14  2016 superblock
 -rw-r--r--   1 root root     0 feb  6 17:10 sysvinit
 -rw-r--r--   1 root root     2 dic 14  2016 whoami
 root@deadpool:/var/lib/ceph/osd/ceph-6# ceph-osd -i 6 --mkjournal
 2019-02-06 17:45:35.030359 7ff679c24880 -1 journal check: ondisk fsid 00000000-0000-0000-0000-000000000000 doesn't match expected 70357923-3227-4d57-980f-92b8c853dc76, invalid (someone else's?) journal
 2019-02-06 17:45:35.038522 7ff679c24880 -1 created new journal /var/lib/ceph/osd/ceph-6/journal for object store /var/lib/ceph/osd/ceph-6

Clearly i've changed the journal partition by hand (eg, direct link) so
i'm expecting that link is 'direct to partition'; but, and see the
warning about fsid, still there's no 'id' associated to that partition
(eg, no link in /dev/disk/by-*/).


If i rerun the 'mkjournal':

 root@deadpool:/var/lib/ceph/osd/ceph-6# ceph-osd -i 6 --mkjournal
 2019-02-06 17:45:37.621855 7f3391377880 -1 created new journal /var/lib/ceph/osd/ceph-6/journal for object store /var/lib/ceph/osd/ceph-6

So seems that effectively journal partition get 'tagged' in someway.


But i'm still confused... using ID link in journal partitions works
only for GPO partitioning?


Thanks.

-- 
dott. Marco Gaiarin				        GNUPG Key ID: 240A3D66
  Associazione ``La Nostra Famiglia''          http://www.lanostrafamiglia.it/
  Polo FVG   -   Via della Bontà, 7 - 33078   -   San Vito al Tagliamento (PN)
  marco.gaiarin(at)lanostrafamiglia.it   t +39-0434-842711   f +39-0434-842797

		Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA!
      http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000
	(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux