Hi, We assimilated our Ceph configuration to store attributes within Ceph itself and subsequently have a minimal configuration file. Whilst this works perfectly we are unable to remove configuration entries populated by the assimilate-conf
command. Ceph Nautilus 14.2.4.1 upgrade notes: cd /etc/pve; ceph config assimilate-conf -i ceph.conf -o ceph.conf.new; mv ceph.conf.new ceph.conf; pico /etc/ceph/ceph.conf # add back: cluster_network # public_network ceph config rm global cluster_network; ceph config rm global public_network; ceph config set global mon_osd_down_out_subtree_limit host; Resulting minimal Ceph configuration file: [admin@kvm1c ~]#
cat /etc/ceph/ceph.conf [global] cluster_network = 10.248.1.0/24 filestore_xattr_use_omap = true fsid = 31f6ea46-12cb-47e8-a6f3-60fb6bbd1782 mon_host = 10.248.1.60 10.248.1.61 10.248.1.62 public_network = 10.248.1.0/24 [client] keyring = /etc/pve/priv/$cluster.$name.keyring Ceph configuration entries: [admin@kvm1c ~]#
ceph config dump WHO MASK LEVEL OPTION VALUE RO global advanced auth_client_required cephx * global advanced auth_cluster_required cephx * global advanced auth_service_required cephx * global advanced cluster_network 10.248.1.0/24 * global advanced debug_filestore 0/0 global advanced debug_journal 0/0 global advanced debug_ms 0/0 global advanced debug_osd 0/0 global basic device_failure_prediction_mode cloud global advanced mon_allow_pool_delete true global advanced mon_osd_down_out_subtree_limit host global advanced osd_deep_scrub_interval 1209600.000000 global advanced osd_pool_default_min_size 2 global advanced osd_pool_default_size 3 global advanced osd_scrub_begin_hour 19 global advanced osd_scrub_end_hour 6 global advanced osd_scrub_sleep 0.100000 global advanced public_network 10.248.1.0/24 * global advanced rbd_default_features 7 global advanced rbd_default_features 31 mgr advanced mgr/balancer/active true mgr advanced mgr/balancer/mode upmap mgr advanced mgr/devicehealth/enable_monitoring true Note the duplicate ‘rdb_default_features’ entry. We’ve switched to kernel 5.3 which supports object-map and fast-diff and subsequently wanted to change the default features for new RBD images to reflect this. Commands we entered to get here: [admin@kvm1b ~]#
ceph config dump | grep -e WHO -e rbd_default_features WHO MASK LEVEL OPTION VALUE RO global advanced rbd_default_features 7 [admin@kvm1b ~]#
ceph config rm global rbd_default_features [admin@kvm1b ~]#
ceph config rm global rbd_default_features [admin@kvm1b ~]#
ceph config rm global rbd_default_features [admin@kvm1b ~]#
ceph config dump | grep -e WHO -e rbd_default_features WHO MASK LEVEL OPTION VALUE RO global advanced rbd_default_features 7 [admin@kvm1b ~]#
ceph config set global rbd_default_features 31 [admin@kvm1b ~]#
ceph config dump | grep -e WHO -e rbd_default_features WHO MASK LEVEL OPTION VALUE RO global advanced rbd_default_features 7 global advanced rbd_default_features 31 Regards David Herselman |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com