Re: Cephadm adoption - service reconfiguration changes container image

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



That would have been my suggestion as well, set your own container image and override the default. Just one comment, the config option is "container_image" and not "container", that one fails:

$ ceph config set global container my-registry:5000/ceph/ceph:16.2.9
Error EINVAL: unrecognized config option 'container'

Instead run:

$ ceph config set global container_image my-registry:5000/ceph/ceph:16.2.9

Zitat von Adam King <adking@xxxxxxxxxx>:

you could maybe try running "ceph config set global container
quay.io/ceph/ceph:v16.2.9" before running the adoption. It seems it still
thinks it should be deploying mons with the default image (
docker.io/ceph/daemon-base:latest-pacific-devel ) for some reason and maybe
that config option is why.

On Tue, Aug 15, 2023 at 7:29 AM Iain Stott <Iain.Stott@xxxxxxxxxxxxxxx>
wrote:

Hi Everyone,

We are looking at migrating all our production clusters from ceph-ansible
to cephadm. We are currently experiencing an issue where when reconfiguring
a service through ceph orch, it will change the running container image for
that service which has led to the mgr services running an earlier version
than the rest of the cluster, this has caused cephadm/ceph orch to not be
able to manage services in the cluster.

Does anyone have any help with this as I cannot find anything in the docs
that would correct this.

Cheers
Iain

[root@de1-ceph-mon-ceph-site-a-1 ~]# cephadm --image
quay.io/ceph/ceph:v16.2.9 adopt --style legacy --name mon.$(hostname -s)

[root@de1-ceph-mon-ceph-site-a-1 ~]# cat ./mon.yaml
service_type: mon
service_name: mon
placement:
  host_pattern: '*mon*'
extra_container_args:
- -v
- /etc/ceph/ceph.client.admin.keyring:/etc/ceph/ceph.client.admin.keyring


[root@de1-ceph-mon-ceph-site-a-1 ~]# cephadm shell -- ceph config get mgr
mgr/cephadm/container_image_base
quay.io/ceph/ceph

[root@de1-ceph-mon-ceph-site-a-1 ~]# podman ps -a | grep mon
55fe8bc10476  quay.io/ceph/ceph:v16.2.9
          -n mgr.de1-ceph-m...  5 minutes ago  Up 5 minutes
ceph-da9e9837-a3cf-4482-9a13-790a721598cd-mgr-de1-ceph-mon-ceph-site-a-1

[root@de1-ceph-mon-ceph-site-a-1 ~]# cat ./mon.yaml | cephadm --image
quay.io/ceph/ceph:v16.2.9 shell -- ceph orch apply -i -
Inferring fsid da9e9837-a3cf-4482-9a13-790a721598cd
Scheduled mon update...

[root@de1-ceph-mon-ceph-site-a-1 ~]# podman ps -a | grep mon
ecec1d62c719  docker.io/ceph/daemon-base:latest-pacific-devel
          -n mon.de1-ceph-m...  25 seconds ago  Up 26 seconds
ceph-da9e9837-a3cf-4482-9a13-790a721598cd-mon-de1-ceph-mon-ceph-site-a-1

[root@de1-ceph-mon-ceph-site-a-2 ~]# ceph versions
{
    "mon": {
        "ceph version 16.2.5-387-g7282d81d
(7282d81d2c500b5b0e929c07971b72444c6ac424) pacific (stable)": 3
    },
    "mgr": {
        "ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830)
pacific (stable)": 3
    },
    "osd": {
        "ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830)
pacific (stable)": 8
    },
    "mds": {},
    "rgw": {
        "ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830)
pacific (stable)": 3
    },
    "overall": {
        "ceph version 16.2.5-387-g7282d81d
(7282d81d2c500b5b0e929c07971b72444c6ac424) pacific (stable)": 3,
        "ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830)
pacific (stable)": 14
    }
}


Iain Stott
OpenStack Engineer
Iain.Stott@xxxxxxxxxxxxxxx
[THG Ingenuity Logo]<https://www.thg.com>
[https://i.imgur.com/wbpVRW6.png]<
https://www.linkedin.com/company/thgplc/?originalSubdomain=uk>  [
https://i.imgur.com/c3040tr.png] <https://twitter.com/thgplc?lang=en>
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux