Re: ceph orch upgrade stuck at the beginning.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Ashley,

I see this:
[INF] Upgrade: Target is docker.io/ceph/ceph:v15.2.2 with id 4569944bbW86c3f9b5286057a558a3f852156079f759c9734e54d4f64092be9fa
[INF] Upgrade: It is NOT safe to stop mon.vx-rg23-rk65-u43-130


Does this meaning anything to you?

I've also attached full log. See especially after line #49. I stopped and restart upgrade there.

Thanks,
Gencer.
On 20.05.2020 16:13:00, Ashley Merrick <singapore@xxxxxxxxxxxxxx> wrote:
ceph config set mgr mgr/cephadm/log_to_cluster_level debug

ceph -W cephadm --watch-debug


See if you see anything that stands out as an issue with the update, seems it has completed only the two MGR instances


If not:


ceph orch upgrade stop

ceph orch upgrade start --ceph-version 15.2.2


and monitor the watch-debug log


Make sure at the end you run:


ceph config set mgr mgr/cephadm/log_to_cluster_level info



---- On Wed, 20 May 2020 21:07:43 +0800 Gencer W. Genç <gencer@xxxxxxxxxxxxx> wrote ----


Ah yes,


{

    "mon": {

        "ceph version 15.2.1 (9fd2f65f91d9246fae2c841a6222d34d121680ee) octopus (stable)": 2

    },

    "mgr": {

        "ceph version 15.2.2 (0c857e985a29d90501a285f242ea9c008df49eb8) octopus (stable)": 2

    },

    "osd": {

        "ceph version 15.2.1 (9fd2f65f91d9246fae2c841a6222d34d121680ee) octopus (stable)": 24

    },

    "mds": {

        "ceph version 15.2.1 (9fd2f65f91d9246fae2c841a6222d34d121680ee) octopus (stable)": 2

    },

    "overall": {

        "ceph version 15.2.1 (9fd2f65f91d9246fae2c841a6222d34d121680ee) octopus (stable)": 28,

        "ceph version 15.2.2 (0c857e985a29d90501a285f242ea9c008df49eb8) octopus (stable)": 2

    }

}


How can i fix this?


Gencer.

On 20.05.2020 16:04:33, Ashley Merrick <singapore@xxxxxxxxxxxxxx [mailto:singapore@xxxxxxxxxxxxxx]> wrote:

Does:


ceph versions


show any services yet running on 15.2.2?



---- On Wed, 20 May 2020 21:01:12 +0800 Gencer W. Genç <gencer@xxxxxxxxxxxxx [mailto:gencer@xxxxxxxxxxxxx]> wrote ----


Hi Ashley,
$ ceph orch upgrade status


{

    "target_image": "docker.io/ceph/ceph:v15.2.2",

    "in_progress": true,

    "services_complete": [],

    "message": ""

}


Thanks,

Gencer.


On 20.05.2020 15:58:34, Ashley Merrick <singapore@xxxxxxxxxxxxxx [mailto:singapore@xxxxxxxxxxxxxx]> wrote:

What does

ceph orch upgrade status

show?



---- On Wed, 20 May 2020 20:52:39 +0800 Gencer W. Genç <gencer@xxxxxxxxxxxxx [mailto:gencer@xxxxxxxxxxxxx]> wrote ----


Hi,

I've 15.2.1 installed on all machines. On primary machine I executed ceph upgrade command:

$ ceph orch upgrade start --ceph-version 15.2.2


When I check ceph -s I see this:

  progress:
    Upgrade to docker.io/ceph/ceph:v15.2.2 (30m)
      [=...........................] (remaining: 8h)

It says 8 hours. It is already ran for 3 hours. No upgrade processed. It get stuck at this point.

Is there any way to know why this has stuck?

Thanks,
Gencer.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx [mailto:ceph-users@xxxxxxx]
To unsubscribe send an email to ceph-users-leave@xxxxxxx [mailto:ceph-users-leave@xxxxxxx]






_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux