Ceph Orchestrator (cephadm) stopped doing something

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

ceph orch commands are not executed anymore in my cephadm-managed cluster
(17.2.3) and I don't see why. Cluster is healthy and overall working,
except for the orchestrator part.

For instance, when I run `ceph orch redeploy ingress.rgw.default`, I see
the command in audit logs, cephadm also logs the command and
"_kick_serve_loop" and that's it. No more messages or errors (also not in
logs with debug level: ceph config set mgr mgr/cephadm/log_to_cluster_level
debug; ceph -W cephadm --watch-debug) but it never redeploys the service.

Nov 21 07:54:45 ceph-0.yy.xxxx.net bash[1262]: debug
2022-11-21T07:54:45.397+0000 7f7b6b527700  0 log_channel(audit) log [DBG] :
from='client.38766115 -' entity='client.admin' cmd=[{"prefix": "orch",
"action": "redeploy", "service_nam
Nov 21 07:54:45 ceph-0.yy.xxxx.net bash[1262]: debug
2022-11-21T07:54:45.401+0000 7f7b6bd28700  0 [cephadm INFO root] Redeploy
service ingress.rgw.default
Nov 21 07:54:45 ceph-0.yy.xxxx.net bash[1262]: debug
2022-11-21T07:54:45.401+0000 7f7b6bd28700  0 log_channel(cephadm) log [INF]
: Redeploy service ingress.rgw.default
Nov 21 07:54:45 ceph-0.yy.xxxx.net bash[1262]: debug
2022-11-21T07:54:45.401+0000 7f7b6bd28700  0 log_channel(cephadm) log [DBG]
: _kick_serve_loop
Nov 21 07:54:45 ceph-0.yy.xxxx.net bash[1262]: debug
2022-11-21T07:54:45.401+0000 7f7b6bd28700  0 log_channel(cephadm) log [DBG]
: _kick_serve_loop

Same behaviour for many other ceph orch ... command including ceph orch
upgrade.

# ceph orch status
Backend: cephadm
Available: Yes
Paused: No

According to status, orchestrator is available and not paused. I have tried
to set the backend to "" and reset to "cephadm", I paused and resumed the
orchestrator, cleared progress entries and such but nothing could make the
cluster execute the commands. SSH connections between hosts are working.

Any ideas how to fix or even debug this? I am a bit lost on this.

Regards, SW.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux