Hi all, I'm deploying a new octopus cluster using cephadm, follow docs <https://ceph.io/ceph-management/introducing-cephadm/>. However it failed on the bootstrap step. According to the logs, key generating failed because of the lack of directory and file. Did I miss something? here is the logs: [root@ceph-mon1 ~]# cephadm bootstrap --mon-ip 172.24.202.119 INFO:cephadm:Verifying podman|docker is present... INFO:cephadm:Verifying lvm2 is present... INFO:cephadm:Verifying time synchronization is in place... INFO:cephadm:Unit ntpd.service is enabled and running INFO:cephadm:Repeating the final host check... INFO:cephadm:podman|docker (/usr/bin/docker) is present INFO:cephadm:systemctl is present INFO:cephadm:lvcreate is present INFO:cephadm:Unit ntpd.service is enabled and running INFO:cephadm:Host looks OK INFO:root:Cluster fsid: 828e6b7a-91c2-11ea-8644-005056885573 INFO:cephadm:Verifying IP 172.24.202.119 port 3300 ... INFO:cephadm:Verifying IP 172.24.202.119 port 6789 ... INFO:cephadm:Mon IP 172.24.202.119 is in CIDR network 172.24.202.0/24 INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15 container... INFO:cephadm:Extracting ceph user uid/gid from container image... INFO:cephadm:Creating initial keys... INFO:cephadm:Creating initial monmap... INFO:cephadm:Creating mon... INFO:cephadm:Waiting for mon to start... INFO:cephadm:Waiting for mon... INFO:cephadm:Assimilating anything we can from ceph.conf... INFO:cephadm:Generating new minimal ceph.conf... INFO:cephadm:Restarting the monitor... INFO:cephadm:Setting mon public_network... INFO:cephadm:Creating mgr... INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring INFO:cephadm:Wrote config to /etc/ceph/ceph.conf INFO:cephadm:Waiting for mgr to start... INFO:cephadm:Waiting for mgr... INFO:cephadm:mgr not available, waiting (1/10)... INFO:cephadm:mgr not available, waiting (2/10)... INFO:cephadm:mgr not available, waiting (3/10)... INFO:cephadm:mgr not available, waiting (4/10)... INFO:cephadm:mgr not available, waiting (5/10)... INFO:cephadm:Enabling cephadm module... INFO:cephadm:Waiting for the mgr to restart... INFO:cephadm:Waiting for Mgr epoch 4... INFO:cephadm:Setting orchestrator backend to cephadm... INFO:cephadm:Generating ssh key... INFO:cephadm:Non-zero exit code 22 from /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15 -e NODE_NAME=ceph-mon1 -v /var/log/ceph/828e6b7a-91c2-11ea-8644-005056885573:/var/log/ceph:z -v /tmp/ceph-tmp8ydndiho:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9yl7hx5u:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15 cephadm generate-key INFO:cephadm:/usr/bin/ceph:stderr Error EINVAL: Traceback (most recent call last): INFO:cephadm:/usr/bin/ceph:stderr File "/usr/share/ceph/mgr/cephadm/module.py", line 1438, in _generate_key INFO:cephadm:/usr/bin/ceph:stderr with open(path, 'r') as f: INFO:cephadm:/usr/bin/ceph:stderr FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpxvc18jh3/key' INFO:cephadm:/usr/bin/ceph:stderr INFO:cephadm:/usr/bin/ceph:stderr During handling of the above exception, another exception occurred: INFO:cephadm:/usr/bin/ceph:stderr INFO:cephadm:/usr/bin/ceph:stderr Traceback (most recent call last): INFO:cephadm:/usr/bin/ceph:stderr File "/usr/share/ceph/mgr/mgr_module.py", line 1153, in _handle_command INFO:cephadm:/usr/bin/ceph:stderr return self.handle_command(inbuf, cmd) INFO:cephadm:/usr/bin/ceph:stderr File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 110, in handle_command INFO:cephadm:/usr/bin/ceph:stderr return dispatch[cmd['prefix']].call(self, cmd, inbuf) INFO:cephadm:/usr/bin/ceph:stderr File "/usr/share/ceph/mgr/mgr_module.py", line 308, in call INFO:cephadm:/usr/bin/ceph:stderr return self.func(mgr, **kwargs) INFO:cephadm:/usr/bin/ceph:stderr File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 72, in <lambda> INFO:cephadm:/usr/bin/ceph:stderr wrapper_copy = lambda *l_args, **l_kwargs: wrapper(*l_args, **l_kwargs) INFO:cephadm:/usr/bin/ceph:stderr File "/usr/share/ceph/mgr/orchestrator/_interface.py", line 63, in wrapper INFO:cephadm:/usr/bin/ceph:stderr return func(*args, **kwargs) INFO:cephadm:/usr/bin/ceph:stderr File "/usr/share/ceph/mgr/cephadm/module.py", line 1443, in _generate_key INFO:cephadm:/usr/bin/ceph:stderr os.unlink(path) INFO:cephadm:/usr/bin/ceph:stderr FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpxvc18jh3/key' INFO:cephadm:/usr/bin/ceph:stderr Traceback (most recent call last): File "./cephadm", line 4579, in <module> r = args.func() File "./cephadm", line 1122, in _default_image return func() File "./cephadm", line 2521, in command_bootstrap cli(['cephadm', 'generate-key']) File "./cephadm", line 2409, in cli ).run(timeout=timeout) File "./cephadm", line 2142, in run self.run_cmd(), desc=self.entrypoint, timeout=timeout) File "./cephadm", line 837, in call_throws raise RuntimeError('Failed command: %s' % ' '.join(command)) RuntimeError: Failed command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15 -e NODE_NAME=ceph-mon1 -v /var/log/ceph/828e6b7a-91c2-11ea-8644-005056885573:/var/log/ceph:z -v /tmp/ceph-tmp8ydndiho:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp9yl7hx5u:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15 cephadm generate-key OS: CentOS Linux release 7.8.2003 (Core) Kernel: 3.10.0-514.6.1.el7.x86_64 Docker version: 19.03.8 cephadm: Using recent ceph image ceph/ceph:v15 ceph version 15.2.1 (9fd2f65f91d9246fae2c841a6222d34d121680ee) octopus (stable) Thanks _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx