Hi Robert, Do you think this could be https://tracker.ceph.com/issues/54620 (the traceback looks similar enough I think it likely is)? We had this issue in 17.2.0 when using a non-root ssh user. If it's the same thing, it should be fixed for the 17.2.1 release which is planned to be soon. Thanks, - Adam King On Thu, Jun 23, 2022 at 11:20 AM Robert Reihs <robert.reihs@xxxxxxxxx> wrote: > Hi all, > I am currently trying to setup a test cluster with cephadm on a system with > ipv6 setup. > In the ceph.conf I have: > ms_bind_ipv4 = false > ms_bind_ipv6 = true > I also have a non standard ssh port set, configured with the ssh-config > settings. > > After bootstrapping the first server I am adding hosts with monitors and > managers the cluster. The first system has mon and mrg running. > > I am getting a permission denied error: > debug 2022-06-23T14:51:41.776+0000 7f1a31ec8700 -1 log_channel(cephadm) log > [ERR] : executing refresh((['fsn1-ceph-01', 'fsn1-ceph-02', > 'fsn1-ceph-03'],)) failed. > Traceback (most recent call last): > File "/usr/share/ceph/mgr/cephadm/ssh.py", line 221, in > _write_remote_file > await asyncssh.scp(f.name, (conn, tmp_path)) > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in scp > await source.run(srcpath) > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in run > self.handle_error(exc) > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in > handle_error > raise exc from None > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in run > await self._send_files(path, b'') > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in > _send_files > self.handle_error(exc) > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in > handle_error > raise exc from None > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in > _send_files > await self._send_file(srcpath, dstpath, attrs) > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in > _send_file > await self._make_cd_request(b'C', attrs, size, srcpath) > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in > _make_cd_request > self._fs.basename(path)) > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in > make_request > raise exc > asyncssh.sftp.SFTPFailure: scp: /tmp/etc/ceph/ceph.conf.new: Permission > denied > During handling of the above exception, another exception occurred: > Traceback (most recent call last): > File "/usr/share/ceph/mgr/cephadm/utils.py", line 76, in do_work > return f(*arg) > File "/usr/share/ceph/mgr/cephadm/serve.py", line 265, in refresh > self._write_client_files(client_files, host) > File "/usr/share/ceph/mgr/cephadm/serve.py", line 1052, in > _write_client_files > self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid) > File "/usr/share/ceph/mgr/cephadm/ssh.py", line 238, in write_remote_file > host, path, content, mode, uid, gid, addr)) > File "/usr/share/ceph/mgr/cephadm/module.py", line 569, in wait_async > return self.event_loop.get_result(coro) > File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result > return asyncio.run_coroutine_threadsafe(coro, self._loop).result() > File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result > return self.__get_result() > File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in > __get_result > raise self._exception > File "/usr/share/ceph/mgr/cephadm/ssh.py", line 226, in > _write_remote_file > raise OrchestratorError(msg) > orchestrator._interface.OrchestratorError: Unable to write > fsn1-ceph-01:/etc/ceph/ceph.conf: scp: /tmp/etc/ceph/ceph.conf.new: > Permission denied > > Thanks! > Best > Robert Reihs > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |