Hi, I tested with the 17.2.1 release with a non root ssh user and it worked fine. Best Robert On Thu, Jun 23, 2022 at 9:12 PM Robert Reihs <robert.reihs@xxxxxxxxx> wrote: > Thanks for the help, It was the same issue. > > Best > Robert > > On Thu, Jun 23, 2022 at 8:37 PM Robert Reihs <robert.reihs@xxxxxxxxx> > wrote: > >> Hi Adam, >> >> Yes looks like the same error, I will test it with the root user. >> >> Thanks for the quick help. >> Best >> Robert >> >> On Thu, Jun 23, 2022 at 7:46 PM Adam King <adking@xxxxxxxxxx> wrote: >> >>> Hi Robert, >>> >>> Do you think this could be https://tracker.ceph.com/issues/54620 (the >>> traceback looks similar enough I think it likely is)? We had this issue in >>> 17.2.0 when using a non-root ssh user. If it's the same thing, it should be >>> fixed for the 17.2.1 release which is planned to be soon. >>> >>> Thanks, >>> - Adam King >>> >>> On Thu, Jun 23, 2022 at 11:20 AM Robert Reihs <robert.reihs@xxxxxxxxx> >>> wrote: >>> >>>> Hi all, >>>> I am currently trying to setup a test cluster with cephadm on a system >>>> with >>>> ipv6 setup. >>>> In the ceph.conf I have: >>>> ms_bind_ipv4 = false >>>> ms_bind_ipv6 = true >>>> I also have a non standard ssh port set, configured with the ssh-config >>>> settings. >>>> >>>> After bootstrapping the first server I am adding hosts with monitors and >>>> managers the cluster. The first system has mon and mrg running. >>>> >>>> I am getting a permission denied error: >>>> debug 2022-06-23T14:51:41.776+0000 7f1a31ec8700 -1 log_channel(cephadm) >>>> log >>>> [ERR] : executing refresh((['fsn1-ceph-01', 'fsn1-ceph-02', >>>> 'fsn1-ceph-03'],)) failed. >>>> Traceback (most recent call last): >>>> File "/usr/share/ceph/mgr/cephadm/ssh.py", line 221, in >>>> _write_remote_file >>>> await asyncssh.scp(f.name, (conn, tmp_path)) >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in scp >>>> await source.run(srcpath) >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in run >>>> self.handle_error(exc) >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in >>>> handle_error >>>> raise exc from None >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in run >>>> await self._send_files(path, b'') >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in >>>> _send_files >>>> self.handle_error(exc) >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in >>>> handle_error >>>> raise exc from None >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in >>>> _send_files >>>> await self._send_file(srcpath, dstpath, attrs) >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in >>>> _send_file >>>> await self._make_cd_request(b'C', attrs, size, srcpath) >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in >>>> _make_cd_request >>>> self._fs.basename(path)) >>>> File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in >>>> make_request >>>> raise exc >>>> asyncssh.sftp.SFTPFailure: scp: /tmp/etc/ceph/ceph.conf.new: Permission >>>> denied >>>> During handling of the above exception, another exception occurred: >>>> Traceback (most recent call last): >>>> File "/usr/share/ceph/mgr/cephadm/utils.py", line 76, in do_work >>>> return f(*arg) >>>> File "/usr/share/ceph/mgr/cephadm/serve.py", line 265, in refresh >>>> self._write_client_files(client_files, host) >>>> File "/usr/share/ceph/mgr/cephadm/serve.py", line 1052, in >>>> _write_client_files >>>> self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid) >>>> File "/usr/share/ceph/mgr/cephadm/ssh.py", line 238, in >>>> write_remote_file >>>> host, path, content, mode, uid, gid, addr)) >>>> File "/usr/share/ceph/mgr/cephadm/module.py", line 569, in wait_async >>>> return self.event_loop.get_result(coro) >>>> File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result >>>> return asyncio.run_coroutine_threadsafe(coro, self._loop).result() >>>> File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in >>>> result >>>> return self.__get_result() >>>> File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in >>>> __get_result >>>> raise self._exception >>>> File "/usr/share/ceph/mgr/cephadm/ssh.py", line 226, in >>>> _write_remote_file >>>> raise OrchestratorError(msg) >>>> orchestrator._interface.OrchestratorError: Unable to write >>>> fsn1-ceph-01:/etc/ceph/ceph.conf: scp: /tmp/etc/ceph/ceph.conf.new: >>>> Permission denied >>>> >>>> Thanks! >>>> Best >>>> Robert Reihs >>>> _______________________________________________ >>>> ceph-users mailing list -- ceph-users@xxxxxxx >>>> To unsubscribe send an email to ceph-users-leave@xxxxxxx >>>> >>>> >> >> -- >> Robert Reihs >> Jakobsweg 22 >> 8046 Stattegg >> AUSTRIA >> >> mobile: +43 (664) 51 035 90 >> robert.reihs@xxxxxxxxx >> >> TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY >> Biomedizinische Technik - Biomedical Engineering >> > > > -- > Robert Reihs > Jakobsweg 22 > 8046 Stattegg > AUSTRIA > > mobile: +43 (664) 51 035 90 > robert.reihs@xxxxxxxxx > > TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY > Biomedizinische Technik - Biomedical Engineering > -- Robert Reihs Jakobsweg 22 8046 Stattegg AUSTRIA mobile: +43 (664) 51 035 90 robert.reihs@xxxxxxxxx TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY Biomedizinische Technik - Biomedical Engineering _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx