Re: cephadm permission denied when extending cluster

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks for the help, It was the same issue.

Best
Robert

On Thu, Jun 23, 2022 at 8:37 PM Robert Reihs <robert.reihs@xxxxxxxxx> wrote:

> Hi Adam,
>
> Yes looks like the same error, I will test it with the root user.
>
> Thanks for the quick help.
> Best
> Robert
>
> On Thu, Jun 23, 2022 at 7:46 PM Adam King <adking@xxxxxxxxxx> wrote:
>
>> Hi Robert,
>>
>> Do you think this could be https://tracker.ceph.com/issues/54620 (the
>> traceback looks similar enough I think it likely is)? We had this issue in
>> 17.2.0 when using a non-root ssh user. If it's the same thing, it should be
>> fixed for the 17.2.1 release which is planned to be soon.
>>
>> Thanks,
>>   - Adam King
>>
>> On Thu, Jun 23, 2022 at 11:20 AM Robert Reihs <robert.reihs@xxxxxxxxx>
>> wrote:
>>
>>> Hi all,
>>> I am currently trying to setup a test cluster with cephadm on a system
>>> with
>>> ipv6 setup.
>>> In the ceph.conf I have:
>>>   ms_bind_ipv4 = false
>>>   ms_bind_ipv6 = true
>>> I also have a non standard ssh port set, configured with the ssh-config
>>> settings.
>>>
>>> After bootstrapping the first server I am adding hosts with monitors and
>>> managers the cluster. The first system has mon and mrg running.
>>>
>>> I am getting a permission denied error:
>>> debug 2022-06-23T14:51:41.776+0000 7f1a31ec8700 -1 log_channel(cephadm)
>>> log
>>> [ERR] : executing refresh((['fsn1-ceph-01', 'fsn1-ceph-02',
>>> 'fsn1-ceph-03'],)) failed.
>>> Traceback (most recent call last):
>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 221, in
>>> _write_remote_file
>>>     await asyncssh.scp(f.name, (conn, tmp_path))
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in scp
>>>     await source.run(srcpath)
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in run
>>>     self.handle_error(exc)
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in
>>> handle_error
>>>     raise exc from None
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in run
>>>     await self._send_files(path, b'')
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in
>>> _send_files
>>>     self.handle_error(exc)
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in
>>> handle_error
>>>     raise exc from None
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in
>>> _send_files
>>>     await self._send_file(srcpath, dstpath, attrs)
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in
>>> _send_file
>>>     await self._make_cd_request(b'C', attrs, size, srcpath)
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in
>>> _make_cd_request
>>>     self._fs.basename(path))
>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in
>>> make_request
>>>     raise exc
>>> asyncssh.sftp.SFTPFailure: scp: /tmp/etc/ceph/ceph.conf.new: Permission
>>> denied
>>> During handling of the above exception, another exception occurred:
>>> Traceback (most recent call last):
>>>   File "/usr/share/ceph/mgr/cephadm/utils.py", line 76, in do_work
>>>     return f(*arg)
>>>   File "/usr/share/ceph/mgr/cephadm/serve.py", line 265, in refresh
>>>     self._write_client_files(client_files, host)
>>>   File "/usr/share/ceph/mgr/cephadm/serve.py", line 1052, in
>>> _write_client_files
>>>     self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid)
>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 238, in
>>> write_remote_file
>>>     host, path, content, mode, uid, gid, addr))
>>>   File "/usr/share/ceph/mgr/cephadm/module.py", line 569, in wait_async
>>>     return self.event_loop.get_result(coro)
>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result
>>>     return asyncio.run_coroutine_threadsafe(coro, self._loop).result()
>>>   File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in
>>> result
>>>     return self.__get_result()
>>>   File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in
>>> __get_result
>>>     raise self._exception
>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 226, in
>>> _write_remote_file
>>>     raise OrchestratorError(msg)
>>> orchestrator._interface.OrchestratorError: Unable to write
>>> fsn1-ceph-01:/etc/ceph/ceph.conf: scp: /tmp/etc/ceph/ceph.conf.new:
>>> Permission denied
>>>
>>> Thanks!
>>> Best
>>> Robert Reihs
>>> _______________________________________________
>>> ceph-users mailing list -- ceph-users@xxxxxxx
>>> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>>>
>>>
>
> --
> Robert Reihs
> Jakobsweg 22
> 8046 Stattegg
> AUSTRIA
>
> mobile: +43 (664) 51 035 90
> robert.reihs@xxxxxxxxx
>
> TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY
> Biomedizinische Technik - Biomedical Engineering
>


-- 
Robert Reihs
Jakobsweg 22
8046 Stattegg
AUSTRIA

mobile: +43 (664) 51 035 90
robert.reihs@xxxxxxxxx

TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY
Biomedizinische Technik - Biomedical Engineering
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux