Re: cephadm permission denied when extending cluster

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi, I tested with the 17.2.1 release with a non root ssh user and it worked
fine.
Best
Robert

On Thu, Jun 23, 2022 at 9:12 PM Robert Reihs <robert.reihs@xxxxxxxxx> wrote:

> Thanks for the help, It was the same issue.
>
> Best
> Robert
>
> On Thu, Jun 23, 2022 at 8:37 PM Robert Reihs <robert.reihs@xxxxxxxxx>
> wrote:
>
>> Hi Adam,
>>
>> Yes looks like the same error, I will test it with the root user.
>>
>> Thanks for the quick help.
>> Best
>> Robert
>>
>> On Thu, Jun 23, 2022 at 7:46 PM Adam King <adking@xxxxxxxxxx> wrote:
>>
>>> Hi Robert,
>>>
>>> Do you think this could be https://tracker.ceph.com/issues/54620 (the
>>> traceback looks similar enough I think it likely is)? We had this issue in
>>> 17.2.0 when using a non-root ssh user. If it's the same thing, it should be
>>> fixed for the 17.2.1 release which is planned to be soon.
>>>
>>> Thanks,
>>>   - Adam King
>>>
>>> On Thu, Jun 23, 2022 at 11:20 AM Robert Reihs <robert.reihs@xxxxxxxxx>
>>> wrote:
>>>
>>>> Hi all,
>>>> I am currently trying to setup a test cluster with cephadm on a system
>>>> with
>>>> ipv6 setup.
>>>> In the ceph.conf I have:
>>>>   ms_bind_ipv4 = false
>>>>   ms_bind_ipv6 = true
>>>> I also have a non standard ssh port set, configured with the ssh-config
>>>> settings.
>>>>
>>>> After bootstrapping the first server I am adding hosts with monitors and
>>>> managers the cluster. The first system has mon and mrg running.
>>>>
>>>> I am getting a permission denied error:
>>>> debug 2022-06-23T14:51:41.776+0000 7f1a31ec8700 -1 log_channel(cephadm)
>>>> log
>>>> [ERR] : executing refresh((['fsn1-ceph-01', 'fsn1-ceph-02',
>>>> 'fsn1-ceph-03'],)) failed.
>>>> Traceback (most recent call last):
>>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 221, in
>>>> _write_remote_file
>>>>     await asyncssh.scp(f.name, (conn, tmp_path))
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in scp
>>>>     await source.run(srcpath)
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in run
>>>>     self.handle_error(exc)
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in
>>>> handle_error
>>>>     raise exc from None
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in run
>>>>     await self._send_files(path, b'')
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in
>>>> _send_files
>>>>     self.handle_error(exc)
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in
>>>> handle_error
>>>>     raise exc from None
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in
>>>> _send_files
>>>>     await self._send_file(srcpath, dstpath, attrs)
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in
>>>> _send_file
>>>>     await self._make_cd_request(b'C', attrs, size, srcpath)
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in
>>>> _make_cd_request
>>>>     self._fs.basename(path))
>>>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in
>>>> make_request
>>>>     raise exc
>>>> asyncssh.sftp.SFTPFailure: scp: /tmp/etc/ceph/ceph.conf.new: Permission
>>>> denied
>>>> During handling of the above exception, another exception occurred:
>>>> Traceback (most recent call last):
>>>>   File "/usr/share/ceph/mgr/cephadm/utils.py", line 76, in do_work
>>>>     return f(*arg)
>>>>   File "/usr/share/ceph/mgr/cephadm/serve.py", line 265, in refresh
>>>>     self._write_client_files(client_files, host)
>>>>   File "/usr/share/ceph/mgr/cephadm/serve.py", line 1052, in
>>>> _write_client_files
>>>>     self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid)
>>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 238, in
>>>> write_remote_file
>>>>     host, path, content, mode, uid, gid, addr))
>>>>   File "/usr/share/ceph/mgr/cephadm/module.py", line 569, in wait_async
>>>>     return self.event_loop.get_result(coro)
>>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result
>>>>     return asyncio.run_coroutine_threadsafe(coro, self._loop).result()
>>>>   File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in
>>>> result
>>>>     return self.__get_result()
>>>>   File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in
>>>> __get_result
>>>>     raise self._exception
>>>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 226, in
>>>> _write_remote_file
>>>>     raise OrchestratorError(msg)
>>>> orchestrator._interface.OrchestratorError: Unable to write
>>>> fsn1-ceph-01:/etc/ceph/ceph.conf: scp: /tmp/etc/ceph/ceph.conf.new:
>>>> Permission denied
>>>>
>>>> Thanks!
>>>> Best
>>>> Robert Reihs
>>>> _______________________________________________
>>>> ceph-users mailing list -- ceph-users@xxxxxxx
>>>> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>>>>
>>>>
>>
>> --
>> Robert Reihs
>> Jakobsweg 22
>> 8046 Stattegg
>> AUSTRIA
>>
>> mobile: +43 (664) 51 035 90
>> robert.reihs@xxxxxxxxx
>>
>> TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY
>> Biomedizinische Technik - Biomedical Engineering
>>
>
>
> --
> Robert Reihs
> Jakobsweg 22
> 8046 Stattegg
> AUSTRIA
>
> mobile: +43 (664) 51 035 90
> robert.reihs@xxxxxxxxx
>
> TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY
> Biomedizinische Technik - Biomedical Engineering
>


-- 
Robert Reihs
Jakobsweg 22
8046 Stattegg
AUSTRIA

mobile: +43 (664) 51 035 90
robert.reihs@xxxxxxxxx

TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY
Biomedizinische Technik - Biomedical Engineering
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux