Re: cephadm permission denied when extending cluster

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Adam,

Yes looks like the same error, I will test it with the root user.

Thanks for the quick help.
Best
Robert

On Thu, Jun 23, 2022 at 7:46 PM Adam King <adking@xxxxxxxxxx> wrote:

> Hi Robert,
>
> Do you think this could be https://tracker.ceph.com/issues/54620 (the
> traceback looks similar enough I think it likely is)? We had this issue in
> 17.2.0 when using a non-root ssh user. If it's the same thing, it should be
> fixed for the 17.2.1 release which is planned to be soon.
>
> Thanks,
>   - Adam King
>
> On Thu, Jun 23, 2022 at 11:20 AM Robert Reihs <robert.reihs@xxxxxxxxx>
> wrote:
>
>> Hi all,
>> I am currently trying to setup a test cluster with cephadm on a system
>> with
>> ipv6 setup.
>> In the ceph.conf I have:
>>   ms_bind_ipv4 = false
>>   ms_bind_ipv6 = true
>> I also have a non standard ssh port set, configured with the ssh-config
>> settings.
>>
>> After bootstrapping the first server I am adding hosts with monitors and
>> managers the cluster. The first system has mon and mrg running.
>>
>> I am getting a permission denied error:
>> debug 2022-06-23T14:51:41.776+0000 7f1a31ec8700 -1 log_channel(cephadm)
>> log
>> [ERR] : executing refresh((['fsn1-ceph-01', 'fsn1-ceph-02',
>> 'fsn1-ceph-03'],)) failed.
>> Traceback (most recent call last):
>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 221, in
>> _write_remote_file
>>     await asyncssh.scp(f.name, (conn, tmp_path))
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in scp
>>     await source.run(srcpath)
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in run
>>     self.handle_error(exc)
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in
>> handle_error
>>     raise exc from None
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in run
>>     await self._send_files(path, b'')
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in
>> _send_files
>>     self.handle_error(exc)
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in
>> handle_error
>>     raise exc from None
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in
>> _send_files
>>     await self._send_file(srcpath, dstpath, attrs)
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in
>> _send_file
>>     await self._make_cd_request(b'C', attrs, size, srcpath)
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in
>> _make_cd_request
>>     self._fs.basename(path))
>>   File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in
>> make_request
>>     raise exc
>> asyncssh.sftp.SFTPFailure: scp: /tmp/etc/ceph/ceph.conf.new: Permission
>> denied
>> During handling of the above exception, another exception occurred:
>> Traceback (most recent call last):
>>   File "/usr/share/ceph/mgr/cephadm/utils.py", line 76, in do_work
>>     return f(*arg)
>>   File "/usr/share/ceph/mgr/cephadm/serve.py", line 265, in refresh
>>     self._write_client_files(client_files, host)
>>   File "/usr/share/ceph/mgr/cephadm/serve.py", line 1052, in
>> _write_client_files
>>     self.mgr.ssh.write_remote_file(host, path, content, mode, uid, gid)
>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 238, in
>> write_remote_file
>>     host, path, content, mode, uid, gid, addr))
>>   File "/usr/share/ceph/mgr/cephadm/module.py", line 569, in wait_async
>>     return self.event_loop.get_result(coro)
>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 48, in get_result
>>     return asyncio.run_coroutine_threadsafe(coro, self._loop).result()
>>   File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result
>>     return self.__get_result()
>>   File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in
>> __get_result
>>     raise self._exception
>>   File "/usr/share/ceph/mgr/cephadm/ssh.py", line 226, in
>> _write_remote_file
>>     raise OrchestratorError(msg)
>> orchestrator._interface.OrchestratorError: Unable to write
>> fsn1-ceph-01:/etc/ceph/ceph.conf: scp: /tmp/etc/ceph/ceph.conf.new:
>> Permission denied
>>
>> Thanks!
>> Best
>> Robert Reihs
>> _______________________________________________
>> ceph-users mailing list -- ceph-users@xxxxxxx
>> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>>
>>

-- 
Robert Reihs
Jakobsweg 22
8046 Stattegg
AUSTRIA

mobile: +43 (664) 51 035 90
robert.reihs@xxxxxxxxx

TECHNISCHE UNIVERSITÄT GRAZ - GRAZ UNIVERSITY OF TECHNOLOGY
Biomedizinische Technik - Biomedical Engineering
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux