Curiously what is the umask and directory permission in your case? add a host for the cluster for further try? Eugen Block <eblock@xxxxxx> 于2023年5月9日周二 14:59写道： > Hi, > > I just retried without the single-host option and it worked. Also > everything under /tmp/var belongs to root in my case. Unfortunately, I > can't use the curl-based cephadm but the contents are identical, I > compared. Not sure what it could be at the moment. > > Zitat von Ben <ruidong.gao@xxxxxxxxx>: > > > Hi, It is uos v20(with kernel 4.19), one linux distribution among others. > > no matter since cephadm deploys things in containers by default. cephadm > is > > pulled by curl from Quincy branch of github. > > > > I think you could see some sort of errors if you remove parameter > > --single-host-defaults. > > > > More investigation shows it looks like a bug with cephadm. > > during the deploying procedure > > > ,/tmp/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e.new > > is created through sudo ssh session remotely(with owner of root) and > > /tmp/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/ is changed to > owner > > of ssh user deployer. The correct thing to do instead is, /tmp/var/ be > > changed to the owner deployer recursively so that following scp can have > > access permission. > > I will see if having time to wire up a PR to fix it. > > > > Thanks for help on this. > > Ben > > > > > > Eugen Block <eblock@xxxxxx> 于2023年5月8日周一 21:01写道： > > > >> Hi, > >> > >> could you provide some more details about your host OS? Which cephadm > >> version is it? I was able to bootstrap a one-node cluster with both > >> 17.2.5 and 17.2.6 with a non-root user with no such error on openSUSE > >> Leap 15.4: > >> > >> quincy:~ # rpm -qa | grep cephadm > >> cephadm-17.2.6.248+gad656d572cb-lp154.2.1.noarch > >> > >> deployer@quincy:~> sudo cephadm --image quay.io/ceph/ceph:v17.2.5 > >> bootstrap --mon-ip 172.17.2.3 --skip-monitoring-stack --ssh-user > >> deployer --single-host-defaults > >> Verifying ssh connectivity ... > >> Adding key to deployer@localhost authorized_keys... > >> Verifying podman|docker is present... > >> Verifying lvm2 is present... > >> Verifying time synchronization is in place... > >> Unit chronyd.service is enabled and running > >> Repeating the final host check... > >> podman (/usr/bin/podman) version 4.4.4 is present > >> [...] > >> Ceph version: ceph version 17.2.5 > >> (98318ae89f1a893a6ded3a640405cdbb33e08757) quincy (stable) > >> Extracting ceph user uid/gid from container image... > >> Creating initial keys... > >> Creating initial monmap... > >> Creating mon... > >> Waiting for mon to start... > >> Waiting for mon... > >> mon is available > >> [...] > >> Adding key to deployer@localhost authorized_keys... > >> Adding host quincy... > >> Deploying mon service with default placement... > >> Deploying mgr service with default placement... > >> [...] > >> Bootstrap complete. > >> > >> Zitat von Ben <ruidong.gao@xxxxxxxxx>: > >> > >> > Hi, > >> > > >> > with following command: > >> > > >> > sudo cephadm --docker bootstrap --mon-ip 10.1.32.33 > >> --skip-monitoring-stack > >> > --ssh-user deployer > >> > the user deployer has passwordless sudo configuration. > >> > I can see the error below: > >> > > >> > debug 2023-05-04T12:46:43.268+0000 7fc5ddc2e700 0 [cephadm ERROR > >> > cephadm.ssh] Unable to write > >> > > >> > szhyf-xx1d002-hx15w:/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e: > >> > scp: > >> > > >> > /tmp/var/lib/ceph/ad3a132e-e9ee-11ed-8a19-043f72fb8bf9/cephadm.059bfc99f5cf36ed881f2494b104711faf4cbf5fc86a9594423cc105cafd9b4e.new: > >> > Permission denied > >> > > >> > Traceback (most recent call last): > >> > > >> > File "/usr/share/ceph/mgr/cephadm/ssh.py", line 222, in > >> _write_remote_file > >> > > >> > await asyncssh.scp(f.name, (conn, tmp_path)) > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 922, in > scp > >> > > >> > await source.run(srcpath) > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 458, in > run > >> > > >> > self.handle_error(exc) > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in > >> > handle_error > >> > > >> > raise exc from None > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 456, in > run > >> > > >> > await self._send_files(path, b'') > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 438, in > >> > _send_files > >> > > >> > self.handle_error(exc) > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 307, in > >> > handle_error > >> > > >> > raise exc from None > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 434, in > >> > _send_files > >> > > >> > await self._send_file(srcpath, dstpath, attrs) > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 365, in > >> > _send_file > >> > > >> > await self._make_cd_request(b'C', attrs, size, srcpath) > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 343, in > >> > _make_cd_request > >> > > >> > self._fs.basename(path)) > >> > > >> > File "/lib/python3.6/site-packages/asyncssh/scp.py", line 224, in > >> > make_request > >> > > >> > raise exc > >> > > >> > Any ideas on this? > >> > > >> > Thanks, > >> > Ben > >> > _______________________________________________ > >> > ceph-users mailing list -- ceph-users@xxxxxxx > >> > To unsubscribe send an email to ceph-users-leave@xxxxxxx > >> > >> > >> _______________________________________________ > >> ceph-users mailing list -- ceph-users@xxxxxxx > >> To unsubscribe send an email to ceph-users-leave@xxxxxxx > >> > > > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |