Hi, your welcome. And I learned something new too (if this additional fstab-option is the right way to configure netdev mount via fstab). Switching from oprenrc to systemd is something that will keep me occupied this year, I think. Regards Steffen >>> <knawnd@xxxxxxxxx> schrieb am Donnerstag, 1. Februar 2018 um 13:34: > Steffen, thanks a lot for your prompt replies and trying to help me! I really > appreciate that! > > As for issue I faced with it seems like some of systemd services needs to be > tuned rather than used > out-of-the-box. As far as I understand from the info on the web (e.g. > https://github.com/systemd/systemd/issues/3688) reaching a > network-online.target is not always > enough to get remote FS mounted during the boot since it doesn't always mean > that network at that > time is at a stage when network shares can be mounted. It seems like other > systemd service > (systemd-networkd-wait-online.service? NetworkManager-wait-online.service?) > needs to be tuned properly. > I've found a workaround which works for me and it is to add two more option > in fstab - > "noauto,comment=systemd.automount". So the whole entry in fstab now looks as > below: > 192.168.1.11:6789:/service/cephfsshare /mnt/cephfs ceph > name=mpi,secretfile=/root/ceph.cephfsshare.keyring,noatime,_netdev,noauto,co > mment=systemd.automount 0 0 > > That lets to mount cephfs on boot. > > Thanks again for your replies and questions what directed me to a right way > and let found a workaround! > > Steffen Weißgerber wrote on 01/02/18 13:30: >> Ok, so it seems that all things necessary for mount are configured for >> now but not >> for the moment when the mount is excecuted during boot. >> >> The log messages you pasted do not show the mount attempt. This is only >> an >> error caused by another process that want to use data in /mnt/cephfs. >> >> The mount problem is logged earlier, when all filesystems are mounted >> automatically >> that need a network connection (regarding the _netdev-option). >> >> Is this logged in /varlog/messages too? >> If not is there a rc-logger (don't know how it is called for systemd) >> configured on your >> system that logs to /var/log/rc.log? >> >> Regards >> >> Steffen >> >> >>>>> <knawnd@xxxxxxxxx> schrieb am Donnerstag, 1. Februar 2018 um >> 09:24: >>> Hello, Steffen! >>> >>> Thanks for reply! >>> >>> Please, see my comments inline. >>> >>> Steffen Weißgerber wrote on 01/02/18 11:16: >>>> Hello, >>>> >>>> and what happens when you mount it manually using the fstab entry >> with >>> 'mount /mnt/ceph'? >>> It perfectly mounts cephfs share: >>> >>> $ tail -1 /etc/fstab >>> 192.168.1.11:6789:/service/cephfsshare /mnt/cephfs >> ceph >>> name=mpi,secretfile=/root/ceph.cephfsshare.keyring,noatime,_netdev >> 0 0 >>> >>> $ ls -al /mnt/cephfs >>> total 0 >>> >>> $ mount /mnt/cephfs >>> >>> $ mount|grep -i ceph >>> 192.168.1.11:6789:/service/cephhfsshare on /mnt/cephfs type ceph >>> (rw,noatime,name=mpi,secret=<hidden>,acl,wsize=16777216) >>> >>> $ ls -al /mnt/cephfs >>> <a list of dirs and files on cephfs> >>> >>> /var/log/messages: >>> Feb 1 11:17:44 10-93-221-35 kernel: libceph: mon0 192.168.1.11:6789 >> session >>> established >>> Feb 1 11:17:44 10-93-221-35 kernel: libceph: client353805 fsid >>> 39a08eb8-f289-436e-bbc9-30f449b82650 >>> >>> Best regards >>> >>>> Regards >>>> >>>> Steffen >>>> >>>> >>>>>>> <knawnd@xxxxxxxxx> schrieb am Mittwoch, 31. Januar 2018 um >> 16:19: >>>>> Hello! >>>>> >>>>> I need to mount automatically cephfs on KVM VM boot . >>>>> >>>>> I tried to follow recommendations mentioned at >>>>> http://docs.ceph.com/docs/master/cephfs/fstab/ but in >>>>> both cases (kernel mode or fuse) as well as by specifying mounting >> command >>>>> in /etc/rc.local it >>>>> always fails to get mounted cephfs share on VM boot. There are >> lines i n >>>>> /var/log/messages like below: >>>>> ....... >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Reached target Remote File >> Systems >>> (Pre). >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Starting Remote File Systems >> (Pre). >>>>> Jan 31 17:56:54 10-93-221-35 systemd: MESSAGE=Failed to check >> directory >>>>> /mnt/cephfs: No such file or >>>>> directory >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Mounting /mnt/cephfs... >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Started OpenSSH server >> daemon. >>>>> Jan 31 17:56:54 10-93-221-35 kernel: FS-Cache: Loaded >>>>> Jan 31 17:56:54 10-93-221-35 htcondor: Not changing GLOBAL_MAX_FDS >>>>> (/proc/sys/fs/file-max): new >>>>> value (32768) <= old value (400704). >>>>> Jan 31 17:56:54 10-93-221-35 kernel: Key type ceph registered >>>>> Jan 31 17:56:54 10-93-221-35 kernel: libceph: loaded (mon/osd proto >> 15/24) >>>>> Jan 31 17:56:54 10-93-221-35 mount: mount error 2 = No such file or >> >>> directory >>>>> Jan 31 17:56:54 10-93-221-35 systemd: mnt-cephfsshare.mount mount >> process >>>>> exited, code=exited status=2 >>>>> Jan 31 17:56:54 10-93-221-35 kernel: FS-Cache: Netfs 'ceph' >> registered for >>>>> caching >>>>> Jan 31 17:56:54 10-93-221-35 kernel: ceph: loaded (mds proto 32) >>>>> Jan 31 17:56:54 10-93-221-35 systemd-vconsole-setup: >> /usr/bin/setfont failed >>> with >>>>> error code 71. >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Failed to mount /mnt/cephfs. >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Dependency failed for Remote >> File >>>>> Systems. >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Job remote-fs.target/start >> failed with >>>>> result 'dependency'. >>>>> Jan 31 17:56:54 10-93-221-35 systemd: Unit mnt-cephfsshare.mount >> entered >>> failed >>>>> state. >>>>> >>>>> ..... or in case of fuse .... >>>>> >>>>> Jan 31 17:42:18 10-93-221-35 rc.local: fuse: bad mount point >> `/ >> mnt/cephfs/': >>> No >>>>> such file or directory >>>>> Jan 31 17:42:18 10-93-221-35 rc.local: 2018-01-31 17:42:18.056464 >>> 7ff0f09b3040 -1 >>>>> fuse_parse_cmdline >>>>> failed. >>>>> Jan 31 17:42:18 10-93-221-35 rc.local: ceph-fuse[1043]: fuse failed >> to >>>>> initialize >>>>> Jan 31 17:42:18 10-93-221-35 systemd: Started /etc/rc.d/rc.local >>> Compatibility. >>>>> >>>>> >>>>> But /mnt/cephfs dir exists on the host: >>>>> $ ls -al /mnt/ >>>>> total 4 >>>>> drwxr-xr-x. 2 root root 4096 Nov 15 16:12 cephfs >>>>> >>>>> I tried various entries in /etc/fstab: >>>>> #none /mnt/cephfs >>>>> fuse.ceph >>>>> >> ceph.id=cephfsshare,ceph.conf=/etc/ceph/ceph.conf,ceph.client_mountpoint=/se >>>>> rvice/cephfsshare,_netdev,defaults >>>>> 0 0 >>>>> >>>>> >> #192.168.1.11:6789,192.168.1.12:6789,192.168.1.13:6789:/service/cephfsshare >>>>> /mnt/cephfs >>>>> ceph >>>>> >> name=cephfsshare,secretfile=/root/ceph.cephfsshare.keyring,noatime,_netdev >>>>> 0 0 >>>>> >>>>> 192.168.1.11:6789:/service/cephfsshare /mnt/cephfs >> ceph >>>>> >> name=cephfsshare,secretfile=/root/ceph.cephfsshare.keyring,noatime,_netdev >>>>> 0 0 >>>>> >>>>> In all cases I was able successfully mount cephfs share manually as >> soon as >>>>> VM booted. >>>>> >>>>> On the cephfs client with CentOS 7 x64 I have >>>>> >>>>> $ rpm -qa|grep -i ceph >>>>> ceph-fuse-12.2.2-0.el7.x86_64 >>>>> ceph-release-1-1.el7.noarch >>>>> libcephfs2-12.2.2-0.el7.x86_64 >>>>> python-cephfs-12.2.2-0.el7.x86_64 >>>>> ceph-common-12.2.2-0.el7.x86_64 >>>>> >>>>> $ uname -r >>>>> 4.15.0-1.el7.elrepo.x86_64 >>>>> >>>>> Ceph release is Luminous (12.2.2). >>>>> >>>>> I would appreciate any help on that issue. >>>>> _______________________________________________ >>>>> ceph-users mailing list >>>>> ceph-users@xxxxxxxxxxxxxx >>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>> >>>> >> -- Klinik-Service Neubrandenburg GmbH Allendestr. 30, 17036 Neubrandenburg Amtsgericht Neubrandenburg, HRB 2457 Geschaeftsfuehrerin: Gudrun Kappich _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |