Re: Laptop Losing Connectivity To CephFS On Sleep/Hibernation

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




On 23/03/2024 18:00, Alexander E. Patrakov wrote:
Hi Dulux-Oz,

CephFS is not designed to deal with mobile clients such as laptops
that can lose connectivity at any time. And I am not talking about the
inconveniences on the laptop itself, but about problems that your
laptop would cause to other clients. The problems stem from the fact
that MDSes give out "caps" to clients, which are, essentially,
licenses to do local caching. If another client wants to access the
same file, the MDS would need to contact the laptop and tell it to
release the caps - which is no longer possible. Result: a health
warning and delays/hangs on other clients.

The proper solution here is to use NFSv3 (ideally with a userspace
client instead of a kernel mount). NFSv3, because v4 has leases which
bring the problem back. And this means that you cannot use cephadm to
deploy this NFS server, as cephadm-deployed NFS-Ganesha is hard-coded
to speak only NFSv4.

SAMBA server with oplocks disabled, and, again, a userspace client
could be another solution.

If you decide to disregard this advice, here are some tips.

With systemd, configuring autofs is as easy as adding
"x-systemd.automount,x-systemd.idle-timeout=1min,noauto,nofail,_netdev"
to your /etc/fstab line. This applies both to CephFS and NFS.

For kernel-based NFSv3 mounts, consider adding "nolock".

Another CephFS-specific mount option that somewhat helps with
reconnects is "recover_session=clean".

--
Alexander E. Patrakov
Hi Alex, and thanks for getting back to me so quickly (I really appreciate it),

So from what you said it looks like we've got the wrong solution. Instead, (if I'm understanding things correctly) we may be better off setting up a dedicated Samba server with the CephFS mounts, and then using Samba to share those out - is that right?

Cheers

Dulux-Oz
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux