Re: Persistent FUSE file handles (Was: virtiofs uuid and file handles)

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Sun, Sep 11, 2022 at 01:14:49PM +0300, Amir Goldstein wrote:
> On Wed, Sep 23, 2020 at 10:44 AM Miklos Szeredi <miklos@xxxxxxxxxx> wrote:
> >
> > One proposal was to add  LOOKUP_HANDLE operation that is similar to
> > LOOKUP except it takes a {variable length handle, name} as input and
> > returns a variable length handle *and* a u64 node_id that can be used
> > normally for all other operations.
> >
> > The advantage of such a scheme for virtio-fs (and possibly other fuse
> > based fs) would be that userspace need not keep a refcounted object
> > around until the kernel sends a FORGET, but can prune its node ID
> > based cache at any time.   If that happens and a request from the
> > client (kernel) comes in with a stale node ID, the server will return
> > -ESTALE and the client can ask for a new node ID with a special
> > lookup_handle(fh, NULL).
> >
> > Disadvantages being:
> >
> >  - cost of generating a file handle on all lookups
> >  - cost of storing file handle in kernel icache
> >
> > I don't think either of those are problematic in the virtiofs case.
> > The cost of having to keep fds open while the client has them in its
> > cache is much higher.
> >
> 
> I was thinking of taking a stab at LOOKUP_HANDLE for a generic
> implementation of persistent file handles for FUSE.

Hi Amir,

I was going throug the proposal above for LOOKUP_HANDLE and I was
wondering how nodeid reuse is handled. IOW, if server decides to drop
nodeid from its cache and reuse it for some other file, how will we
differentiate between two. Some sort of generation id encoded in
nodeid?

> 
> The purpose is "proper" NFS export support for FUSE.
> "proper" being survives server restart.

Sounds like a good enhancement. 

> 
> I realize there is an ongoing effort to use file handles in the virtiofsd
> instead of open fds and that LOOKUP_HANDLE could assist in that
> effort, but that is an added benefit.

Using file handles (instead of keeping O_PATH fds open), is now available
in virtriofsd. (option --inode-file-handles). Thanks to Hanna for this
work.

https://gitlab.com/virtio-fs/virtiofsd/-/blob/main/README.md

With LOOKUP_HANDLE implemented, we can afford to implement a mixed
approach where we can keep O_PATH fd open but if there are too many
fds open, then close some of these fds. So this is sort of hybrid
approach between fd and file handles.

> 
> I have a C++ implementation [1] which sort of supports persistent
> file handles, but not in a generic manner.
> 
> If anyone knows of any WIP on LOOKUP_HANDLE please let me know.

I am not aware of any. Will be good if you make it happen upstream :-)

Thanks
Vivek

> 
> Thanks,
> Amir.
> 
> [1] https://github.com/amir73il/libfuse/commits/fuse_passthrough
> 




[Index of Archives]     [Linux Ext4 Filesystem]     [Union Filesystem]     [Filesystem Testing]     [Ceph Users]     [Ecryptfs]     [NTFS 3]     [AutoFS]     [Kernel Newbies]     [Share Photos]     [Security]     [Netfilter]     [Bugtraq]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux Cachefs]     [Reiser Filesystem]     [Linux RAID]     [NTFS 3]     [Samba]     [Device Mapper]     [CEPH Development]

  Powered by Linux