-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
I've been testing below options out, but I still have the same problem
that files are not visible on different clients. After a "touch" of a
new file (or directory) all files are visible again. It definitly
looks like a directory cache problem.
Client mount options like "noac" or "actimeo=0" solved it for some,
but after a while the clients ran into the same problem again. I'm a
bit at a loss here, so hopefully someone can shed some more light on
this annoying problem.
It seems when I restart the NFS-server, the problem disappears for a
while. After a week or so, the problem resurfaced.
I've used the following options for the NFS-Ganesha config:
NFSv4
{
DomainName = "<<domain>>";
IdmapConf = "/etc/idmapd.conf";
}
NFS_KRB5
{
Active_krb5 = false;
}
NFS_DupReq_Hash
{
Index_Size = 17 ;
Alphabet_Length = 10 ;
}
NFSv4_ClientId_Cache
{
Index_Size = 17 ;
Alphabet_Length = 10 ;
}
CEPH
{
}
CacheInode_Client
{
Entry_Prealloc_PoolSize = 1000 ;
Attr_Expiration_Time = Immediate ;
Symlink_Expiration_Time = Immediate ;
Directory_Expiration_Time = Immediate ;
Use_Test_Access = 1 ;
}
CacheInode
{
Attr_Expiration_Time = 0 ;
Use_Getattr_Directory_Invalidation = true;
}
EXPORT_DEFAULTS
{
Disable_ACL = FALSE;
SecType = "sys";
Protocols = "4";
Transports = "TCP";
Manage_Gids = TRUE;
}
EXPORT
{
Export_ID=1;
FSAL {
Name = Ceph;
}
Path = "/DATA/SHARE";
Pseudo = "/DATA";
Tag = "DATA";
CLIENT {
Clients = 172.17.0.0/16;
Access_Type = RW;
Squash = Root;
}
}
With regards,
On 10/28/2015 05:37 PM, Lincoln Bryant wrote:
> Hi Dennis,
>
> We're using NFS Ganesha here as well. I can send you my
> configuration which is working but we squash users and groups down
> to a particular uid/gid, so it may not be super helpful for you.
>
> I think files not being immediately visible is working as intended,
> due to directory caching. I _believe_ what you need to do is set
> the following (comments shamelessly stolen from the Gluster FSAL):
> # If thuis flag is set to yes, a getattr is performed each time a
> readdir is done # if mtime do not match, the directory is renewed.
> This will make the cache more # synchronous to the FSAL, but will
> strongly decrease the directory cache performance
> Use_Getattr_Directory_Invalidation = true;
>
> Hope that helps.
>
> Thanks, Lincoln
>
>> On Oct 28, 2015, at 9:08 AM, Dennis Kramer (DT)
>> <dennis@xxxxxxxxx> wrote:
>>
> Sorry for raising this topic from the dead, but i'm having the
> same issues with NFS-GANESHA /w the wrong user/group information.
>
> Do you maybe have a working ganesha.conf? I'm assuming I might
> mis-configured something in this file. It's also nice to have some
> reference config file from a working FSAL CEPH, the sample config
> is very minimalistic.
>
> I also have another issue with files that are not immediately
> visible in a NFS folder after another system (using the same NFS)
> has created it. There seems to be a slight delay before all system
> have the same directory listing. This can be enforced by creating a
> *new* file in this directory which will cause a refresh on this
> folder. Changing directories also helps on affected system(s).
>
> On 07/28/2015 11:30 AM, Haomai Wang wrote:
>>>> On Tue, Jul 28, 2015 at 5:28 PM, Burkhard Linke
>>>> <Burkhard.Linke@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx> wrote:
>>>>> Hi,
>>>>>
>>>>> On 07/28/2015 11:08 AM, Haomai Wang wrote:
>>>>>>
>>>>>> On Tue, Jul 28, 2015 at 4:47 PM, Gregory Farnum
>>>>>> <greg@xxxxxxxxxxx> wrote:
>>>>>>>
>>>>>>> On Tue, Jul 28, 2015 at 8:01 AM, Burkhard Linke
>>>>>>> <Burkhard.Linke@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>
>>>>>>> wrote:
>>>>>
>>>>>
>>>>> *snipsnap*
>>>>>>>>
>>>>>>>> Can you give some details on that issues? I'm
>>>>>>>> currently looking for a way to provide NFS based
>>>>>>>> access to CephFS to our desktop machines.
>>>>>>>
>>>>>>> Ummm...sadly I can't; we don't appear to have any
>>>>>>> tracker tickets and I'm not sure where the report went
>>>>>>> to. :( I think it was from Haomai...
>>>>>>
>>>>>> My fault, I should report this to ticket.
>>>>>>
>>>>>> I have forgotten the details about the problem, I submit
>>>>>> the infos to IRC :-(
>>>>>>
>>>>>> It related to the "ls" output. It will print the wrong
>>>>>> user/group owner as "-1", maybe related to root squash?
>>>>>
>>>>> Are you sure this problem is related to the CephFS FSAL? I
>>>>> also had a hard time setting up ganesha correctly,
>>>>> especially with respect to user and group mappings,
>>>>> especially with a kerberized setup.
>>>>>
>>>>> I'm currently running a small test setup with one server
>>>>> and one client to single out the last kerberos related
>>>>> problems (nfs-ganesha 2.2.0 / Ceph Hammer 0.94.2 / Ubuntu
>>>>> 14.04). User/group listings have been OK so far. Do you
>>>>> remember whether the problem occurs every time or just
>>>>> arbitrarily?
>>>>>
>>>>
>>>> Great!
>>>>
>>>> I'm not sure the reason. I guess it may related to
>>>> nfs-ganesha version or client distro version.
>>>>
>>>>> Best regards, Burkhard
>>>>> _______________________________________________ ceph-users
>>>>> mailing list ceph-users@xxxxxxxxxxxxxx
>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>>
>>>>
>>>>
>> _______________________________________________ ceph-users
>> mailing list ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)
iEYEARECAAYFAlZdaIkACgkQiJDTKUBxIRv+1QCfesralFLyU8H+4Oztz2fxIojE
VSYAoMdVf7HIZokWvJ3yaT5BBOH47Ur1
=fUH+
-----END PGP SIGNATURE-----
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
