I checked /var/log/messages and see there are page allocation failures. But I don't understand why? The client has 768GB memory and most of it is not used, cluster has 1500OSDs. Do I need to increase vm.min_free_kytes? It is set to 1GB now. Also huge_page is disabled in clients. Thanks, Serkan On Tue, Aug 13, 2019 at 3:42 PM Ilya Dryomov <idryomov@xxxxxxxxx> wrote: > > On Tue, Aug 13, 2019 at 12:36 PM Serkan Çoban <cobanserkan@xxxxxxxxx> wrote: > > > > Hi, > > > > Just installed nautilus 14.2.2 and setup cephfs on it. OS is all centos 7.6. > > From a client I can mount the cephfs with ceph-fuse, but I cannot > > mount with ceph kernel client. > > It gives "mount error 110 connection timeout" and I can see "libceph: > > corrupt full osdmap (-12) epoch 2759 off 656" in /var/log/messages. > > This client is not on same subnet with ceph servers. > > > > However on a client with the same subnet with the servers I can > > successfully mount both with ceph-fuse and kernel client. > > > > Do I need to configure anything for the clients those are in different subnet? > > Is this a kernel issue? > > Hi Serkan, > > It is failing to allocate memory, so the subnet is probably not the > issue. Is there anything else pointing to memory shortage -- "page > allocation failure" splats, etc? > > How much memory is available for use on that node? How many OSDs do > you have in your cluster? > > Thanks, > > Ilya _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |