Re: mount failing client to gluster cluster.

Amar Tumballi <atumball@xxxxxxxxxx> · Wed, 9 May 2018 13:50:21 +0530

On Tue, May 8, 2018 at 9:30 AM, Thing <thing.thing@xxxxxxxxx> wrote:
Hi,
On a debian 9 client,

========
root@kvm01:/var/lib/libvirt# dpkg -l glusterfs-client
8><---
ii  glusterfs-client                  3.8.8-1               amd64                 clustered file-system (client package)
root@kvm01:/var/lib/libvirt# 
=======

I am trying to to do a mount to a Centos 7 gluster setup,

=======
[root@glustep1 libvirt]# rpm -q glusterfs
glusterfs-4.0.2-1.el7.x86_64
[root@glustep1 libvirt]# 
=======

mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images /var/lib/libvirt/images

I see that you are trying 'subdir' mount. (as I see '/gv0' was able to mount fine).

If that is the case, please make sure to add a proper 'auth.allow' entry for subdir.

something like 'gluster volume set gv0 auth.allow "/(*),/kvm01/images(*)"

But, while typing above, noticed that subdir mount is enabled by default for every directory if none of the options are given. So, looking deeper, I see below line in your client:

[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8 (args: /usr
/sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz --volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)

and for that version, we didn't had that particular feature.

-Amar

the logs are telling me,
=========
root@kvm01:/var/lib/libvirt# > /var/log/glusterfs/var-lib-libvirt-images.log 
root@kvm01:/var/lib/libvirt# mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images/ /var/lib/libvirt/images
Mount failed. Please check the log file for more details.
root@kvm01:/var/lib/libvirt# more /var/log/glusterfs/var-lib-libvirt-images.log 
[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8 (args: /usr
/sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz --volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)
[2018-05-08 03:33:48.996244] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_getspec_cbk] 0-glusterfs: failed to get the 'volume file' from server
[2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/)
[2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_and_exit] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) [0x7f25cd69ba20]
 -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x494) [0x558e7de496f4] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (0), s
hutting down
[2018-05-08 03:33:48.998923] I [fuse-bridge.c:5794:fini] 0-fuse: Unmounting '/var/lib/libvirt/images'.
[2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f25cc72c494] -->/usr/sbin/gluster
fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (15), shutting down
root@kvm01:/var/lib/libvirt# 
==========

though,

mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos

works fine.

===========
root@kvm01:/var/lib/libvirt# df -h
Filesystem                      Size  Used Avail Use% Mounted on
udev                            7.8G     0  7.8G   0% /dev
tmpfs                           1.6G  9.2M  1.6G   1% /run
/dev/mapper/kvm01--vg-root       23G  3.8G   18G  18% /
tmpfs                           7.8G     0  7.8G   0% /dev/shm
tmpfs                           5.0M  4.0K  5.0M   1% /run/lock
tmpfs                           7.8G     0  7.8G   0% /sys/fs/cgroup
/dev/mapper/kvm01--vg-home      243G   61M  231G   1% /home
/dev/mapper/kvm01--vg-tmp       1.8G  5.6M  1.7G   1% /tmp
/dev/mapper/kvm01--vg-var       9.2G  302M  8.4G   4% /var
/dev/sda1                       236M   63M  161M  28% /boot
tmpfs                           1.6G  4.0K  1.6G   1% /run/user/115
tmpfs                           1.6G     0  1.6G   0% /run/user/1000
glusterp1.graywitch.co.nz:/gv0  932G  247G  685G  27% /isos

also, I can mount the sub-directory fine on the gluster cluster itself,

=======
[root@glustep1 libvirt]# df -h
Filesystem                                     Size  Used Avail Use% Mounted on
/dev/mapper/centos-root                         20G  3.4G   17G  17% /
devtmpfs                                       3.8G     0  3.8G   0% /dev
tmpfs                                          3.8G  6.1M  3.8G   1% /dev/shm
tmpfs                                          3.8G  9.0M  3.8G   1% /run
tmpfs                                          3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/sda1                                      969M  206M  713M  23% /boot
/dev/mapper/centos-tmp                         3.9G   33M  3.9G   1% /tmp
/dev/mapper/centos-home                         50G  4.3G   46G   9% /home
/dev/mapper/centos-var                          20G  341M   20G   2% /var
/dev/mapper/centos-data1                       120G   36M  120G   1% /data1
/dev/mapper/centos00-var_lib                   9.4G  179M  9.2G   2% /var/lib
/dev/mapper/vg--gluster--prod1-gluster--prod1  932G  233G  699G  25% /bricks/brick1
tmpfs                                          771M   12K  771M   1% /run/user/42
tmpfs                                          771M   32K  771M   1% /run/user/1000
glusterp1:gv0/glusterp1/images                 932G  247G  685G  27% /var/lib/libvirt/images
glusterp1:gv0                                  932G  247G  685G  27% /isos
[root@glustep1 libvirt]# 
========

Is this a version mis-match thing? or what am I doing wrongly please?

_______________________________________________

Gluster-users mailing list

Gluster-users@xxxxxxxxxxx

http://lists.gluster.org/mailman/listinfo/gluster-users

-- 
Amar Tumballi (amarts)

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-users