Sorry, I misunderstood that command.
Here is it:
# rpm -qil glusterfs-server
Name : glusterfs-server
Version : 3.8.5
Release : 1.el7
Architecture: x86_64
Install Date: Thu 17 Nov 2016 07:23:22 PM EET
Group : System Environment/Daemons
Size : 4776600
License : GPLv2 or LGPLv3+
Signature : RSA/SHA1, Wed 26 Oct 2016 04:27:02 PM EEST, Key ID d4a2e50be451e5b5
Source RPM : glusterfs-3.8.5-1.el7.src.rpm
Build Date : Thu 13 Oct 2016 04:28:18 PM EEST
Build Host : c1bd.rdu2.centos.org
Relocations : (not relocatable)
Packager : CBS <cbs@xxxxxxxxxx>
Vendor : Fedora Project
Summary : Clustered file-system server
Description :
GlusterFS is a distributed file-system capable of scaling to several
petabytes. It aggregates various storage bricks over Infiniband RDMA
or TCP/IP interconnect into one large parallel network file
system. GlusterFS is one of the most sophisticated file systems in
terms of features and extensibility. It borrows a powerful concept
called Translators from GNU Hurd kernel. Much of the code in GlusterFS
is in user space and easily manageable.
This package provides the glusterfs server daemon.
/etc/glusterfs
/etc/glusterfs/gluster-rsyslog-5.8.conf
/etc/glusterfs/gluster-rsyslog-7.2.conf
/etc/glusterfs/glusterd.vol
/etc/glusterfs/glusterfs-georep-logrotate
/etc/glusterfs/glusterfs-logrotate
/etc/glusterfs/group-virt.example
/etc/glusterfs/logger.conf.example
/etc/sysconfig/glusterd
/etc/sysconfig/glusterfsd
/usr/bin/glusterfind
/usr/lib/firewalld/services/glusterfs.xml
/usr/lib/systemd/system/glusterd.service
/usr/lib/systemd/system/glusterfsd.service
/usr/lib64/glusterfs/3.8.5/xlator/cluster/pump.so
/usr/lib64/glusterfs/3.8.5/xlator/features/arbiter.so
/usr/lib64/glusterfs/3.8.5/xlator/features/bit-rot.so
/usr/lib64/glusterfs/3.8.5/xlator/features/bitrot-stub.so
/usr/lib64/glusterfs/3.8.5/xlator/features/changetimerecorder.so
/usr/lib64/glusterfs/3.8.5/xlator/features/index.so
/usr/lib64/glusterfs/3.8.5/xlator/features/leases.so
/usr/lib64/glusterfs/3.8.5/xlator/features/locks.so
/usr/lib64/glusterfs/3.8.5/xlator/features/marker.so
/usr/lib64/glusterfs/3.8.5/xlator/features/posix-locks.so
/usr/lib64/glusterfs/3.8.5/xlator/features/quota.so
/usr/lib64/glusterfs/3.8.5/xlator/features/quotad.so
/usr/lib64/glusterfs/3.8.5/xlator/features/snapview-server.so
/usr/lib64/glusterfs/3.8.5/xlator/features/trash.so
/usr/lib64/glusterfs/3.8.5/xlator/features/upcall.so
/usr/lib64/glusterfs/3.8.5/xlator/mgmt
/usr/lib64/glusterfs/3.8.5/xlator/mgmt/glusterd.so
/usr/lib64/glusterfs/3.8.5/xlator/nfs
/usr/lib64/glusterfs/3.8.5/xlator/nfs/server.so
/usr/lib64/glusterfs/3.8.5/xlator/performance/decompounder.so
/usr/lib64/glusterfs/3.8.5/xlator/protocol/server.so
/usr/lib64/glusterfs/3.8.5/xlator/storage
/usr/lib64/glusterfs/3.8.5/xlator/storage/bd.so
/usr/lib64/glusterfs/3.8.5/xlator/storage/posix.so
/usr/lib64/libgfdb.so.0
/usr/lib64/libgfdb.so.0.0.1
/usr/libexec/glusterfs/glusterfind
/usr/libexec/glusterfs/glusterfind/S57glusterfind-delete-post.py
/usr/libexec/glusterfs/glusterfind/S57glusterfind-delete-post.pyc
/usr/libexec/glusterfs/glusterfind/S57glusterfind-delete-post.pyo
/usr/libexec/glusterfs/glusterfind/__init__.py
/usr/libexec/glusterfs/glusterfind/__init__.pyc
/usr/libexec/glusterfs/glusterfind/__init__.pyo
/usr/libexec/glusterfs/glusterfind/brickfind.py
/usr/libexec/glusterfs/glusterfind/brickfind.pyc
/usr/libexec/glusterfs/glusterfind/brickfind.pyo
/usr/libexec/glusterfs/glusterfind/changelog.py
/usr/libexec/glusterfs/glusterfind/changelog.pyc
/usr/libexec/glusterfs/glusterfind/changelog.pyo
/usr/libexec/glusterfs/glusterfind/changelogdata.py
/usr/libexec/glusterfs/glusterfind/changelogdata.pyc
/usr/libexec/glusterfs/glusterfind/changelogdata.pyo
/usr/libexec/glusterfs/glusterfind/conf.py
/usr/libexec/glusterfs/glusterfind/conf.pyc
/usr/libexec/glusterfs/glusterfind/conf.pyo
/usr/libexec/glusterfs/glusterfind/libgfchangelog.py
/usr/libexec/glusterfs/glusterfind/libgfchangelog.pyc
/usr/libexec/glusterfs/glusterfind/libgfchangelog.pyo
/usr/libexec/glusterfs/glusterfind/main.py
/usr/libexec/glusterfs/glusterfind/main.pyc
/usr/libexec/glusterfs/glusterfind/main.pyo
/usr/libexec/glusterfs/glusterfind/nodeagent.py
/usr/libexec/glusterfs/glusterfind/nodeagent.pyc
/usr/libexec/glusterfs/glusterfind/nodeagent.pyo
/usr/libexec/glusterfs/glusterfind/tool.conf
/usr/libexec/glusterfs/glusterfind/utils.py
/usr/libexec/glusterfs/glusterfind/utils.pyc
/usr/libexec/glusterfs/glusterfind/utils.pyo
/usr/libexec/glusterfs/peer_add_secret_pub
/usr/sbin/gcron.py
/usr/sbin/glfsheal
/usr/sbin/glusterd
/usr/sbin/snap_scheduler.py
/usr/share/doc/glusterfs-server-3.8.5
/usr/share/doc/glusterfs-server-3.8.5/clear_xattrs.sh
/usr/share/glusterfs/scripts/stop-all-gluster-processes.sh
/var/lib/glusterd
/var/lib/glusterd/bitd
/var/lib/glusterd/glusterd.info
/var/lib/glusterd/glusterfind
/var/lib/glusterd/glusterfind/.keys
/var/lib/glusterd/glustershd
/var/lib/glusterd/groups
/var/lib/glusterd/groups/virt
/var/lib/glusterd/hooks
/var/lib/glusterd/hooks/1
/var/lib/glusterd/hooks/1/add-brick
/var/lib/glusterd/hooks/1/add-brick/post
/var/lib/glusterd/hooks/1/add-brick/post/disabled-quota-root-xattr-heal.sh
/var/lib/glusterd/hooks/1/add-brick/pre
/var/lib/glusterd/hooks/1/add-brick/pre/S28Quota-enable-root-xattr-heal.sh
/var/lib/glusterd/hooks/1/copy-file
/var/lib/glusterd/hooks/1/copy-file/post
/var/lib/glusterd/hooks/1/copy-file/pre
/var/lib/glusterd/hooks/1/create
/var/lib/glusterd/hooks/1/create/post
/var/lib/glusterd/hooks/1/create/pre
/var/lib/glusterd/hooks/1/delete
/var/lib/glusterd/hooks/1/delete/post
/var/lib/glusterd/hooks/1/delete/post/S57glusterfind-delete-post
/var/lib/glusterd/hooks/1/delete/pre
/var/lib/glusterd/hooks/1/remove-brick
/var/lib/glusterd/hooks/1/remove-brick/post
/var/lib/glusterd/hooks/1/remove-brick/pre
/var/lib/glusterd/hooks/1/reset
/var/lib/glusterd/hooks/1/reset/post
/var/lib/glusterd/hooks/1/reset/pre
/var/lib/glusterd/hooks/1/set
/var/lib/glusterd/hooks/1/set/post
/var/lib/glusterd/hooks/1/set/post/S30samba-set.sh
/var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh
/var/lib/glusterd/hooks/1/set/pre
/var/lib/glusterd/hooks/1/start
/var/lib/glusterd/hooks/1/start/post
/var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh
/var/lib/glusterd/hooks/1/start/post/S30samba-start.sh
/var/lib/glusterd/hooks/1/start/pre
/var/lib/glusterd/hooks/1/stop
/var/lib/glusterd/hooks/1/stop/post
/var/lib/glusterd/hooks/1/stop/pre
/var/lib/glusterd/hooks/1/stop/pre/S29CTDB-teardown.sh
/var/lib/glusterd/hooks/1/stop/pre/S30samba-stop.sh
/var/lib/glusterd/nfs
/var/lib/glusterd/nfs/nfs-server.vol
/var/lib/glusterd/nfs/run
/var/lib/glusterd/nfs/run/nfs.pid
/var/lib/glusterd/options
/var/lib/glusterd/peers
/var/lib/glusterd/quotad
/var/lib/glusterd/scrub
/var/lib/glusterd/snaps
/var/lib/glusterd/ss_brick
/var/lib/glusterd/vols
On Mon, Nov 21, 2016 at 12:10 PM, Alexandr Porunov <alexandr.porunov@xxxxxxxxx> wrote:
I don't have volumes named "gluster_shared_storage".Here is what I have:# gluster volume status gluster_shared_storageVolume gluster_shared_storage does not existI added that script "/var/lib/glusterd/hooks/1/set/post/S32gluster_enable_ shared_storage.sh" Then I run next commands:# systemctl restart glusterd# gluster volume set all cluster.enable-shared-storage disable# gluster volume set all cluster.enable-shared-storage enableAfter several minutes I tried to check if the volume is exists but it still doesn't:# gluster volume status gluster_shared_storageVolume gluster_shared_storage does not existI have check next log file: "/var/log/glusterfs/run-gluster-shared_storage.log" and it is empty. Then I checked next log file "/var/log/glusterfs/etc-glusterfs-glusterd.vol.log" it has the next content: [2016-11-21 10:01:58.847473] I [MSGID: 106499] [glusterd-handler.c:4349:__glusterd_handle_status_volume] 0-management: Received status volume req for volume gluster_shared_storage [2016-11-21 10:01:58.850019] E [MSGID: 106525] [glusterd-op-sm.c:3914:glusterd_dict_set_volid] 0-management: Volume gluster_shared_storage does not exist [2016-11-21 10:01:58.850058] E [MSGID: 106289] [glusterd-syncop.c:1894:gd_sync_task_begin] 0-management: Failed to build payload for operation 'Volume Status' I am not sure how to check rpm file because I have installed glusterfs with "yum install glusterfs-server".Do you know how to get rpm with yum?Sincerely,AlexandrOn Mon, Nov 21, 2016 at 9:02 AM, Jiffin Tony Thottan <jthottan@xxxxxxxxxx> wrote:
On 21/11/16 11:13, Alexandr Porunov wrote:
Version of glusterfs is 3.8.5
Here what I have installed:yum install centos-release-glusteryum install glusterfs-server
It should be part of glusterfs-server. So can u check files provided by this, run rpm -qil <full name of glusterfs-server rpm>
yum install glusterfs-geo-replication
Unfortunately it doesn't work if I just add the script "/var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared _storage.sh" and restart "glusterd".
I didn't get that, when u rerun gluster v set all cluster.enable-shared-storage enable should work (I guess even glusterd restart is not required)
Or do u have any volumes named "gluster_shared_storage", if yes please remove it and rerun the cli.
--
Jiffin
It seems that I have to install something else..
Sincerely,Alexandr
On Mon, Nov 21, 2016 at 6:58 AM, Jiffin Tony Thottan <jthottan@xxxxxxxxxx> wrote:
On 21/11/16 01:07, Alexandr Porunov wrote:
I have installed it from rpm. No that file isn't there. The folder "/var/lib/glusterd/hooks/1/set/post/" is empty..
which gluster version and what all gluster rpms have u installed?
For time being just download this file[1] and copy to above location and rerun the same cli.
[1] https://github.com/gluster/glusterfs/blob/master/extras/hook -scripts/set/post/S32gluster_e nable_shared_storage.sh
--
Jiffin
Sincerely,Alexandr
On Sun, Nov 20, 2016 at 2:55 PM, Jiffin Tony Thottan <jthottan@xxxxxxxxxx> wrote:
Did u install rpm or directly from sources. Can u check whether following script is present?
/var/lib/glusterd/hooks/1/set/
post/S32gluster_enable_shared_ storage.sh
--
Jiffin
On 20/11/16 13:33, Alexandr Porunov wrote:
To enable shared storage I used next command:# gluster volume set all cluster.enable-shared-storage enable
But it seems that it doesn't create gluster_shared_storage automatically.
# gluster volume status gluster_shared_storageVolume gluster_shared_storage does not exist
Do I need to manually create a volume "gluster_shared_storage"? Do I need to manually create a folder "/var/run/gluster/shared_storage"? Do I need to manually mount it? Or something I don't need to do?
If I use 6 cluster nodes and I need to have a shared storage on all of them then how to create a shared storage?It says that it have to be with replication 2 or replication 3. But if we use shared storage on all of 6 nodes then we have only 2 ways to create a volume:1. Use replication 62. Use replication 3 with distribution.
Which way I need to use?
Sincerely,Alexandr
On Sun, Nov 20, 2016 at 9:07 AM, Jiffin Tony Thottan <jthottan@xxxxxxxxxx> wrote:
On 19/11/16 21:47, Alexandr Porunov wrote:
Unfortunately I haven't this log file but I have 'run-gluster-shared_storage.log' and it has errors I don't know why.
Here is the content of the 'run-gluster-shared_storage.log':
Make sure shared storage is up and running using "gluster volume status gluster_shared_storage"
May be the issue is related to firewalld or iptables. Try it after disabling them.
--
Jiffin
[2016-11-19 10:37:01.581737] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5 (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1 --volfile-id=gluster_shared_storage /run/gluster/shared_storage) [2016-11-19 10:37:01.641836] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-11-19 10:37:01.642311] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs: failed to get the 'volume file' from server [2016-11-19 10:37:01.642340] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:gluster_shared_storage) [2016-11-19 10:37:01.642592] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libgfrpc.so.0(rpc_c lnt_handle_reply+0x90) [0x7f95cd309770] -->/usr/sbin/glusterfs(mgmt_ge tspec_cbk+0x536) [0x7f95cda3afc6] -->/usr/sbin/glusterfs(cleanup _and_exit+0x6b) [0x7f95cda34b4b] ) 0-: received signum (0), shutting down [2016-11-19 10:37:01.642638] I [fuse-bridge.c:5793:fini] 0-fuse: Unmounting '/run/gluster/shared_storage'.[2016-11-19 10:37:18.798787] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5 (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1 --volfile-id=gluster_shared_storage /run/gluster/shared_storage) [2016-11-19 10:37:18.813011] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-11-19 10:37:18.813363] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs: failed to get the 'volume file' from server [2016-11-19 10:37:18.813386] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:gluster_shared_storage) [2016-11-19 10:37:18.813592] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libgfrpc.so.0(rpc_c lnt_handle_reply+0x90) [0x7f96ba4c7770] -->/usr/sbin/glusterfs(mgmt_ge tspec_cbk+0x536) [0x7f96babf8fc6] -->/usr/sbin/glusterfs(cleanup _and_exit+0x6b) [0x7f96babf2b4b] ) 0-: received signum (0), shutting down [2016-11-19 10:37:18.813633] I [fuse-bridge.c:5793:fini] 0-fuse: Unmounting '/run/gluster/shared_storage'.[2016-11-19 10:40:33.115685] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5 (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1 --volfile-id=gluster_shared_storage /run/gluster/shared_storage) [2016-11-19 10:40:33.124218] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-11-19 10:40:33.124722] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs: failed to get the 'volume file' from server [2016-11-19 10:40:33.124738] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:gluster_shared_storage) [2016-11-19 10:40:33.124869] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libgfrpc.so.0(rpc_c lnt_handle_reply+0x90) [0x7f23576a9770] -->/usr/sbin/glusterfs(mgmt_ge tspec_cbk+0x536) [0x7f2357ddafc6] -->/usr/sbin/glusterfs(cleanup _and_exit+0x6b) [0x7f2357dd4b4b] ) 0-: received signum (0), shutting down [2016-11-19 10:40:33.124896] I [fuse-bridge.c:5793:fini] 0-fuse: Unmounting '/run/gluster/shared_storage'.[2016-11-19 10:44:36.029838] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.5 (args: /usr/sbin/glusterfs --volfile-server=127.0.0.1 --volfile-id=gluster_shared_storage /run/gluster/shared_storage) [2016-11-19 10:44:36.043705] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-11-19 10:44:36.044082] E [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk] 0-glusterfs: failed to get the 'volume file' from server [2016-11-19 10:44:36.044106] E [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:gluster_shared_storage) [2016-11-19 10:44:36.044302] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib64/libgfrpc.so.0(rpc_c lnt_handle_reply+0x90) [0x7fbd9dced770] -->/usr/sbin/glusterfs(mgmt_ge tspec_cbk+0x536) [0x7fbd9e41efc6] -->/usr/sbin/glusterfs(cleanup _and_exit+0x6b) [0x7fbd9e418b4b] ) 0-: received signum (0), shutting down [2016-11-19 10:44:36.044356] I [fuse-bridge.c:5793:fini] 0-fuse: Unmounting '/run/gluster/shared_storage'.
Can you help me to figure out what I am doing wrong?
Sincerely,Alexandr
On Sat, Nov 19, 2016 at 3:18 PM, Saravanakumar Arumugam <sarumuga@xxxxxxxxxx> wrote:
On 11/19/2016 04:13 PM, Alexandr Porunov wrote:
It still doesn't work..
I have created that dir:# mkdir -p /var/run/gluster/shared_storage
and then:# mount -t glusterfs 127.0.0.1:gluster_shared_storage /var/run/gluster/shared_storag e Mount failed. Please check the log file for more details.
Where to find a proper file to read logs? Because "/var/log/glusterfs/" has a lot of log files.
You can find mount logs like this : "directory_mounted".log inside /var/log/glusterfs
There is some issue in your setup...check this log and share it here.
Sincerely,Alexandr
On Sat, Nov 19, 2016 at 11:16 AM, Saravanakumar Arumugam <sarumuga@xxxxxxxxxx> wrote:
On 11/19/2016 01:39 AM, Alexandr Porunov wrote:
Hello,This error means /var/run/gluster/shared_storag
I try to enable shared storage for Geo-Replication but I am not sure that I do it properly.
Here is what I do:
# gluster volume set all cluster.enable-shared-storage enable
volume set: success
# mount -t glusterfs 127.0.0.1:gluster_shared_storage /var/run/gluster/shared_storag e
ERROR: Mount point does not exist
Please specify a mount point
Usage:
man 8 /sbin/mount.glusterfs
e directory does NOT exists.
But, running the command (gluster volume set all cluster.enable-shared-storage enable)
should carry out the mounting automatically. (so, there is no need to manually mount).
Check after running "gluster volume set all cluster.enable-shared-storage enable"
1. gluster volume info
2. glusterfs process started with volfile-id as gluster_shared_storage.
Thanks,
Saravana
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman /listinfo/gluster-users
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-users