Re: How to enable shared_storage?

Jiffin Tony Thottan <jthottan@xxxxxxxxxx> · Mon, 21 Nov 2016 10:28:40 +0530



    On 21/11/16 01:07, Alexandr Porunov
      wrote:

    
        I have installed it from rpm. No that file isn't there. The
          folder "/var/lib/glusterd/hooks/1/set/post/" is empty..
        

    which gluster version and what all gluster rpms have u installed?

    For time being just download this file[1] and copy to  above
    location and rerun the same cli.

    
    [1] https://github.com/gluster/glusterfs/blob/master/extras/hook-scripts/set/post/S32gluster_enable_shared_storage.sh

    
    --

    Jiffin

    
        Sincerely,
        Alexandr
      
      
        On Sun, Nov 20, 2016 at 2:55 PM, Jiffin
          Tony Thottan <jthottan@xxxxxxxxxx>
          wrote:

          
              Did u install rpm or directly from sources. Can u check
                whether following script is present?

              
              /var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh

              
              --

              
              Jiffin
              
                
                  On
                    20/11/16 13:33, Alexandr Porunov wrote:

                  
                      To enable shared storage I used next command:
                      # gluster volume set all
                        cluster.enable-shared-storage enable
                      

                      But it seems that it doesn't create
                        gluster_shared_storage automatically.
                      

                      # gluster volume status
                        gluster_shared_storage
                      Volume gluster_shared_storage does not exist
                      

                      Do I need to manually create a volume
                        "gluster_shared_storage"? Do I need to manually
                        create a folder "/var/run/gluster/shared_storage"?
                        Do I need to manually mount it? Or something I
                        don't need to do?
                      

                      If I use 6 cluster nodes and I need to have a
                        shared storage on all of them then how to create
                        a shared storage? 
                      It says that it have to be with replication 2
                        or replication 3. But if we use shared storage
                        on all of 6 nodes then we have only 2 ways to
                        create a volume:
                      1. Use replication 6
                      2. Use replication 3 with distribution.
                      

                      Which way I need to use?
                      

                      Sincerely,
                      Alexandr
                    
                    
                      On Sun, Nov 20, 2016 at
                        9:07 AM, Jiffin Tony Thottan <jthottan@xxxxxxxxxx>
                        wrote:

                        
                              On
                                19/11/16 21:47, Alexandr Porunov wrote:

                              
                                  Unfortunately I haven't this log
                                    file but I have
                                    'run-gluster-shared_storage.log'
                                    and it has errors I don't know why.
                                  

                                  Here is the content of the
                                    'run-gluster-shared_storage.log':
                                  

                             Make sure shared storage is up and
                            running using "gluster volume status 
                            gluster_shared_storage"

                            
                            May be the issue is related to firewalld or
                            iptables. Try it after disabling them.

                            
                            --

                            
                            Jiffin

                            
                                      [2016-11-19
                                          10:37:01.581737] I [MSGID:
                                          100030]
                                          [glusterfsd.c:2454:main]
                                          0-/usr/sbin/glusterfs: Started
                                          running /usr/sbin/glusterfs
                                          version 3.8.5 (args:
                                          /usr/sbin/glusterfs
                                          --volfile-server=127.0.0.1
                                          --volfile-id=gluster_shared_storage
                                          /run/gluster/shared_storage)
                                      [2016-11-19
                                          10:37:01.641836] I [MSGID:
                                          101190]
                                          [event-epoll.c:628:event_dispatch_epoll_worker]
                                          0-epoll: Started thread with
                                          index 1
                                      [2016-11-19
                                          10:37:01.642311] E
                                          [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
                                          0-glusterfs: failed to get the
                                          'volume file' from server
                                      [2016-11-19
                                          10:37:01.642340] E
                                          [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
                                          0-mgmt: failed to fetch volume
                                          file
                                          (key:gluster_shared_storage)
                                      [2016-11-19
                                          10:37:01.642592] W
                                          [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
                                          [0x7f95cd309770]
                                          -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
                                          [0x7f95cda3afc6]
                                          -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
                                          [0x7f95cda34b4b] ) 0-:
                                          received signum (0), shutting
                                          down
                                      [2016-11-19
                                          10:37:01.642638] I
                                          [fuse-bridge.c:5793:fini]
                                          0-fuse: Unmounting
                                          '/run/gluster/shared_storage'.
                                      [2016-11-19
                                          10:37:18.798787] I [MSGID:
                                          100030]
                                          [glusterfsd.c:2454:main]
                                          0-/usr/sbin/glusterfs: Started
                                          running /usr/sbin/glusterfs
                                          version 3.8.5 (args:
                                          /usr/sbin/glusterfs
                                          --volfile-server=127.0.0.1
                                          --volfile-id=gluster_shared_storage
                                          /run/gluster/shared_storage)
                                      [2016-11-19
                                          10:37:18.813011] I [MSGID:
                                          101190]
                                          [event-epoll.c:628:event_dispatch_epoll_worker]
                                          0-epoll: Started thread with
                                          index 1
                                      [2016-11-19
                                          10:37:18.813363] E
                                          [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
                                          0-glusterfs: failed to get the
                                          'volume file' from server
                                      [2016-11-19
                                          10:37:18.813386] E
                                          [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
                                          0-mgmt: failed to fetch volume
                                          file
                                          (key:gluster_shared_storage)
                                      [2016-11-19
                                          10:37:18.813592] W
                                          [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
                                          [0x7f96ba4c7770]
                                          -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
                                          [0x7f96babf8fc6]
                                          -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
                                          [0x7f96babf2b4b] ) 0-:
                                          received signum (0), shutting
                                          down                          
                                                                       
                                                                       
                                      [2016-11-19
                                          10:37:18.813633] I
                                          [fuse-bridge.c:5793:fini]
                                          0-fuse: Unmounting
                                          '/run/gluster/shared_storage'.
                                                                    
                                      [2016-11-19
                                          10:40:33.115685] I [MSGID:
                                          100030]
                                          [glusterfsd.c:2454:main]
                                          0-/usr/sbin/glusterfs: Started
                                          running /usr/sbin/glusterfs
                                          version 3.8.5 (args:
                                          /usr/sbin/glusterfs
                                          --volfile-server=127.0.0.1
                                          --volfile-id=gluster_shared_storage
                                          /run/gluster/shared_storage)
                                            
                                      [2016-11-19
                                          10:40:33.124218] I [MSGID:
                                          101190]
                                          [event-epoll.c:628:event_dispatch_epoll_worker]
                                          0-epoll: Started thread with
                                          index 1  
                                      [2016-11-19
                                          10:40:33.124722] E
                                          [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
                                          0-glusterfs: failed to get the
                                          'volume file' from server    
                                      [2016-11-19
                                          10:40:33.124738] E
                                          [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
                                          0-mgmt: failed to fetch volume
                                          file
                                          (key:gluster_shared_storage)  
                                                                       
                                                                       
                                      [2016-11-19
                                          10:40:33.124869] W
                                          [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
                                          [0x7f23576a9770]
                                          -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
                                          [0x7f2357ddafc6]
                                          -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
                                          [0x7f2357dd4b4b] ) 0-:
                                          received signum (0), shutting
                                          down                          
                                                                       
                                                                       
                                      [2016-11-19
                                          10:40:33.124896] I
                                          [fuse-bridge.c:5793:fini]
                                          0-fuse: Unmounting
                                          '/run/gluster/shared_storage'.
                                                                    
                                      [2016-11-19
                                          10:44:36.029838] I [MSGID:
                                          100030]
                                          [glusterfsd.c:2454:main]
                                          0-/usr/sbin/glusterfs: Started
                                          running /usr/sbin/glusterfs
                                          version 3.8.5 (args:
                                          /usr/sbin/glusterfs
                                          --volfile-server=127.0.0.1
                                          --volfile-id=gluster_shared_storage
                                          /run/gluster/shared_storage)
                                            
                                      [2016-11-19
                                          10:44:36.043705] I [MSGID:
                                          101190]
                                          [event-epoll.c:628:event_dispatch_epoll_worker]
                                          0-epoll: Started thread with
                                          index 1  
                                      [2016-11-19
                                          10:44:36.044082] E
                                          [glusterfsd-mgmt.c:1586:mgmt_getspec_cbk]
                                          0-glusterfs: failed to get the
                                          'volume file' from server    
                                      [2016-11-19
                                          10:44:36.044106] E
                                          [glusterfsd-mgmt.c:1686:mgmt_getspec_cbk]
                                          0-mgmt: failed to fetch volume
                                          file
                                          (key:gluster_shared_storage)  
                                                                       
                                                                       
                                      [2016-11-19
                                          10:44:36.044302] W
                                          [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
                                          [0x7fbd9dced770]
                                          -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x536)
                                          [0x7fbd9e41efc6]
                                          -->/usr/sbin/glusterfs(cleanup_and_exit+0x6b)
                                          [0x7fbd9e418b4b] ) 0-:
                                          received signum (0), shutting
                                          down                          
                                                                       
                                                                       
                                      [2016-11-19
                                          10:44:36.044356] I
                                          [fuse-bridge.c:5793:fini]
                                          0-fuse: Unmounting
                                          '/run/gluster/shared_storage'. 
                                    
                                    
                                      Can you help me to figure out
                                        what I am doing wrong?
                                      

                                      Sincerely,
                                      Alexandr
                                    
                                  
                                    On Sat, Nov
                                      19, 2016 at 3:18 PM, Saravanakumar
                                      Arumugam <sarumuga@xxxxxxxxxx>
                                      wrote:

                                      
                                            On
                                              11/19/2016 04:13 PM,
                                              Alexandr Porunov wrote:

                                            
                                              It still
                                                doesn't work..
                                                

                                                I have created that
                                                  dir:
                                                # mkdir -p
                                                  /var/run/gluster/shared_storage

                                                
                                                and then:
                                                
                                                  # mount -t
                                                    glusterfs
                                                    127.0.0.1:gluster_shared_storage
/var/run/gluster/shared_storage
                                                  Mount failed.
                                                    Please check the log
                                                    file for more
                                                    details.
                                                
                                                
                                                Where to find a
                                                  proper file to read
                                                  logs? Because
                                                  "/var/log/glusterfs/"
                                                  has a lot of log
                                                  files.
                                              
                                            
                                           You can  find mount
                                          logs like this : 
                                          "directory_mounted".log inside
                                          /var/log/glusterfs

                                          There is some issue in your
                                          setup...check this log and
                                          share it here.

                                            
                                                Sincerely,
                                                Alexandr
                                              
                                              
                                                On
                                                  Sat, Nov 19, 2016 at
                                                  11:16 AM,
                                                  Saravanakumar Arumugam
                                                  <sarumuga@xxxxxxxxxx>
                                                  wrote:

                                                  
                                                      On 11/19/2016
                                                      01:39 AM, Alexandr
                                                      Porunov wrote:

                                                      
                                                        Hello,

                                                        
                                                        I try to enable
                                                        shared storage
                                                        for
                                                        Geo-Replication
                                                        but I am not
                                                        sure that I do
                                                        it properly.

                                                        
                                                        Here is what I
                                                        do:

                                                        # gluster volume
                                                        set all
                                                        cluster.enable-shared-storage
                                                        enable

                                                        volume set:
                                                        success

                                                        
                                                        # mount -t
                                                        glusterfs
                                                        127.0.0.1:gluster_shared_storage
/var/run/gluster/shared_storage

                                                        ERROR: Mount
                                                        point does not
                                                        exist

                                                        Please specify a
                                                        mount point

                                                        Usage:

                                                        man 8
                                                        /sbin/mount.glusterfs

                                                        
                                                     This error
                                                    means
                                                    /var/run/gluster/shared_storage
                                                    directory does NOT
                                                    exists.

                                                    
                                                    But, running the 
                                                    command (gluster
                                                    volume set all
                                                    cluster.enable-shared-storage
                                                    enable)

                                                    should carry out the
                                                    mounting
                                                    automatically. (so,
                                                    there is no need to
                                                    manually mount).

                                                    
                                                    Check after running
                                                    "gluster volume set
                                                    all
                                                    cluster.enable-shared-storage
                                                    enable"

                                                        1. gluster
                                                    volume info

                                                         2. glusterfs
                                                    process started with
                                                    volfile-id as
                                                    gluster_shared_storage.

                                                    
                                                    Thanks,

                                                    Saravana

                                                    
                              _______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
    
    
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users