Hi,
Thanks, if anyone has the time could you review what I did?
I wrote up the process I did as follows.
Did I do anything wrong? have I missed anything?
Not sure firewall is 100% right.
(note I was recovering a brick from a previous ovirt/gluster 3.x install and wanted to keep the data hence the lvm2 stuff)
4.10.4Gluster 4.0
https://wiki.centos.org/HowTos/GlusterFSonCentOS#head-338b2d9d4c8a798ed7444f4f356c2a67ae8f7dc5
Make sure the servers point at the internal DNS servers 192.168.1.241 and 192.168.1.104 and that domain and search lines are present
-
Setup each in forward and reverse DNS
-
Setup the servers in /etc/hosts
192.168.1.31 glusterp1.graywitch.co.nz glusterp1
192.168.1.32 glusterp2.graywitch.co.nz glusterp2
192.168.1.33 glusterp3.graywitch.co.nz glusterp3
Install EPEL
Install Gluster 4.0
https://wiki.centos.org/SpecialInterestGroup/Storage
https://wiki.centos.org/SpecialInterestGroup/Storage/gluster-Quickstart
-
yum install centos-release-gluster40
-
mkdir -p /bricks/brick1
-
Either create a new volume group, or recover esisting group.
-
To recover, run pvs and lvs note the volume group and run vgchange,
-
vgchange -a y vg-gluster-prod1
-
add to /etc/fstab,
/dev/vg-gluster-prod1/gluster-prod1 /bricks/brick1 xfs defaults 1 2
-
Setup the servers in DNS
-
yum install glusterfs-server
-
Start the gluster service,
-
systemctl enable glusterd
-
systemctl start glusterd
-
systemctl status glusterd
-
● glusterd.service - GlusterFS, a clustered file-system server
Loaded: loaded (/usr/lib/systemd/system/glusterd.service; enabled; vendor preset: disabled)
Active: active (running) since Wed 2018-03-28 15:22:20 NZDT; 2min 42s ago
Process: 17341 ExecStart=/usr/sbin/glusterd -p /var/run/glusterd.pid --log-level $LOG_LEVEL $GLUSTERD_OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 17342 (glusterd)
CGroup: /system.slice/glusterd.service
└─17342 /usr/sbin/glusterd -p /var/run/glusterd.pid --log-level INFO
Mar 28 15:22:20 glustep1.graywitch.co.nz systemd[1]: Starting GlusterFS, a clustered file-system server...
Mar 28 15:22:20 glustep1.graywitch.co.nz systemd[1]: Started GlusterFS, a clustered file-system server.
[root@glustep1 ~]#
-
Now we need to set the firewall
-
Run, firewall-cmd –state it should reply “running”
-
firewall-cmd --add-service=nfs --add-service=samba --add-service=samba-client –permanent
-
firewall-cmd --add-port=111/tcp --add-port=139/tcp --add-port=445/tcp --add-port=965/tcp –add-port=2049/tcp
-
firewall-cmd --zone=public --add-rich-rule='rule family="ipv4" source address="192.168.1.31" accept'
-
firewall-cmd --zone=public --add-rich-rule='rule family="ipv4" source address="192.168.1.32" accept'
-
firewall-cmd --zone=public --add-rich-rule='rule family="ipv4" source address="192.168.1.33" accept'
-
firewall-cmd --add-port=24007/tcp --add-port=24008/tcp –permanent
-
firewall-cmd --add-port=24009/tcp --permanent
-
firewall-cmd --reload
-
This should give us,
[root@glustep1 ~]# firewall-cmd --zone=public --list-all
public (active)
target: default
icmp-block-inversion: no
interfaces: em1
sources:
services: ssh dhcpv6-client nfs samba samba-client
ports: 111/tcp 139/tcp 445/tcp 965/tcp 2049/tcp 38465-38469/tcp 631/tcp 111/udp 963/udp 49152-49251/tcp 24007/tcp 24008/tcp 24009/tcp
protocols:
masquerade: no
forward-ports:
source-ports:
icmp-blocks:
rich rules:
[root@glustep1 ~]#
-
yum -y install nmap to allow troubleshooting
-
setup the gluster volume,
-
gluster volume create gv0 replica 3 glusterp1:/bricks/brick1/gv0 glusterp2:/bricks/brick1/gv0 glusterp3:/bricks/brick1/gv0
-
-
Start the volume,
-
gluster volume start gv0
-
-
check the volume
-
gluster volume info
-
Volume Name: gv0
Type: Replicate
Volume ID: a92ef588-5e86-459d-bd46-a0df65f2bd4e
Status: Created
Snapshot Count: 0
Number of Bricks: 1 x 3 = 3
Transport-type: tcp
Bricks:
Brick1: glusterp1:/bricks/brick1/gv0
Brick2: glusterp2:/bricks/brick1/gv0
Brick3: glusterp3:/bricks/brick1/gv0
Options Reconfigured:
transport.address-family: inet
nfs.disable: on
performance.client-io-threads: off
[root@glustep1 ~]#
-
Test it looks good,
-
mkdir /gv0
-
mount -t glusterfs glusterp1:/gv0 /gv0
-
-
test with, df -h
[root@glustep1 brick1]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/centos-root 20G 3.3G 17G 17% /
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 0 3.8G 0% /dev/shm
tmpfs 3.8G 9.0M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup
/dev/sda1 969M 206M 713M 23% /boot
/dev/mapper/centos-home 50G 38M 50G 1% /home
/dev/mapper/centos-tmp 3.9G 33M 3.9G 1% /tmp
/dev/mapper/centos-data1 120G 33M 120G 1% /data1
/dev/mapper/vg--gluster--prod1-gluster--prod1 932G 742G 190G 80% /bricks/brick1
/dev/mapper/centos-var 20G 270M 20G 2% /var
/dev/mapper/centos00-var_lib 9.4G 179M 9.2G 2% /var/lib
tmpfs 771M 12K 771M 1% /run/user/42
tmpfs 771M 0 771M 0% /run/user/1000
glusterp1:/gv0 932G 751G 181G 81% /gv0
On 28 March 2018 at 21:47, Niels de Vos <ndevos@xxxxxxxxxx> wrote:
On Wed, Mar 28, 2018 at 02:57:55PM +1300, Thing wrote:
> Hi,
>
> Thanks, yes, not very familiar with Centos and hence googling took a while
> to find a 4.0 version at,
>
> https://wiki.centos.org/SpecialInterestGroup/Storage
The announcement for Gluster 4.0 in CentOS should contain all the
details that you need as well:
https://lists.centos.org/pipermail/centos-announce/ 2018-March/022805.html
HTH,
Niels
>
> On 28 March 2018 at 14:37, Kaleb S. KEITHLEY <kkeithle@xxxxxxxxxx> wrote:
>
> >
> > Go to [1], click on CentOS, the README.txt has links to the CentOS
> > Storage SIG where you can find information on installing RPMs from the
> > CentOS Storage SIG.
> >
> >
> > On 03/27/2018 08:53 PM, Thing wrote:
> > > Hi,
> > >
> > > Thanks, any howtos/docs/notes for installing gluster4.0.x on Centos 7
> > > please?
> > >
> > > On 27 March 2018 at 01:28, Shyam Ranganathan <srangana@xxxxxxxxxx
> > > <mailto:srangana@xxxxxxxxxx>> wrote:
> > >
> > > The Gluster community is pleased to announce the release of Gluster
> > > 4.0.1 (packages available at [1]).
> > >
> > > Release notes for the release can be found at [2].
> > >
> > > Thanks,
> > > Gluster community
> > >
> > > [1] Packages:
> > > https://download.gluster.org/pub/gluster/glusterfs/4.0/4.0. 1/
> > > <https://download.gluster.org/pub/gluster/glusterfs/4.0/4.0. >1/
> > >
> > > [2] Release notes:
> > > https://github.com/gluster/glusterfs/blob/v4.0.1/doc/
> > release-notes/4.0.1.md
> > > <https://github.com/gluster/glusterfs/blob/v4.0.1/doc/
> > release-notes/4.0.1.md>
> > > _______________________________________________
> > > Gluster-users mailing list
> > > Gluster-users@xxxxxxxxxxx <mailto:Gluster-users@gluster.org >
> > > http://lists.gluster.org/mailman/listinfo/gluster-users
> > > <http://lists.gluster.org/mailman/listinfo/gluster-users >
> > >
> > >
> > >
> > >
> > > _______________________________________________
> > > Gluster-users mailing list
> > > Gluster-users@xxxxxxxxxxx
> > > http://lists.gluster.org/mailman/listinfo/gluster-users
> > >
> >
> >
> _______________________________________________
> Gluster-users mailing list
> Gluster-users@xxxxxxxxxxx
> http://lists.gluster.org/mailman/listinfo/gluster-users
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://lists.gluster.org/mailman/listinfo/gluster-users