Re: Gluster quota issue

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 

The heartbleed bug put me back a couple days but here are the results of running the command on all 4 gluster nodes. I did a du -sh on the two servers that have gluster mounted.

[root@glusterfront1 gbilletz_9774]# du -sh
76G    .

[root@glusterfront2 gbilletz_9774]# du -sh
76G    .

root@gluster1 ~]# gluster volume quota home list /gbilletz_9774
    path          limit_set         size
----------------------------------------------------------------------------------
/gbilletz_9774            500GB               91.7GB
[root@gluster1 ~]# gluster --version
glusterfs 3.4.2 built on Jan  3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@gluster1 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x00000001000000007fffffffffffffff
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000c7e202600
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000c7e202600


[root@gluster2 ~]# gluster volume quota home list /gbilletz_9774
    path          limit_set         size
----------------------------------------------------------------------------------
/gbilletz_9774            500GB               91.7GB
[root@gluster2 ~]# gluster --version
glusterfs 3.4.2 built on Jan  3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@gluster2 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x00000001000000007fffffffffffffff
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000c7c520200
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000c7c520200

[root@gluster3 ~]# gluster volume quota home list /gbilletz_9774
    path          limit_set         size
----------------------------------------------------------------------------------
/gbilletz_9774            500GB               91.7GB
[root@gluster3 ~]# gluster --version
glusterfs 3.4.2 built on Jan  3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@gluster3 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.afr.home-client-2=0x000000000000000000000000
trusted.afr.home-client-3=0x000000000000000000000000
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x0000000100000000000000007ffffffe
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000a6ff6b400
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000a6ff6b400

[root@gluster4 ~]# gluster volume quota home list /gbilletz_9774
    path          limit_set         size
----------------------------------------------------------------------------------
/gbilletz_9774            500GB               91.5GB
[root@gluster4 ~]# gluster --version
glusterfs 3.4.2 built on Jan  3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@gluster4 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.afr.home-client-2=0x000000000000000000000000
trusted.afr.home-client-3=0x000000000000000000000000
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x0000000100000000000000007ffffffe
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000a62c12e00
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000a62c12e00





[root@gluster4 ~]# gluster volume status
Status of volume: home
Gluster process                        Port    Online    Pid
------------------------------------------------------------------------------
Brick gluster1:/export/cluster1                49152    Y    1453
Brick gluster2:/export/cluster1                49152    Y    1134
Brick gluster3:/export/cluster1                49152    Y    1317
Brick gluster4:/export/cluster1                49152    Y    1220
NFS Server on localhost                    2049    Y    2875
Self-heal Daemon on localhost                N/A    Y    1237
NFS Server on gluster1                    2049    Y    29311
Self-heal Daemon on gluster1                N/A    Y    1474
NFS Server on gluster3                    2049    Y    26328
Self-heal Daemon on gluster3                N/A    Y    1329
NFS Server on gluster2                    2049    Y    27141
Self-heal Daemon on gluster2                N/A    Y    1142




Barry Stetler
HIVELOCITY | Devops and Operations Leader
888-869-4678 ext. 224 | Hivelocity.net



On 4/9/14, 9:25 AM, Barry Stetler wrote:
I will check all bricks and resend thank you...

Barry Stetler
HIVELOCITY | Devops and Operations Leader
888-869-4678 ext. 224 | Hivelocity.net



On 4/8/2014 6:08 AM, Varun Shastry wrote:
Hi,
On Monday 07 April 2014 08:10 PM, Barry Stetler wrote:
Gluster Server

[root@gluster1 ~]# gluster --version
glusterfs 3.4.2 built on Jan  3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@gluster1 ~]#


[root@gluster1 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x00000001000000007fffffffffffffff
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000c0aafb400
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000c0aafb400
There can be bug/problem in two cases
i. Accounting :- ie aggregated value of trusted.glusterfs.quota.size from all the bricks (in above case of take one of the bricks from replica pair) should match the du of the directory.
ii. Reading the values from trusted.glusterfs.quota.size.

My intention was to check whether we have problem in level (i). I have only one brick's information here, so can you please check and where the problem among the above two cases?

- Varun Shastry

Server space is mounted on

[root@glusterfront1 dump]# gluster --version
glusterfs 3.4.2 built on Jan  3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.

Logs pretty much say quota exceeded.. On the side its mounted on I have not seen anything in logs pertaining to the issue on the gluster side.. I had to disbale it for the client but I will try to recreate the issue on another user...

 Actual Usage
[root@glusterfront1 gjhgjhg_9774]# du -sh
85G    .

Gluster Usage

[root@gluster1 ~]# gluster volume quota home list /gjhgjhg_9774
    path          limit_set         size
----------------------------------------------------------------------------------
/gjhgjhg_9774            200GB              116.9GB
Barry Stetler
HIVELOCITY | Devops and Operations Leader
888-869-4678 ext. 224 | Hivelocity.net



On 4/7/14, 9:40 AM, Varun Shastry wrote:
Can you please provide these info?

- gluster --version
- getfattr -d -m . -e hex <quota-limit-directories-in-the-backend>
- logs

Thanks
Varun Shastry
On Monday 07 April 2014 06:23 PM, Barry Stetler wrote:
I am having an issue with Gluster quotas. User is set to to 200GB and he is using about 57 GB on mounted file system, Gluster says he is using 180 GB,

gluster volume quota home list /user

shows he is using 180 GB

Is this a bug is this looking at the replicas?

Here is the volume info

Volume Name: home
Type: Distributed-Replicate
Volume ID: 9e0ffc91-9d46-477a-b8eb-dfd3b7d65765
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: gluster1:/export/cluster1
Brick2: gluster2:/export/cluster1
Brick3: gluster3:/export/cluster1
Brick4: gluster4:/export/cluster1
Options Reconfigured:


--
Barry Stetler
HIVELOCITY | Devops and Operations Leader
888-869-4678 ext. 224 | Hivelocity.net 





_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-users








_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-users

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-users
[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux