High Load (Over 90!)

[Pooya Woodcock <pooya@xxxxxxxxxxxxxxx>]

High load over 92... I can do i/o to the glusterfs volume fine. Cpu  
is 0%, memory usage is very low. Must be i/o ? Avati still has his  
ssh key loaded on the servers so if he wants he can check it out. I  
see soemthing with afr_open_cbk ... ??
-Pooya

DAEMON LOG:

2007-07-12 17:40:25 D [inode.c:302:__active_inode] brick/inode:  
activating inode(12141234), lru=149/1000
2007-07-12 17:40:25 D [inode.c:332:__passive_inode] brick/inode:  
passivating inode(12141234), lru=150/1000
2007-07-12 17:40:25 D [inode.c:302:__active_inode] brick-afr/inode:  
activating inode(10552520), lru=152/1000
2007-07-12 17:40:25 D [inode.c:332:__passive_inode] brick-afr/inode:  
passivating inode(10552520), lru=153/1000
2007-07-12 17:40:28 D [inode.c:302:__active_inode] brick/inode:  
activating inode(12075166), lru=149/1000
2007-07-12 17:40:28 D [inode.c:332:__passive_inode] brick/inode:  
passivating inode(12075166), lru=150/1000
2007-07-12 17:40:28 D [inode.c:302:__active_inode] brick-afr/inode:  
activating inode(10502302), lru=152/1000
2007-07-12 17:40:28 D [inode.c:332:__passive_inode] brick-afr/inode:  
passivating inode(10502302), lru=153/1000
2007-07-12 17:40:28 D [inode.c:302:__active_inode] brick/inode:  
activating inode(12125818), lru=149/1000
2007-07-12 17:40:28 D [inode.c:332:__passive_inode] brick/inode:  
passivating inode(12125818), lru=150/1000
2007-07-12 17:40:28 D [inode.c:302:__active_inode] brick-afr/inode:  
activating inode(10552157), lru=152/1000
2007-07-12 17:40:28 D [inode.c:332:__passive_inode] brick-afr/inode:  
passivating inode(10552157), lru=153/1000
2007-07-12 17:40:28 D [inode.c:302:__active_inode] brick/inode:  
activating inode(12141234), lru=149/1000
2007-07-12 17:40:28 D [inode.c:332:__passive_inode] brick/inode:  
passivating inode(12141234), lru=150/1000
2007-07-12 17:40:28 D [inode.c:302:__active_inode] brick-afr/inode:  
activating inode(10552520), lru=152/1000
2007-07-12 17:40:28 D [inode.c:332:__passive_inode] brick-afr/inode:  
passivating inode(10552520), lru=153/1000
2007-07-12 17:40:29 D [inode.c:302:__active_inode] brick-afr/inode:  
activating inode(10502302), lru=152/1000
2007-07-12 17:40:29 D [inode.c:332:__passive_inode] brick-afr/inode:  
passivating inode(10502302), lru=153/1000
2007-07-12 17:40:29 D [inode.c:302:__active_inode] brick/inode:  
activating inode(12075166), lru=149/1000
2007-07-12 17:40:29 D [inode.c:332:__passive_inode] brick/inode:  
passivating inode(12075166), lru=150/1000
2007-07-12 17:40:29 D [inode.c:302:__active_inode] brick-afr/inode:  
activating inode(10552157), lru=152/1000
2007-07-12 17:40:29 D [inode.c:332:__passive_inode] brick-afr/inode:  
passivating inode(10552157), lru=153/1000
2007-07-12 17:40:29 D [inode.c:302:__active_inode] brick/inode:  
activating inode(12125818), lru=149/1000
2007-07-12 17:40:29 D [inode.c:332:__passive_inode] brick/inode:  
passivating inode(12125818), lru=150/1000
2007-07-12 17:40:29 D [inode.c:302:__active_inode] brick-afr/inode:  
activating inode(10552520), lru=152/1000
2007-07-12 17:40:29 D [inode.c:332:__passive_inode] brick-afr/inode:  
passivating inode(10552520), lru=153/1000
2007-07-12 17:40:29 D [inode.c:302:__active_inode] brick/inode:  
activating inode(12141234), lru=149/1000
2007-07-12 17:40:29 D [inode.c:332:__passive_inode] brick/inode:  
passivating inode(12141234), lru=150/1000



CLIENT LOG:

2007-07-12 17:37:33 D [fuse-bridge.c:290:fuse_entry_cbk] glusterfs- 
fuse: ENTRY => 6832568
2007-07-12 17:37:33 D [inode.c:332:__passive_inode] fuse/inode:  
passivating inode(6832568), lru=561/1024
2007-07-12 17:37:33 D [inode.c:332:__passive_inode] fuse/inode:  
passivating inode(6832172), lru=562/1024
2007-07-12 17:37:33 D [inode.c:302:__active_inode] fuse/inode:  
activating inode(6832568), lru=561/1024
2007-07-12 17:37:33 E [afr.c:697:afr_open_cbk] afr4: (path=/www/ 
community.starherpes.com/includes/functions_forumlist.php) op_ret=0  
op_errno=2
2007-07-12 17:37:33 D [inode.c:332:__passive_inode] fuse/inode:  
passivating inode(6832568), lru=562/1024
2007-07-12 17:37:33 D [fuse-bridge.c:415:fuse_getattr] glusterfs- 
fuse: GETATTR 1 ()
2007-07-12 17:37:33 D [inode.c:302:__active_inode] fuse/inode:  
activating inode(6832554), lru=561/1024
2007-07-12 17:37:33 D [inode.c:302:__active_inode] fuse/inode:  
activating inode(6832172), lru=560/1024
2007-07-12 17:37:33 D [fuse-bridge.c:340:fuse_lookup] glusterfs-fuse:  
LOOKUP 6832172/functions_calendar.php (/www/community.starherpes.com/ 
includes/functions_calendar.php)
2007-07-12 17:37:33 D [fuse-bridge.c:290:fuse_entry_cbk] glusterfs- 
fuse: ENTRY => 6832554
2007-07-12 17:37:33 D [inode.c:332:__passive_inode] fuse/inode:  
passivating inode(6832554), lru=561/1024
2007-07-12 17:37:33 D [inode.c:332:__passive_inode] fuse/inode:  
passivating inode(6832172), lru=562/1024
2007-07-12 17:37:33 D [inode.c:302:__active_inode] fuse/inode:  
activating inode(6832554), lru=561/1024
2007-07-12 17:37:33 E [afr.c:697:afr_open_cbk] afr4: (path=/www/ 
community.starherpes.com/includes/functions_calendar.php) op_ret=0  
op_errno=2
2007-07-12 17:37:33 D [inode.c:332:__passive_inode] fuse/inode:  
passivating inode(6832554), lru=562/1024