Hi, I just installed glusterfs 3.0.3 on three servers, and copied 300GB
small files in thousands of directories from our old file system to
glusterfs. The 300GB files are replicated to two of the three servers.
It took us about 16 hours. However, after it finished, the glusterfs
process still hold about 700MB memory, which is about 30% of the total
memory. Could someone tell me why? And is there a solution for this?
By the way, we suppose to use internal ip address for clients to connect
servers. But it sometimes use external ip address to connect servers.
How can I solve this problem?
The following are the server vol file and error messages.
volume posix1
type storage/posix
option directory /gfs/r2/f1
end-volume
volume locks1
type features/locks
subvolumes posix1
end-volume
volume brick1
type performance/io-threads
option thread-count 8
subvolumes locks1
end-volume
volume server-tcp
type protocol/server
option transport-type tcp
option auth.addr.brick1.allow 192.168.0.*
option transport.socket.listen-port 6991
option transport.socket.nodelay on
subvolumes brick1
end-volume
[2010-04-12 14:20:14] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.135.58.12:1017
[2010-04-12 14:20:14] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.135.58.12:1017
[2010-04-12 14:20:14] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1016
[2010-04-12 14:20:14] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1016
[2010-04-12 14:20:14] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1017 disconnected
[2010-04-12 14:20:14] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1016 disconnected
[2010-04-12 14:20:14] N [server-helpers.c:842:server_connection_destroy]
server-tcp: destroyed connection of
s7.pikiware.com-4657-2010/04/12-08:09:39:823330-s2
[2010-04-12 14:20:24] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1013
[2010-04-12 14:20:24] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1013
[2010-04-12 14:20:24] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1012
[2010-04-12 14:20:24] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1012
[2010-04-12 14:20:24] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1013 disconnected
[2010-04-12 14:20:24] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1012 disconnected
[2010-04-12 14:20:24] N [server-helpers.c:842:server_connection_destroy]
server-tcp: destroyed connection of
s7.pikiware.com-4657-2010/04/12-08:09:39:823330-s2
[2010-04-12 14:20:34] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1009
[2010-04-12 14:20:34] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1009
[2010-04-12 14:20:34] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1008
[2010-04-12 14:20:34] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1008
[2010-04-12 14:20:34] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1009 disconnected
[2010-04-12 14:20:34] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1008 disconnected
[2010-04-12 14:20:34] N [server-helpers.c:842:server_connection_destroy]
server-tcp: destroyed connection of
s7.pikiware.com-4657-2010/04/12-08:09:39:823330-s2
[2010-04-12 14:20:44] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1001
[2010-04-12 14:20:44] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1001
[2010-04-12 14:20:44] E [authenticate.c:234:gf_authenticate] auth: no
authentication module is interested in accepting remote-client
66.133.59.19:1000
[2010-04-12 14:20:44] E [server-protocol.c:5862:mop_setvolume]
server-tcp: Cannot authenticate client from 66.133.59.19:1000
[2010-04-12 14:20:44] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1001 disconnected
[2010-04-12 14:20:44] N [server-protocol.c:6788:notify] server-tcp:
66.133.59.19:1000 disconnected
