Re: glusterfs version3 and xen images

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



hi,

changed client volfile:

cat /etc/glusterfs/mount-office-data02-server_repl.vol
#volume office-data02-rr
volume office-data02
  type protocol/client
  option transport-type tcp
#  option remote-host cluster-gfs.magora.local # RRDNS
  option remote-host gfs-01-01
  option remote-host gfs-01-02
  option remote-port 7000
  option remote-subvolume office-data02
end-volume

volume readahead
  type performance/read-ahead
option page-count 16 # cache per file = (page-count x page-size)
  option force-atime-update off # default is off
  subvolumes office-data02
end-volume

volume writebehind
  type performance/write-behind
  option cache-size 512MB # default is equal to aggregate-size
  option flush-behind on # default is 'off'
  subvolumes readahead
end-volume

volume iocache
  type performance/io-cache
  option cache-size 64MB             # default is 32MB
#  option priority *.h:3,*.html:2,*:1 # default is '*:0'
  option cache-timeout 3             # default is 1 second
  subvolumes writebehind
end-volume

volume quickread
 type performance/quick-read
  option cache-timeout 1
  option max-file-size 512
  subvolumes iocache
end-volume

volume stat-prefetch
  type performance/stat-prefetch
  subvolumes quickread
end-volume

But client connects always to gfs-01-02 - never to gfs-01-01 - whats wrong?

server debug gfs-01-01:
[2009-12-21 10:30:52] D [glusterfsd.c:1335:main] glusterfs: running in pid 4978
[New Thread 0x7ffff5b45950 (LWP 4981)]
[2009-12-21 10:30:52] D [transport.c:145:transport_load] transport: attempt to load file /usr/lib64/glusterfs/3.0.0/transport/socket.so [2009-12-21 10:30:52] D [xlator.c:284:_volume_option_value_validate] server: no range check required for 'option transport.socket.listen-port 7000' [2009-12-21 10:30:52] W [quick-read.c:2187:init] quickread: dangling volume. check volfile [2009-12-21 10:30:52] D [io-threads.c:2841:init] office-data02: io-threads: Autoscaling: off, min_threads: 32, max_threads: 32
[New Thread 0x7ffff7f85950 (LWP 4982)]
[New Thread 0x7ffff4f36950 (LWP 4983)]
[New Thread 0x7ffff4e35950 (LWP 4984)]
[New Thread 0x7ffff4d34950 (LWP 4985)]
[New Thread 0x7ffff4c33950 (LWP 4986)]
[New Thread 0x7ffff4b32950 (LWP 4987)]
[New Thread 0x7ffff4a31950 (LWP 4988)]
[New Thread 0x7ffff4930950 (LWP 4989)]
[New Thread 0x7ffff482f950 (LWP 4990)]
[New Thread 0x7ffff472e950 (LWP 4991)]
[New Thread 0x7ffff462d950 (LWP 4992)]
[New Thread 0x7ffff452c950 (LWP 4993)]
[New Thread 0x7ffff442b950 (LWP 4994)]
[New Thread 0x7ffff432a950 (LWP 4995)]
[New Thread 0x7ffff4229950 (LWP 4996)]
[New Thread 0x7ffff4128950 (LWP 4997)]
[New Thread 0x7ffff4027950 (LWP 4998)]
[New Thread 0x7ffff3f26950 (LWP 4999)]
[New Thread 0x7ffff3e25950 (LWP 5000)]
[New Thread 0x7ffff3d24950 (LWP 5001)]
[New Thread 0x7ffff3c23950 (LWP 5002)]
[New Thread 0x7ffff3b22950 (LWP 5003)]
[New Thread 0x7ffff3a21950 (LWP 5004)]
[New Thread 0x7ffff3920950 (LWP 5005)]
[New Thread 0x7ffff381f950 (LWP 5006)]
[New Thread 0x7ffff371e950 (LWP 5007)]
[New Thread 0x7ffff361d950 (LWP 5008)]
[New Thread 0x7ffff351c950 (LWP 5009)]
[New Thread 0x7ffff341b950 (LWP 5010)]
[New Thread 0x7ffff331a950 (LWP 5011)]
[New Thread 0x7ffff3219950 (LWP 5012)]
[New Thread 0x7ffff3118950 (LWP 5013)]
[2009-12-21 10:30:52] D [write-behind.c:2480:init] writebehind: disabling write-behind for first 1 bytes [2009-12-21 10:30:52] D [write-behind.c:2531:init] writebehind: enabling flush-behind [2009-12-21 10:30:52] D [client-protocol.c:6581:init] posix-remote: defaulting frame-timeout to 30mins [2009-12-21 10:30:52] D [client-protocol.c:6589:init] posix-remote: setting ping-timeout to 5 [2009-12-21 10:30:52] D [transport.c:145:transport_load] transport: attempt to load file /usr/lib64/glusterfs/3.0.0/transport/socket.so [2009-12-21 10:30:52] D [xlator.c:284:_volume_option_value_validate] posix-remote: no range check required for 'option remote-port 7000' [2009-12-21 10:30:52] D [transport.c:145:transport_load] transport: attempt to load file /usr/lib64/glusterfs/3.0.0/transport/socket.so [2009-12-21 10:30:52] D [xlator.c:284:_volume_option_value_validate] posix-remote: no range check required for 'option remote-port 7000' [2009-12-21 10:30:52] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:52] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:52] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:52] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:52] N [glusterfsd.c:1361:main] glusterfs: Successfully started [2009-12-21 10:30:52] D [client-protocol.c:7019:notify] posix-remote: got GF_EVENT_CHILD_UP [2009-12-21 10:30:52] D [client-protocol.c:7019:notify] posix-remote: got GF_EVENT_CHILD_UP [2009-12-21 10:30:52] N [client-protocol.c:6224:client_setvolume_cbk] posix-remote: Connected to 192.168.11.82:7000, attached to remote volume 'locks'. [2009-12-21 10:30:52] N [afr.c:2625:notify] gfs-replicate: Subvolume 'posix-remote' came back up; going online. [2009-12-21 10:30:52] N [client-protocol.c:6224:client_setvolume_cbk] posix-remote: Connected to 192.168.11.82:7000, attached to remote volume 'locks'. [2009-12-21 10:30:52] N [afr.c:2625:notify] gfs-replicate: Subvolume 'posix-remote' came back up; going online. [2009-12-21 10:31:02] D [addr.c:190:gf_auth] locks: allowed = "192.168.11.*", received addr = "192.168.11.82" [2009-12-21 10:31:02] N [server-protocol.c:5809:mop_setvolume] server: accepted client from 192.168.11.82:1023 [2009-12-21 10:31:02] D [addr.c:190:gf_auth] locks: allowed = "192.168.11.*", received addr = "192.168.11.82" [2009-12-21 10:31:02] N [server-protocol.c:5809:mop_setvolume] server: accepted client from 192.168.11.82:1022

serverdebug gfs-01-02:
[2009-12-21 10:30:51] D [write-behind.c:2480:init] writebehind: disabling write-behind for first 1 bytes [2009-12-21 10:30:51] D [write-behind.c:2531:init] writebehind: enabling flush-behind [2009-12-21 10:30:51] D [client-protocol.c:6581:init] posix-remote: defaulting frame-timeout to 30mins [2009-12-21 10:30:51] D [client-protocol.c:6589:init] posix-remote: setting ping-timeout to 5 [2009-12-21 10:30:51] D [transport.c:145:transport_load] transport: attempt to load file /usr/lib64/glusterfs/3.0.0/transport/socket.so [2009-12-21 10:30:51] D [xlator.c:284:_volume_option_value_validate] posix-remote: no range check required for 'option remote-port 7000' [2009-12-21 10:30:51] D [transport.c:145:transport_load] transport: attempt to load file /usr/lib64/glusterfs/3.0.0/transport/socket.so [2009-12-21 10:30:51] D [xlator.c:284:_volume_option_value_validate] posix-remote: no range check required for 'option remote-port 7000' [2009-12-21 10:30:51] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:51] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:51] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:51] D [client-protocol.c:7005:notify] posix-remote: got GF_EVENT_PARENT_UP, attempting connect on transport [2009-12-21 10:30:51] N [glusterfsd.c:1361:main] glusterfs: Successfully started [2009-12-21 10:30:51] E [socket.c:760:socket_connect_finish] posix-remote: connection to failed (Connection refused) [2009-12-21 10:30:51] E [socket.c:760:socket_connect_finish] posix-remote: connection to failed (Connection refused) [2009-12-21 10:30:52] D [addr.c:190:gf_auth] locks: allowed = "192.168.11.*", received addr = "192.168.11.11" [2009-12-21 10:30:52] N [server-protocol.c:5809:mop_setvolume] server: accepted client from 192.168.11.11:1023 [2009-12-21 10:30:52] D [addr.c:190:gf_auth] locks: allowed = "192.168.11.*", received addr = "192.168.11.11" [2009-12-21 10:30:52] N [server-protocol.c:5809:mop_setvolume] server: accepted client from 192.168.11.11:1022 [2009-12-21 10:31:02] D [client-protocol.c:7019:notify] posix-remote: got GF_EVENT_CHILD_UP [2009-12-21 10:31:02] D [client-protocol.c:7019:notify] posix-remote: got GF_EVENT_CHILD_UP [2009-12-21 10:31:02] N [client-protocol.c:6224:client_setvolume_cbk] posix-remote: Connected to 192.168.11.11:7000, attached to remote volume 'locks'. [2009-12-21 10:31:02] N [afr.c:2625:notify] gfs-replicate: Subvolume 'posix-remote' came back up; going online. [2009-12-21 10:31:02] N [client-protocol.c:6224:client_setvolume_cbk] posix-remote: Connected to 192.168.11.11:7000, attached to remote volume 'locks'. [2009-12-21 10:31:02] N [afr.c:2625:notify] gfs-replicate: Subvolume 'posix-remote' came back up; going online. [2009-12-21 10:31:06] D [addr.c:190:gf_auth] office-data02: allowed = "192.168.11.*", received addr = "192.168.11.68" [2009-12-21 10:31:06] N [server-protocol.c:5809:mop_setvolume] server: accepted client from 192.168.11.68:1023 [2009-12-21 10:31:06] D [addr.c:190:gf_auth] office-data02: allowed = "192.168.11.*", received addr = "192.168.11.68" [2009-12-21 10:31:06] N [server-protocol.c:5809:mop_setvolume] server: accepted client from 192.168.11.68:1022



regards,
roland





[Index of Archives]     [Gluster Users]     [Ceph Users]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux