Hi,
This morning one of the gluster 3.4 servers went crazy, to be honest
with you no idea what I did that caused it, but it's only on this one
machine.
Glusterd and Glusterfsd refuse to start and this shows up in the logs.
Rdma.so is indeed missing, but I am not using rdma ... and it is missing
also in the other gluster machine which runs just fine.
Or maybe the main problem is with "Unable to retrieve store handle".
==> /var/log/glusterfs/etc-glusterfs-glusterd.vol.log <==
[2013-03-14 10:00:07.301076] I [glusterfsd.c:1878:main]
0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version
3.4.0alpha2 (/usr/sbin/glusterd -p /var/run/glusterd.pid)
[2013-03-14 10:00:07.304110] I [glusterd.c:958:init] 0-management:
Using /var/lib/glusterd as working directory
[2013-03-14 10:00:07.306209] I [socket.c:3459:socket_init]
0-socket.management: SSL support is NOT enabled
[2013-03-14 10:00:07.306229] I [socket.c:3474:socket_init]
0-socket.management: using system polling thread
[2013-03-14 10:00:07.306330] E [rpc-transport.c:252:rpc_transport_load]
0-rpc-transport: /usr/lib64/glusterfs/3.4.0alpha2/rpc-transport/rdma.so:
cannot open shared object file: No such file or directory
[2013-03-14 10:00:07.306346] W [rpc-transport.c:256:rpc_transport_load]
0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not
valid or not found on this machine
[2013-03-14 10:00:07.306359] W [rpcsvc.c:1388:rpcsvc_transport_create]
0-rpc-service: cannot create listener, initing the transport failed
[2013-03-14 10:00:08.360775] I
[glusterd-store.c:1738:glusterd_restore_op_version] 0-glusterd:
retrieved op-version: 1
[2013-03-14 10:00:08.361157] E
[glusterd-store.c:2476:glusterd_store_retrieve_volume] 0-: Unknown key:
brick-0
[2013-03-14 10:00:08.361200] E
[glusterd-store.c:2476:glusterd_store_retrieve_volume] 0-: Unknown key:
brick-1
[2013-03-14 10:00:08.362490] E
[glusterd-store.c:2476:glusterd_store_retrieve_volume] 0-: Unknown key:
brick-0
[2013-03-14 10:00:08.362522] E
[glusterd-store.c:2476:glusterd_store_retrieve_volume] 0-: Unknown key:
brick-1
[2013-03-14 10:00:08.362593] E
[glusterd-store.c:1554:glusterd_store_handle_retrieve] 0-glusterd:
Unable to retrieve store handle for
/var/lib/glusterd/vols/test1/bricks/2216.storage.domeniu.net:-bricks-test1,
error: No such file or directory
[2013-03-14 10:00:08.362615] E
[glusterd-store.c:2690:glusterd_store_retrieve_volumes] 0-: Unable to
restore volume: test1
[2013-03-14 10:00:08.362646] E [xlator.c:408:xlator_init] 0-management:
Initialization of volume 'management' failed, review your volfile again
[2013-03-14 10:00:08.362672] E [graph.c:292:glusterfs_graph_init]
0-management: initializing translator failed
[2013-03-14 10:00:08.362693] E [graph.c:479:glusterfs_graph_activate]
0-graph: init failed
[2013-03-14 10:00:08.362929] W [glusterfsd.c:970:cleanup_and_exit]
(-->/usr/sbin/glusterd(main+0x5b0) [0x406660]
(-->/usr/sbin/glusterd(glusterfs_volumes_init+0xb7) [0x4050b7]
(-->/usr/sbin/glusterd(glusterfs_process_volfp+0x103) [0x404fc3]))) 0-:
received signum (0), shutting down
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro