Hi,
I'm trying to host several GlusterFS versions
on the same machine (3.8.8, 4.1.6 and 5.2), not to be ran
together of course.
I built them with the following procedure
(examples with 3.8.8):
git clone
https://github.com/gluster/glusterfs .
git checkout v3.8.8
./autogen
./configure --program-suffix="-3.8.8"
make
sudo make install
sudo cp -a extras/systemd/glusterd.service
/etc/systemd/system/glusterd-3.8.8.service
sudo systemctl load glusterd-3.8.8
I had to edit the service for it to execute the right version
of glusterd:
ExecStart=/usr/local/sbin/glusterd-3.8.8
-p /var/run/glusterd.pid --log-level $LOG_LEVEL
$GLUSTERD_OPTIONS
And I had to create symlinks for glusterd:
cd /usr/local/sbin
ln -s glusterd-3.8.8 glusterfsd-3.8.8
I also ran ldconfig for good mesure...
sudo ldconfig
When I run glusterd in the foreground (not
even with systemd) I'm left with some errors and the process
exits (errors emphasized):
user@host0:~/glusterfs-3.8.8 on
e5f3a990c [!☡]# sudo glusterd-3.8.8 --debug
[2019-01-01 16:23:37.120684] I [MSGID: 100030]
[glusterfsd.c:2454:main] 0-glusterd-3.8.8: Started running
glusterd-3.8.8 version 3.8.8 (args: glusterd-3.8.8 --debug)
[2019-01-01 16:23:37.120765] D
[logging.c:1791:__gf_log_inject_timer_event]
0-logging-infra: Starting timer now. Timeout = 120, current
buf size = 5
[2019-01-01 16:23:37.121187] D [MSGID: 0]
[glusterfsd.c:660:get_volfp] 0-glusterfsd: loading volume
file /usr/local/etc/glusterfs/glusterd.vol
[2019-01-01 16:23:37.137003] I [MSGID: 106478]
[glusterd.c:1379:init] 0-management: Maximum allowed open
file descriptors set to 65536
[2019-01-01 16:23:37.137064] I [MSGID: 106479]
[glusterd.c:1428:init] 0-management: Using /var/lib/glusterd
as working directory
[2019-01-01 16:23:37.137262] D [MSGID: 0]
[glusterd.c:406:glusterd_rpcsvc_options_build] 0-glusterd:
listen-backlog value: 128
[2019-01-01 16:23:37.137683] D [rpcsvc.c:2316:rpcsvc_init]
0-rpc-service: RPC service inited.
[2019-01-01 16:23:37.137723] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2019-01-01 16:23:37.137798] D
[rpc-transport.c:283:rpc_transport_load] 0-rpc-transport:
attempt to load file
/usr/local/lib/glusterfs/3.8.8/rpc-transport/socket.so
[2019-01-01 16:23:37.151778] D [socket.c:3938:socket_init]
0-socket.management: Configued transport.tcp-user-timeout=0
[2019-01-01 16:23:37.151823] D [socket.c:4021:socket_init]
0-socket.management: SSL support on the I/O path is NOT
enabled
[2019-01-01 16:23:37.151862] D [socket.c:4024:socket_init]
0-socket.management: SSL support for glusterd is NOT enabled
[2019-01-01 16:23:37.151890] D [socket.c:4041:socket_init]
0-socket.management: using system polling thread
[2019-01-01 16:23:37.151927] D
[name.c:584:server_fill_address_family] 0-socket.management:
option address-family not specified, defaulting to inet
[2019-01-01 16:23:37.152173] D
[rpc-transport.c:283:rpc_transport_load] 0-rpc-transport:
attempt to load file
/usr/local/lib/glusterfs/3.8.8/rpc-transport/rdma.so
[2019-01-01 16:23:37.155510] D
[rpc-transport.c:321:rpc_transport_load] 0-rpc-transport:
dlsym (gf_rpc_transport_reconfigure) on
/usr/local/lib/glusterfs/3.8.8/rpc-transport/rdma.so:
undefined symbol: reconfigure
[2019-01-01 16:23:37.155830] W [MSGID: 103071]
[rdma.c:4589:__gf_rdma_ctx_create] 0-rpc-transport/rdma:
rdma_cm event channel creation failed [No such device]
[2019-01-01 16:23:37.155884] W [MSGID: 103055]
[rdma.c:4896:init] 0-rdma.management: Failed to initialize
IB Device
[2019-01-01 16:23:37.155920] W
[rpc-transport.c:354:rpc_transport_load] 0-rpc-transport:
'rdma' initialization failed
[2019-01-01 16:23:37.156224] W
[rpcsvc.c:1638:rpcsvc_create_listener] 0-rpc-service: cannot
create listener, initing the transport failed
[2019-01-01 16:23:37.156258] E [MSGID: 106243]
[glusterd.c:1652:init] 0-management: creation of 1
listeners failed, continuing with succeeded transport
[2019-01-01 16:23:37.156300] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: GlusterD svc peer, Num: 1238437, Ver: 2,
Port: 0
[2019-01-01 16:23:37.156332] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: GlusterD svc cli read-only, Num:
1238463, Ver: 2, Port: 0
[2019-01-01 16:23:37.156356] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: GlusterD svc mgmt, Num: 1238433, Ver: 2,
Port: 0
[2019-01-01 16:23:37.156384] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: GlusterD svc mgmt v3, Num: 1238433, Ver:
3, Port: 0
[2019-01-01 16:23:37.156414] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: Gluster Portmap, Num: 34123456, Ver: 1,
Port: 0
[2019-01-01 16:23:37.156438] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: Gluster Handshake, Num: 14398633, Ver:
2, Port: 0
[2019-01-01 16:23:37.156468] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: Gluster MGMT Handshake, Num: 1239873,
Ver: 1, Port: 0
[2019-01-01 16:23:37.156591] D [rpcsvc.c:2316:rpcsvc_init]
0-rpc-service: RPC service inited.
[2019-01-01 16:23:37.156619] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: GF-DUMP, Num: 123451501, Ver: 1, Port: 0
[2019-01-01 16:23:37.156665] D
[rpc-transport.c:283:rpc_transport_load] 0-rpc-transport:
attempt to load file
/usr/local/lib/glusterfs/3.8.8/rpc-transport/socket.so
[2019-01-01 16:23:37.156854] D [socket.c:3887:socket_init]
0-socket.management: disabling nodelay
[2019-01-01 16:23:37.156882] D [socket.c:3938:socket_init]
0-socket.management: Configued transport.tcp-user-timeout=0
[2019-01-01 16:23:37.156912] D [socket.c:4021:socket_init]
0-socket.management: SSL support on the I/O path is NOT
enabled
[2019-01-01 16:23:37.156933] D [socket.c:4024:socket_init]
0-socket.management: SSL support for glusterd is NOT enabled
[2019-01-01 16:23:37.156961] D [socket.c:4041:socket_init]
0-socket.management: using system polling thread
[2019-01-01 16:23:37.157095] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: GlusterD svc cli, Num: 1238463, Ver: 2,
Port: 0
[2019-01-01 16:23:37.157125] D
[rpcsvc.c:1866:rpcsvc_program_register] 0-rpc-service: New
program registered: Gluster Handshake (CLI Getspec), Num:
14398633, Ver: 2, Port: 0
[2019-01-01 16:23:37.157282] D [MSGID: 0]
[glusterd-utils.c:6379:glusterd_sm_tr_log_init] 0-glusterd:
returning 0
[2019-01-01 16:23:37.157318] D [MSGID: 0]
[glusterd.c:1720:init] 0-management: cannot get
run-with-valgrind value
[2019-01-01 16:23:37.170633] E [MSGID: 106229]
[glusterd.c:455:glusterd_check_gsync_present] 0-glusterd:
geo-replication module not working as desired
[2019-01-01 16:23:37.171476] D [MSGID: 0]
[glusterd.c:465:glusterd_check_gsync_present] 0-glusterd:
Returning -1
[2019-01-01 16:23:37.171572] E [MSGID: 101019]
[xlator.c:433:xlator_init] 0-management: Initialization of
volume 'management' failed, review your volfile again
[2019-01-01 16:23:37.171613] E [MSGID: 101066]
[graph.c:324:glusterfs_graph_init] 0-management:
initializing translator failed
[2019-01-01 16:23:37.171649] E [MSGID: 101176]
[graph.c:673:glusterfs_graph_activate] 0-graph: init
failed
[2019-01-01 16:23:37.173130] D
[logging.c:1765:gf_log_flush_extra_msgs] 0-logging-infra:
Log buffer size reduced. About to flush 5 extra log messages
[2019-01-01 16:23:37.173187] D
[logging.c:1768:gf_log_flush_extra_msgs] 0-logging-infra:
Just flushed 5 extra log messages
[2019-01-01 16:23:37.173280] W [MSGID: 100032]
[glusterfsd.c:1327:cleanup_and_exit] 0-: received signum
(1), shutting down
[2019-01-01 16:23:37.173335] D
[glusterfsd-mgmt.c:2385:glusterfs_mgmt_pmap_signout]
0-fsd-mgmt: portmapper signout arguments not given
I can't pin what particular error caused the
process to exit and I failed findind informations on the
'management' volume fail... any hints?
Thanks,
Raphael.
