As highlighted in the last maintainers meeting that I'm seeing some log entries in the glusterd log file which are (a) informative logs in one way but can cause excessive logging and potentially may run an user with out of space issue (b) some logs might not be errors or be avoided.
Even though these logs are captured in glusterd.log file, but they don't originate from glusterd APIs. So request all of devs to go through the below. I will eventually convert this to a BZ to track this better, so this is a heads up for now.
I believe as a practice working on code changes, we need to look at the aspects of balancing out the log entries i.e. (a) don't log everything & (b) log only meaningful things.
===============================================================
[2018-09-10 03:55:19.236387] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/libgfrpc.so.0(rpc_clnt_reconnect+0xc2) [0x7ff7a83d0452] -->/usr/local/lib/glusterfs/4.2dev/rpc-transport/socket.so(+0x65b0) [0x7ff7a06cf5b0] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key transport.socket.ignore-enoent, integer type asked, has string type [Invalid argument] <== seen in volume start
[2018-09-10 03:55:21.583508] I [run.c:241:runner_log] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a) [0x7ff7a34d766a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c) [0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105) [0x7ff7a8651805] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=test-vol1 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd <== seen in volume start
[2018-09-10 03:55:13.647675] E [MSGID: 101191] [event-epoll.c:689:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch handler <== seen in almost all the volume operations
[2018-09-10 03:57:14.370861] E [MSGID: 106061] [glusterd-utils.c:10584:glusterd_max_opversion_use_rsp_dict] 0-management: Maximum supported op-version not set in destination dictionary
<=== seen while running gluster v get all all
[2018-09-10 03:58:24.307305] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307322] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307336] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307340] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307350] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307355] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307365] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307369] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307378] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
<=== seen while running gluster v get <volname> all, cloudsync xlator seems to be the culprit here.
[2018-09-10 05:00:16.082968] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/storage/posix.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.083388] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/trash.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084201] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changetimerecorder.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084597] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084917] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.085258] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086153] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086546] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086947] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.087273] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.088271] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.088800] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089004] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089245] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089491] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089684] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089967] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.090247] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.090433] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/decompounder.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093580] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093729] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093930] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094184] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094451] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094650] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094853] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095113] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095613] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095934] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096125] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096273] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096433] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096606] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096803] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changetimerecorder.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.084201] and [2018-09-10 05:00:16.100584]
[2018-09-10 05:00:16.100775] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.100978] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101105] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101257] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101398] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101525] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101688] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101852] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102043] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102164] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102315] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102467] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102633] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102800] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/decompounder.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.090433] and [2018-09-10 05:00:16.103150]
[2018-09-10 05:00:16.105005] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.105005] and [2018-09-10 05:00:16.105194]
[2018-09-10 05:00:16.105430] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105664] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/distribute.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105803] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/write-behind.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105904] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/read-ahead.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106041] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/readdir-ahead.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106160] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-cache.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106364] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/open-behind.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.096803] and [2018-09-10 05:00:16.106602]
[2018-09-10 05:00:16.107303] W [MSGID: 101095] [xlator.c:454:xlator_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/nfs/server.so: cannot open shared object file: No such file or directory
[2018-09-10 05:00:16.107435] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x93c6a) [0x7ff7a3499c6a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x9074c) [0x7ff7a349674c] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key graph-check, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.108476] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.108476] and [2018-09-10 05:00:16.109080]
[2018-09-10 05:00:16.109376] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.112484] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.145133] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xcebf4) [0x7ff7a34d4bf4] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x392e0) [0x7ff7a343f2e0] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key check-op-version, integer type asked, has unsigned integer type [Invalid argument]
[2018-09-10 05:00:16.145841] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/nfs/server.so: cannot open shared object file: No such file or directory
[2018-09-10 05:00:16.151513] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69) [0x7ff7a348cd69] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8f747) [0x7ff7a3495747] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key gfproxy-client, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.151613] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69) [0x7ff7a348cd69] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8fb6c) [0x7ff7a3495b6c] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key gfproxy-client, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.154023] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69) [0x7ff7a348cd69] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8fb8d) [0x7ff7a3495b8d] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key gfproxy-server, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.238162] I [run.c:241:runner_log] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a) [0x7ff7a34d766a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c) [0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105) [0x7ff7a8651805] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S30samba-set.sh --volname=test-vol1 -o barrier=on --gd-workdir=/var/lib/glusterd
[2018-09-10 05:00:16.257676] I [run.c:241:runner_log] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a) [0x7ff7a34d766a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c) [0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105) [0x7ff7a8651805] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh --volname=test-vol1 -o barrier=on --gd-workdir=/var/lib/glusterd
[2018-09-10 05:00:16.335118] E [MSGID: 101191] [event-epoll.c:689:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch handler
<== all the above snippets for only one volume set operation
[2018-09-10 03:55:21.583508] I [run.c:241:runner_log] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a) [0x7ff7a34d766a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c) [0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105) [0x7ff7a8651805] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/start/post/S29CTDBsetup.sh --volname=test-vol1 --first=yes --version=1 --volume-op=start --gd-workdir=/var/lib/glusterd <== seen in volume start
[2018-09-10 03:55:13.647675] E [MSGID: 101191] [event-epoll.c:689:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch handler <== seen in almost all the volume operations
[2018-09-10 03:57:14.370861] E [MSGID: 106061] [glusterd-utils.c:10584:glusterd_max_opversion_use_rsp_dict] 0-management: Maximum supported op-version not set in destination dictionary
<=== seen while running gluster v get all all
[2018-09-10 03:58:24.307305] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307322] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307336] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307340] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307350] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307355] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307365] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
[2018-09-10 03:58:24.307369] E [MSGID: 106434] [glusterd-utils.c:13301:glusterd_get_value_for_vme_entry] 0-management: xlator_volopt_dynload error (-1)
[2018-09-10 03:58:24.307378] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/features/cloudsync.so: cannot open shared object file: No such file or directory
<=== seen while running gluster v get <volname> all, cloudsync xlator seems to be the culprit here.
[2018-09-10 05:00:16.082968] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/storage/posix.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.083388] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/trash.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084201] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changetimerecorder.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084597] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.084917] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.085258] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086153] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086546] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.086947] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.087273] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.088271] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.088800] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089004] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089245] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089491] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089684] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.089967] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.090247] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.090433] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/decompounder.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093580] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093729] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.093930] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094184] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094451] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094650] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.094853] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095113] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095613] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.095934] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096125] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096273] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096433] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096606] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.096803] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changetimerecorder.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.084201] and [2018-09-10 05:00:16.100584]
[2018-09-10 05:00:16.100775] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/changelog.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.100978] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/bitrot-stub.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101105] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/access-control.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101257] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/locks.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101398] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/worm.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101525] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/read-only.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101688] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/leases.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.101852] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/upcall.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102043] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-threads.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102164] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/selinux.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102315] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/marker.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102467] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/barrier.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102633] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/index.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.102800] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/features/quota.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/decompounder.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.090433] and [2018-09-10 05:00:16.103150]
[2018-09-10 05:00:16.105005] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.105005] and [2018-09-10 05:00:16.105194]
[2018-09-10 05:00:16.105430] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105664] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/distribute.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105803] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/write-behind.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.105904] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/read-ahead.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106041] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/readdir-ahead.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106160] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/io-cache.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.106364] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/performance/open-behind.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.096803] and [2018-09-10 05:00:16.106602]
[2018-09-10 05:00:16.107303] W [MSGID: 101095] [xlator.c:454:xlator_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/nfs/server.so: cannot open shared object file: No such file or directory
[2018-09-10 05:00:16.107435] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x93c6a) [0x7ff7a3499c6a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x9074c) [0x7ff7a349674c] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key graph-check, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.108476] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols
The message "I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/protocol/client.so: undefined symbol: xlator_api. Fall back to old symbols" repeated 2 times between [2018-09-10 05:00:16.108476] and [2018-09-10 05:00:16.109080]
[2018-09-10 05:00:16.109376] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/cluster/replicate.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.112484] I [MSGID: 101097] [xlator.c:334:xlator_dynload_newway] 0-xlator: dlsym(xlator_api) on /usr/local/lib/glusterfs/4.2dev/xlator/debug/io-stats.so: undefined symbol: xlator_api. Fall back to old symbols
[2018-09-10 05:00:16.145133] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xcebf4) [0x7ff7a34d4bf4] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x392e0) [0x7ff7a343f2e0] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key check-op-version, integer type asked, has unsigned integer type [Invalid argument]
[2018-09-10 05:00:16.145841] W [MSGID: 101095] [xlator.c:181:xlator_volopt_dynload] 0-xlator: /usr/local/lib/glusterfs/4.2dev/xlator/nfs/server.so: cannot open shared object file: No such file or directory
[2018-09-10 05:00:16.151513] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69) [0x7ff7a348cd69] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8f747) [0x7ff7a3495747] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key gfproxy-client, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.151613] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69) [0x7ff7a348cd69] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8fb6c) [0x7ff7a3495b6c] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key gfproxy-client, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.154023] I [dict.c:2838:dict_get_str_boolean] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x86d69) [0x7ff7a348cd69] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0x8fb8d) [0x7ff7a3495b8d] -->/usr/local/lib/libglusterfs.so.0(dict_get_str_boolean+0xcf) [0x7ff7a85fc58f] ) 0-dict: key gfproxy-server, integer type asked, has string type [Invalid argument]
[2018-09-10 05:00:16.238162] I [run.c:241:runner_log] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a) [0x7ff7a34d766a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c) [0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105) [0x7ff7a8651805] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S30samba-set.sh --volname=test-vol1 -o barrier=on --gd-workdir=/var/lib/glusterd
[2018-09-10 05:00:16.257676] I [run.c:241:runner_log] (-->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd166a) [0x7ff7a34d766a] -->/usr/local/lib/glusterfs/4.2dev/xlator/mgmt/glusterd.so(+0xd119c) [0x7ff7a34d719c] -->/usr/local/lib/libglusterfs.so.0(runner_log+0x105) [0x7ff7a8651805] ) 0-management: Ran script: /var/lib/glusterd/hooks/1/set/post/S32gluster_enable_shared_storage.sh --volname=test-vol1 -o barrier=on --gd-workdir=/var/lib/glusterd
[2018-09-10 05:00:16.335118] E [MSGID: 101191] [event-epoll.c:689:event_dispatch_epoll_worker] 0-epoll: Failed to dispatch handler
<== all the above snippets for only one volume set operation
_______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-devel
