Hi Xavi,
what happens is that Nova cannot create the file structure which is needed in order to create the virtual machine.
In /var/lib/nova/instances, I can find only one directory under a casual name (random), for example ca095fd4-1c0c-4fb4-a2d8-a0d758 6c0ffa. If I try to list the content, the command fails and never comes back. The shell freezes.
By the way, I try to find out some more verbous logs and to update the spftware to 3.6.2. In this case, should I unistall 3.6.1. and install it again?
El Martes 27 de enero de 2015 12:14, Xavier Hernandez <xhernandez@xxxxxxxxxx> escribió:
Hi Pedro,
do you get any specific error ?
From logs, the only thing I see is a warning about a GFID not being
available. This can cause troubles, but I'm not sure if this is the problem.
Anyway, version 3.6.2 has some fixes that improve on this. Is it
possible for you to try the newer version ?
Xavi
On 01/27/2015 11:25 AM, Pedro Serotto wrote:
> Dear all,
> I try the disperse volume on 3 node cluster, but my instances never build.
>
> This is the log:
>
> root@node-1:/var/log/glusterfs# tail -f var-lib-nova-instances.log
> [2015-01-27 10:03:11.510702] I
> [client-handshake.c:1415:select_server_supported_programs]
> 0-nova-vm-client-1: Using Program GlusterFS 3.3, Num (1298437), Version
> (330)
> [2015-01-27 10:03:11.511052] I
> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-2:
> Connected to nova-vm-client-2, attached to remote volume '/data/nova'.
> [2015-01-27 10:03:11.511074] I
> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-2:
> Server and Client lk-version numbers are not same, reopening the fds
> [2015-01-27 10:03:11.511783] I
> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-1:
> Connected to nova-vm-client-1, attached to remote volume '/data/nova'.
> [2015-01-27 10:03:11.511806] I
> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-1:
> Server and Client lk-version numbers are not same, reopening the fds
> [2015-01-27 10:03:11.512464] I [ec.c:205:ec_up] 0-nova-vm-disperse-0:
> Going UP
> [2015-01-27 10:03:11.520391] I [fuse-bridge.c:5080:fuse_graph_setup]
> 0-fuse: switched to graph 0
> [2015-01-27 10:03:11.520660] I
> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-1:
> Server lk version = 1
> [2015-01-27 10:03:11.520680] I
> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-2:
> Server lk version = 1
> [2015-01-27 10:03:11.520941] I [fuse-bridge.c:4009:fuse_init]
> 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22
> kernel 7.17
>
>
>
> ------------>>>> nova boot --flavor 1 --image
> 4f31cf1b-3cff-470e-8533-0792c0e805d5 test-vm
>
>
>
>
> [2015-01-27 10:04:38.002739] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.009403] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.019634] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.025431] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.029552] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.040237] I
> [dht-selfheal.c:1065:dht_selfheal_layout_new_directory] 0-nova-vm-dht:
> chunk size = 0xffffffff / 20458 = 0x33414
> [2015-01-27 10:04:38.040343] I
> [dht-selfheal.c:1103:dht_selfheal_layout_new_directory] 0-nova-vm-dht:
> assigning range size 0xffffc648 to nova-vm-disperse-0
> [2015-01-27 10:04:38.045521] I [MSGID: 109036]
> [dht-common.c:6221:dht_log_new_layout_for_dir_selfheal] 0-nova-vm-dht:
> Setting layout of /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa with
> [Subvol_name: nova-vm-disperse-0, Err: -1 , Start: 0 , Stop: 4294967295 ],
> [2015-01-27 10:04:38.057391] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.062147] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.068511] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.072586] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.076411] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.082613] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.config
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.086569] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.089969] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.093946] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.096379] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.123688] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.127440] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.131979] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.136525] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.143846] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.159679] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.162102] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.175625] I [dht-rename.c:1344:dht_rename]
> 0-nova-vm-dht: renaming
> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp
> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0) =>
> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0)
>
> where am I wrong?
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users@xxxxxxxxxxx
> http://www.gluster.org/mailman/listinfo/gluster-users
>
do you get any specific error ?
From logs, the only thing I see is a warning about a GFID not being
available. This can cause troubles, but I'm not sure if this is the problem.
Anyway, version 3.6.2 has some fixes that improve on this. Is it
possible for you to try the newer version ?
Xavi
On 01/27/2015 11:25 AM, Pedro Serotto wrote:
> Dear all,
> I try the disperse volume on 3 node cluster, but my instances never build.
>
> This is the log:
>
> root@node-1:/var/log/glusterfs# tail -f var-lib-nova-instances.log
> [2015-01-27 10:03:11.510702] I
> [client-handshake.c:1415:select_server_supported_programs]
> 0-nova-vm-client-1: Using Program GlusterFS 3.3, Num (1298437), Version
> (330)
> [2015-01-27 10:03:11.511052] I
> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-2:
> Connected to nova-vm-client-2, attached to remote volume '/data/nova'.
> [2015-01-27 10:03:11.511074] I
> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-2:
> Server and Client lk-version numbers are not same, reopening the fds
> [2015-01-27 10:03:11.511783] I
> [client-handshake.c:1200:client_setvolume_cbk] 0-nova-vm-client-1:
> Connected to nova-vm-client-1, attached to remote volume '/data/nova'.
> [2015-01-27 10:03:11.511806] I
> [client-handshake.c:1212:client_setvolume_cbk] 0-nova-vm-client-1:
> Server and Client lk-version numbers are not same, reopening the fds
> [2015-01-27 10:03:11.512464] I [ec.c:205:ec_up] 0-nova-vm-disperse-0:
> Going UP
> [2015-01-27 10:03:11.520391] I [fuse-bridge.c:5080:fuse_graph_setup]
> 0-fuse: switched to graph 0
> [2015-01-27 10:03:11.520660] I
> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-1:
> Server lk version = 1
> [2015-01-27 10:03:11.520680] I
> [client-handshake.c:188:client_set_lk_version_cbk] 0-nova-vm-client-2:
> Server lk version = 1
> [2015-01-27 10:03:11.520941] I [fuse-bridge.c:4009:fuse_init]
> 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.22
> kernel 7.17
>
>
>
> ------------>>>> nova boot --flavor 1 --image
> 4f31cf1b-3cff-470e-8533-0792c0e805d5 test-vm
>
>
>
>
> [2015-01-27 10:04:38.002739] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.009403] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.019634] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.025431] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.029552] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa missing on
> subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.040237] I
> [dht-selfheal.c:1065:dht_selfheal_layout_new_directory] 0-nova-vm-dht:
> chunk size = 0xffffffff / 20458 = 0x33414
> [2015-01-27 10:04:38.040343] I
> [dht-selfheal.c:1103:dht_selfheal_layout_new_directory] 0-nova-vm-dht:
> assigning range size 0xffffc648 to nova-vm-disperse-0
> [2015-01-27 10:04:38.045521] I [MSGID: 109036]
> [dht-common.c:6221:dht_log_new_layout_for_dir_selfheal] 0-nova-vm-dht:
> Setting layout of /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa with
> [Subvol_name: nova-vm-disperse-0, Err: -1 , Start: 0 , Stop: 4294967295 ],
> [2015-01-27 10:04:38.057391] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.062147] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.068511] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.072586] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.076411] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.082613] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.config
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.086569] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.089969] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.093946] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/console.log
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.096379] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.123688] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.127440] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /instance-00000023 missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.131979] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.136525] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.143846] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.159679] I [dht-common.c:1822:dht_lookup_cbk]
> 0-nova-vm-dht: Entry /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp
> missing on subvol nova-vm-disperse-0
> [2015-01-27 10:04:38.162102] W [ec-helpers.c:501:ec_loc_prepare]
> 0-nova-vm-disperse-0: GFID not available for inode
> [2015-01-27 10:04:38.175625] I [dht-rename.c:1344:dht_rename]
> 0-nova-vm-dht: renaming
> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info.tmp
> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0) =>
> /ca095fd4-1c0c-4fb4-a2d8-a0d7586c0ffa/disk.info
> (hash=nova-vm-disperse-0/cache=nova-vm-disperse-0)
>
> where am I wrong?
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users@xxxxxxxxxxx
> http://www.gluster.org/mailman/listinfo/gluster-users
>
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-users
