i forgot - here are logs from client: [2011-05-04 12:24:16.512829] I [client3_1-fops.c:2228:client3_1_lookup_cbk] 0-macm03-client-0: remote operation failed: Stale NFS file handle [2011-05-04 12:24:16.513308] W [afr-common.c:634:afr_lookup_self_heal_check] 0-macm03-replicate-0: /videos12/30007: gfid different on subvolume [2011-05-04 12:24:16.528145] I [afr-common.c:680:afr_lookup_done] 0-macm03-replicate-0: entries are missing in lookup of /videos12/30007/data. [2011-05-04 12:24:16.528180] I [afr-common.c:735:afr_lookup_done] 0-macm03-replicate-0: background meta-data data entry self-heal triggered. path: /videos12/30007/data [2011-05-04 12:24:16.528838] I [client3_1-fops.c:1303:client3_1_entrylk_cbk] 0-macm03-client-0: remote operation failed: No such file or directory [2011-05-04 12:24:16.529087] I [afr-self-heal-common.c:1387:afr_sh_post_nonblocking_entrylk_cbk] 0-macm03-replicate-0: Non blocking entrylks failed. [2011-05-04 12:24:16.529835] I [client3_1-fops.c:1226:client3_1_inodelk_cbk] 0-macm03-client-0: remote operation failed: No such file or directory [2011-05-04 12:24:16.530833] I [client3_1-fops.c:1303:client3_1_entrylk_cbk] 0-macm03-client-0: remote operation failed: No such file or directory [2011-05-04 12:24:16.531033] I [afr-self-heal-entry.c:2265:afr_sh_post_nonblocking_entry_cbk] 0-macm03-replicate-0: Non Blocking entrylks failed. [2011-05-04 12:24:16.531883] I [client3_1-fops.c:2132:client3_1_opendir_cbk] 0-macm03-client-0: remote operation failed: No such file or directory [2011-05-04 12:24:16.531983] W [client3_1-fops.c:5158:client3_1_readdirp] 0-macm03-client-0: (452919321): failed to get fd ctx. EBADFD [2011-05-04 12:24:16.532008] W [client3_1-fops.c:5222:client3_1_readdirp] 0-macm03-client-0: failed to send the fop: File descriptor in bad state [2011-05-04 12:24:16.532030] W [fuse-bridge.c:2089:fuse_readdir_cbk] 0-glusterfs-fuse: 193: READDIR => -1 (File descriptor in bad state) Am 04.05.2011 12:02, schrieb Christopher Anderlik: > hello. > > I can confirm that with the new generated volfiles there don't rise any zero-byte-files any more. > > but we still have the problem, that we get following error when listing some directories: > > dir videos12/30007/data > /bin/ls: reading directory videos12/30007/data: File descriptor in bad state > > > but we can access files in this directory: > > dir videos12/30007/data/4a9e531ea3630_1251889950.flv > -rw-r--r-- 1 lighttpd lighttpd 194728574 Sep 2 2009 videos12/30007/data/4a9e531ea3630_1251889950.flv > > > > > do you have any idea? > the directory exists on both gfs-servers. > > > > here are the logs from gfs-server: > > > [2011-05-04 11:59:23.812650] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve+0x70) > [0x7f720ba8176e] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve_entry+0x4a) > [0x7f720ba81458] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:23.812810] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_cbk+0x4a0) > [0x7f720ba80a2a] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_continue+0x85) > [0x7f720ba804db] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:23.813224] I [server3_1-fops.c:340:server_entrylk_cbk] 0-macm03-server: 280: > INODELK /videos12/30007 (0) ==> -1 (No such file or directory) > [2011-05-04 11:59:23.814300] I [server3_1-fops.c:259:server_inodelk_cbk] 0-macm03-server: 281: > INODELK /videos12/30007/data (0) ==> -1 (No such file or directory) > [2011-05-04 11:59:23.815305] I [server3_1-fops.c:340:server_entrylk_cbk] 0-macm03-server: 282: > INODELK /videos12/30007/data (0) ==> -1 (No such file or directory) > [2011-05-04 11:59:23.816436] I [server3_1-fops.c:647:server_opendir_cbk] 0-macm03-server: 283: > OPENDIR /videos12/30007/data (0) ==> -1 (No such file or directory) > > > > > > [2011-05-04 11:59:34.125841] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve+0x70) > [0x7f720ba8176e] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve_entry+0x4a) > [0x7f720ba81458] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:34.126065] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_cbk+0x4a0) > [0x7f720ba80a2a] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_continue+0x85) > [0x7f720ba804db] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:34.126944] I [server3_1-fops.c:340:server_entrylk_cbk] 0-macm03-server: 289: > INODELK /videos12/30007 (0) ==> -1 (No such file or directory) > [2011-05-04 11:59:34.127460] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data (INODELK) > [2011-05-04 11:59:34.128261] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve+0x70) > [0x7f720ba8176e] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve_entry+0x4a) > [0x7f720ba81458] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:34.128379] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_cbk+0x4a0) > [0x7f720ba80a2a] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_continue+0x85) > [0x7f720ba804db] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:34.129191] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data (SETATTR) > [2011-05-04 11:59:34.129704] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data (SETXATTR) > [2011-05-04 11:59:34.130734] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data (INODELK) > [2011-05-04 11:59:34.131247] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data (ENTRYLK) > [2011-05-04 11:59:34.131831] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve+0x70) > [0x7f720ba8176e] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(server_resolve_entry+0x4a) > [0x7f720ba81458] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:34.131994] W [inode.c:647:inode_grep] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_cbk+0x4a0) > [0x7f720ba80a2a] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_deep_continue+0x85) > [0x7f720ba804db] > (-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(resolve_entry_simple+0xc0) > [0x7f720ba811fb]))) 0-: table || parent || name not found > [2011-05-04 11:59:34.132292] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data (OPENDIR) > [2011-05-04 11:59:34.137423] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4a9e53bf50437_1251890111.flv (LOOKUP) > [2011-05-04 11:59:34.137468] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4c5186f6ca3c2_1280411382.mp4 (LOOKUP) > [2011-05-04 11:59:34.137510] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4a9e5347897d2_1251889991.flv (LOOKUP) > [2011-05-04 11:59:34.137734] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4c5186f834d76_1280411384.mp4 (LOOKUP) > [2011-05-04 11:59:34.137788] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4c7ce2a4a8306.mp4 (LOOKUP) > [2011-05-04 11:59:34.137823] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4a9e53bfbe9eb_1251890111.flv (LOOKUP) > [2011-05-04 11:59:34.137854] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4c5186f9512db_1280411385.mp4 (LOOKUP) > [2011-05-04 11:59:34.137898] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4a9e536c4f504_1251890028.wmv (LOOKUP) > [2011-05-04 11:59:34.138349] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4c7cdd30ad7cc.mp4 (LOOKUP) > [2011-05-04 11:59:34.138396] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4c5186f7c463b_1280411383.mp4 (LOOKUP) > [2011-05-04 11:59:34.138430] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data/4a9e531ea3630_1251889950.flv (LOOKUP) > [2011-05-04 11:59:34.140822] I [server-resolve.c:580:server_resolve] 0-macm03-server: pure path > resolution for /videos12/30007/data (ENTRYLK) > [2011-05-04 11:59:34.142000] I [server3_1-fops.c:647:server_opendir_cbk] 0-macm03-server: 313: > OPENDIR /videos12/30007/data (0) ==> -1 (No such file or directory) > [2011-05-04 11:59:34.143506] I [server3_1-fops.c:340:server_entrylk_cbk] 0-macm03-server: 314: > INODELK /videos12/30007/data (0) ==> -1 (No such file or directory) > > > > > > > > > > > thank you very much! > christopher > > > > > > > > > > Am 03.05.2011 18:28, schrieb Christopher Anderlik: >> you are right. >> our first tests with new generated volfiles are very good. >> >> you are my hero ;-) >> >> thanks!! >> >> christopher >> >> >> >> >> >> Am 03.05.2011 17:38, schrieb Mohammed Junaid Ahmed: >>> To make use of the new features provided in 3.2, yes you must update the volfiles. Thanks for >>> pointing it out, we will include it in the Documentation. >>> >>> ----- Original Message ----- >>>> From: "Whit Blauvelt"<whit.gluster at transpect.com> >>>> To: "Christopher Anderlik"<christopher.anderlik at xidras.com> >>>> Cc: "Mohammed Junaid Ahmed"<junaid at gluster.com>, gluster-users at gluster.org >>>> Sent: Tuesday, May 3, 2011 8:57:35 PM >>>> Subject: Re: strange behavior with glusterfs 3.2.0 >>>> On Tue, May 03, 2011 at 10:39:57AM +0200, Christopher Anderlik wrote: >>>> >>>>> The volfile was generated in 3.1.x - we only upgraded server and >>>>> client but did not generate new volfiles. >>>> >>>> I take it this means when I upgrade from 3.1.14 to 3.2 I should >>>> generate new >>>> volfiles? Is there a best procedure for doing that? I see nothing in >>>> the >>>> documentation about 3.1 to 3.2 upgrade procedure. >>>> >>>> Thanks, >>>> Whit >>> >> > -- Mag. Christopher Anderlik Leiter Technik ________________________________________________________________________________ Xidras GmbH Stockern 47 3744 Stockern Austria Tel: 0043 2983 201 30 5 01 Fax: 0043 2983 201 30 5 01 9 Email: christopher.anderlik at xidras.com Web: http://www.xidras.com FN 317036 f | Landesgericht Krems | ATU64485024 ________________________________________________________________________________ VERTRAULICHE INFORMATIONEN! Diese eMail enth?lt vertrauliche Informationen und ist nur f?r den berechtigten Empf?nger bestimmt. Wenn diese eMail nicht f?r Sie bestimmt ist, bitten wir Sie, diese eMail an uns zur?ckzusenden und anschlie?end auf Ihrem Computer und Mail-Server zu l?schen. Solche eMails und Anlagen d?rfen Sie weder nutzen, noch verarbeiten oder Dritten zug?nglich machen, gleich in welcher Form. Wir danken f?r Ihre Kooperation! CONFIDENTIAL! This email contains confidential information and is intended for the authorised recipient only. If you are not an authorised recipient, please return the email to us and then delete it from your computer and mail-server. You may neither use nor edit any such emails including attachments, nor make them accessible to third parties in any manner whatsoever. Thank you for your cooperation ________________________________________________________________________________
