Avati,
I saw your log and there is nothing suspicious in it. Are you sure the log captures the event where 'getcwd' returned a failure?
Yes, I am.
Can you also return the output of 'ls -lR of the data set' (from a dir level above) along with the getcwd and capture trace nfs logs from the full session? [and keep the trace nfs logs restricted to just these commands].
please find attached. Regards, Tomo (2012/06/20 13:17), Anand Avati wrote:
Tomosaki, I saw your log and there is nothing suspicious in it. Are you sure the log captures the event where 'getcwd' returned a failure? Can you also return the output of 'ls -lR of the data set' (from a dir level above) along with the getcwd and capture trace nfs logs from the full session? [and keep the trace nfs logs restricted to just these commands]. Thanks! Avati On Tue, Jun 19, 2012 at 7:20 PM, Tomoaki Sato <tsato@xxxxxxxxxxxxx <mailto:tsato@xxxxxxxxxxxxx>> wrote: Vijay, Thank you for your attention to this matter. I could not find strace command on the ESXi hosts. CentOS version of strace command says "strace+ ptrace(PTRACE_TRACEME, ...): Function not implemented" on the ESXi host. Please find attached log file. This log file is smaller than the previous version and covers only the 'getcwd' period. Regards, Tomo (2012/06/20 10:51), Vijay Bellur wrote: On 06/18/2012 11:55 PM, Tomoaki Sato wrote: Vijay, please find attached test program and log file. test-code: $ cat getcwd.c #include <stdio.h> #include <unistd.h> int main(int argc, char* argv[]) { char cwd[1024]; if ( argc != 2 ) { printf("usage: %s dir\n", argv[0]); _exit(1); } if ( chdir(argv[1]) != 0 ) { perror("chdir"); _exit(1); } if ( getcwd(cwd, 1024) == NULL ) { perror("getcwd"); _exit(1); } printf("%s\n", getcwd(cwd, 1024)); _exit(0); } operations: ~ # ./getcwd /vmfs/volumes/1668aab4-__a78e64bd/foo getcwd: No such file or directory ~ # Thanks for providing this test program. Can you please provide the output of strace -f ./getcwd /vmfs/volumes/1668aab4-__a78e64bd/foo and the corresponding nfs log file? -Vijay _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxx <mailto:Gluster-devel@xxxxxxxxxx> https://lists.nongnu.org/mailman/listinfo/gluster-devel
~ # sleep 30; ls -lR /vmfs/volumes/1668aab4-a78e64bd /vmfs/volumes/1668aab4-a78e64bd: drwxr-xr-x 1 root root 4096 Jun 19 06:41 foo /vmfs/volumes/1668aab4-a78e64bd/foo: ~ #
[2012-06-20 13:22:22.381246] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.381318] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.381339] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d77785f, Ver: 2, Program: 100003, ProgVers: 3, Proc: 1) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.381363] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.381383] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - GETATTR [2012-06-20 13:22:22.381412] D [nfs3-helpers.c:1627:nfs3_log_common_call] 0-nfs-nfsv3: XID: 3d77785f, GETATTR: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c [2012-06-20 13:22:22.381435] T [nfs3.c:811:nfs3_getattr] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.381457] T [nfs3-helpers.c:3726:nfs3_fh_resolve_inode] 0-nfs-nfsv3: FH needs inode resolution [2012-06-20 13:22:22.381477] T [nfs3-helpers.c:3535:nfs3_fh_resolve_inode_done] 0-nfs-nfsv3: FH inode resolved [2012-06-20 13:22:22.381501] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.381519] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.381535] T [nfs-fops.c:428:nfs_fop_stat] 0-nfs: Stat: /baz [2012-06-20 13:22:22.381554] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.381572] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.381602] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.381626] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 88, payload: 20, rpc hdr: 68 [2012-06-20 13:22:22.381690] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12324x Program: GlusterFS 3.1, ProgVers: 330, Proc: 1) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.382172] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12324x Program: GlusterFS 3.1, ProgVers: 330, Proc: 1) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.382211] D [nfs3-helpers.c:3389:nfs3_log_common_res] 0-nfs-nfsv3: XID: 3d77785f, GETATTR: NFS: 0(Call completed successfully.), POSIX: 0(Success) [2012-06-20 13:22:22.382240] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 88 [2012-06-20 13:22:22.382262] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 112, payload: 88, rpc hdr: 24 [2012-06-20 13:22:22.382305] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239775x, Program: NFS3, ProgVers: 3, Proc: 1) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.382579] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.382609] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.382628] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777860, Ver: 2, Program: 100003, ProgVers: 3, Proc: 4) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.382648] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.382667] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - ACCESS [2012-06-20 13:22:22.382691] D [nfs3-helpers.c:1627:nfs3_log_common_call] 0-nfs-nfsv3: XID: 3d777860, ACCESS: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c [2012-06-20 13:22:22.382711] T [nfs3.c:1548:nfs3_access] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.382730] T [nfs3-helpers.c:3726:nfs3_fh_resolve_inode] 0-nfs-nfsv3: FH needs inode resolution [2012-06-20 13:22:22.382749] T [nfs3-helpers.c:3535:nfs3_fh_resolve_inode_done] 0-nfs-nfsv3: FH inode resolved [2012-06-20 13:22:22.382769] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.382786] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.382803] T [nfs-fops.c:381:nfs_fop_access] 0-nfs: Access: /baz [2012-06-20 13:22:22.382820] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.382837] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.382861] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.382882] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 92, payload: 24, rpc hdr: 68 [2012-06-20 13:22:22.382934] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12325x Program: GlusterFS 3.1, ProgVers: 330, Proc: 22) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.383239] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12325x Program: GlusterFS 3.1, ProgVers: 330, Proc: 22) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.383272] D [nfs3-helpers.c:3389:nfs3_log_common_res] 0-nfs-nfsv3: XID: 3d777860, ACCESS: NFS: 0(Call completed successfully.), POSIX: 4(Interrupted system call) [2012-06-20 13:22:22.383294] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 12 [2012-06-20 13:22:22.383314] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 36, payload: 12, rpc hdr: 24 [2012-06-20 13:22:22.383354] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239776x, Program: NFS3, ProgVers: 3, Proc: 4) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.383582] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.383611] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.383629] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777861, Ver: 2, Program: 100003, ProgVers: 3, Proc: 17) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.383650] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.383668] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - READDIRPLUS [2012-06-20 13:22:22.383693] D [nfs3-helpers.c:3523:nfs3_log_readdir_call] 0-nfs-nfsv3: XID: 3d777861, READDIRPLUS: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c, dircount: 1008, maxcount: 8064 [2012-06-20 13:22:22.383714] T [nfs3.c:4310:nfs3_readdir] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.383733] T [nfs3-helpers.c:3726:nfs3_fh_resolve_inode] 0-nfs-nfsv3: FH needs inode resolution [2012-06-20 13:22:22.383763] T [nfs3-helpers.c:3535:nfs3_fh_resolve_inode_done] 0-nfs-nfsv3: FH inode resolved [2012-06-20 13:22:22.383787] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.383806] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.383823] T [nfs-fops.c:610:nfs_fop_readdirp] 0-nfs: readdir [2012-06-20 13:22:22.383841] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.383858] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.383886] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.383909] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 108, payload: 40, rpc hdr: 68 [2012-06-20 13:22:22.383964] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12326x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.384480] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12326x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.384519] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.384538] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.384556] T [nfs-fops.c:475:nfs_fop_fstat] 0-nfs: FStat [2012-06-20 13:22:22.384575] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.384592] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.384615] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.384639] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 96, payload: 28, rpc hdr: 68 [2012-06-20 13:22:22.384753] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12327x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.385163] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12327x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.385194] T [nfs3.c:4104:nfs3svc_readdir_fstat_cbk] 0-nfs-nfsv3: Reached end-of-directory [2012-06-20 13:22:22.385218] D [nfs3-helpers.c:3489:nfs3_log_readdirp_res] 0-nfs-nfsv3: XID: 3d777861, READDIRPLUS: NFS: 0(Call completed successfully.), POSIX: 0(Success), dircount: 1008, maxcount: 8064, cverf: 59641052, is_eof: 1 [2012-06-20 13:22:22.385241] T [nfs3-helpers.c:758:nfs3_fill_entryp3] 0-nfs-nfsv3: Entry: .., ino: 16777216 [2012-06-20 13:22:22.385262] T [nfs3-helpers.c:758:nfs3_fill_entryp3] 0-nfs-nfsv3: Entry: foo, ino: 2920037965 [2012-06-20 13:22:22.385281] T [nfs3-helpers.c:758:nfs3_fill_entryp3] 0-nfs-nfsv3: Entry: ., ino: 1205893126 [2012-06-20 13:22:22.385307] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 600 [2012-06-20 13:22:22.385328] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 624, payload: 600, rpc hdr: 24 [2012-06-20 13:22:22.385369] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239777x, Program: NFS3, ProgVers: 3, Proc: 17) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.385396] T [nfs3.c:447:nfs3_call_state_wipe] 0-nfs-nfsv3: fd 0x38e0cdc ref: 1 [2012-06-20 13:22:22.385635] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.385664] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.385683] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777862, Ver: 2, Program: 100003, ProgVers: 3, Proc: 3) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.385703] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.385733] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - LOOKUP [2012-06-20 13:22:22.385759] D [nfs3-helpers.c:1641:nfs3_log_fh_entry_call] 0-nfs-nfsv3: XID: 3d777862, LOOKUP: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c, name: foo [2012-06-20 13:22:22.385780] T [nfs3.c:1408:nfs3_lookup] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.385802] T [nfs3-helpers.c:3679:nfs3_fh_resolve_entry_hard] 0-nfs-nfsv3: FH hard resolution: gfid: a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c , entry: foo [2012-06-20 13:22:22.385826] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.385844] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.385861] T [nfs-fops.c:335:nfs_fop_lookup] 0-nfs: Lookup: /baz/foo [2012-06-20 13:22:22.385879] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.385896] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.385956] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.385980] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 156, payload: 88, rpc hdr: 68 [2012-06-20 13:22:22.386035] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12328x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.386401] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12328x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.386443] D [nfs3-helpers.c:3458:nfs3_log_newfh_res] 0-nfs-nfsv3: XID: 3d777862, LOOKUP: NFS: 0(Call completed successfully.), POSIX: 22(Invalid argument), FH: hashcount 2, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid 3b2400dc-1951-426d-8420-6c44546f4ec3 [2012-06-20 13:22:22.386471] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 224 [2012-06-20 13:22:22.386493] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 248, payload: 224, rpc hdr: 24 [2012-06-20 13:22:22.386533] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239778x, Program: NFS3, ProgVers: 3, Proc: 3) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.386756] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.386786] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.386804] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777863, Ver: 2, Program: 100003, ProgVers: 3, Proc: 17) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.386825] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.386843] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - READDIRPLUS [2012-06-20 13:22:22.386868] D [nfs3-helpers.c:3523:nfs3_log_readdir_call] 0-nfs-nfsv3: XID: 3d777863, READDIRPLUS: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c, dircount: 1008, maxcount: 8064 [2012-06-20 13:22:22.386888] T [nfs3.c:4310:nfs3_readdir] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.386907] T [nfs3-helpers.c:3726:nfs3_fh_resolve_inode] 0-nfs-nfsv3: FH needs inode resolution [2012-06-20 13:22:22.386925] T [nfs3-helpers.c:3535:nfs3_fh_resolve_inode_done] 0-nfs-nfsv3: FH inode resolved [2012-06-20 13:22:22.386946] T [nfs3-helpers.c:1572:nfs3_verify_dircookie] 0-nfs-nfsv3: Verifying cookie: cverf: 59641052, cookie: 2147483647 [2012-06-20 13:22:22.386965] T [nfs3-helpers.c:1597:nfs3_verify_dircookie] 0-nfs-nfsv3: Cookie verified [2012-06-20 13:22:22.386982] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.386999] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.387016] T [nfs-fops.c:610:nfs_fop_readdirp] 0-nfs: readdir [2012-06-20 13:22:22.387045] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.387063] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.387087] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.387109] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 108, payload: 40, rpc hdr: 68 [2012-06-20 13:22:22.387159] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12329x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.394189] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12329x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.394227] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.394251] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.394268] T [nfs-fops.c:475:nfs_fop_fstat] 0-nfs: FStat [2012-06-20 13:22:22.394286] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.394303] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.394326] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.394348] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 96, payload: 28, rpc hdr: 68 [2012-06-20 13:22:22.394403] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12330x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.399154] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12330x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.399189] T [nfs3.c:4104:nfs3svc_readdir_fstat_cbk] 0-nfs-nfsv3: Reached end-of-directory [2012-06-20 13:22:22.399213] D [nfs3-helpers.c:3489:nfs3_log_readdirp_res] 0-nfs-nfsv3: XID: 3d777863, READDIRPLUS: NFS: 0(Call completed successfully.), POSIX: 0(Success), dircount: 1008, maxcount: 8064, cverf: 59641052, is_eof: 1 [2012-06-20 13:22:22.399240] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 108 [2012-06-20 13:22:22.399262] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 132, payload: 108, rpc hdr: 24 [2012-06-20 13:22:22.399304] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239779x, Program: NFS3, ProgVers: 3, Proc: 17) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.399330] T [nfs3.c:447:nfs3_call_state_wipe] 0-nfs-nfsv3: fd 0x38e0cdc ref: 1 [2012-06-20 13:22:22.399722] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.399751] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.399769] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777864, Ver: 2, Program: 100003, ProgVers: 3, Proc: 3) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.399790] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.399808] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - LOOKUP [2012-06-20 13:22:22.399832] D [nfs3-helpers.c:1641:nfs3_log_fh_entry_call] 0-nfs-nfsv3: XID: 3d777864, LOOKUP: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c, name: foo [2012-06-20 13:22:22.399853] T [nfs3.c:1408:nfs3_lookup] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.399876] T [nfs3-helpers.c:3679:nfs3_fh_resolve_entry_hard] 0-nfs-nfsv3: FH hard resolution: gfid: a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c , entry: foo [2012-06-20 13:22:22.399899] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.399917] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.399947] T [nfs-fops.c:335:nfs_fop_lookup] 0-nfs: Lookup: /baz/foo [2012-06-20 13:22:22.399966] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.399984] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.400038] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.400062] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 156, payload: 88, rpc hdr: 68 [2012-06-20 13:22:22.400112] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12331x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.400513] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12331x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.400555] D [nfs3-helpers.c:3458:nfs3_log_newfh_res] 0-nfs-nfsv3: XID: 3d777864, LOOKUP: NFS: 0(Call completed successfully.), POSIX: 22(Invalid argument), FH: hashcount 2, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid 3b2400dc-1951-426d-8420-6c44546f4ec3 [2012-06-20 13:22:22.400584] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 224 [2012-06-20 13:22:22.400606] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 248, payload: 224, rpc hdr: 24 [2012-06-20 13:22:22.400647] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239780x, Program: NFS3, ProgVers: 3, Proc: 3) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.400894] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.400923] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.400942] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777865, Ver: 2, Program: 100003, ProgVers: 3, Proc: 3) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.400962] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.400981] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - LOOKUP [2012-06-20 13:22:22.401005] D [nfs3-helpers.c:1641:nfs3_log_fh_entry_call] 0-nfs-nfsv3: XID: 3d777865, LOOKUP: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c, name: foo [2012-06-20 13:22:22.401025] T [nfs3.c:1408:nfs3_lookup] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.401047] T [nfs3-helpers.c:3679:nfs3_fh_resolve_entry_hard] 0-nfs-nfsv3: FH hard resolution: gfid: a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c , entry: foo [2012-06-20 13:22:22.401070] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.401088] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.401104] T [nfs-fops.c:335:nfs_fop_lookup] 0-nfs: Lookup: /baz/foo [2012-06-20 13:22:22.401122] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.401139] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.401202] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.401226] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 156, payload: 88, rpc hdr: 68 [2012-06-20 13:22:22.401275] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12332x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.401660] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12332x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.401703] D [nfs3-helpers.c:3458:nfs3_log_newfh_res] 0-nfs-nfsv3: XID: 3d777865, LOOKUP: NFS: 0(Call completed successfully.), POSIX: 22(Invalid argument), FH: hashcount 2, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid 3b2400dc-1951-426d-8420-6c44546f4ec3 [2012-06-20 13:22:22.401742] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 224 [2012-06-20 13:22:22.401765] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 248, payload: 224, rpc hdr: 24 [2012-06-20 13:22:22.401806] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239781x, Program: NFS3, ProgVers: 3, Proc: 3) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.401973] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.402001] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.402019] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777866, Ver: 2, Program: 100003, ProgVers: 3, Proc: 3) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.402040] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.402058] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - LOOKUP [2012-06-20 13:22:22.402082] D [nfs3-helpers.c:1641:nfs3_log_fh_entry_call] 0-nfs-nfsv3: XID: 3d777866, LOOKUP: args: FH: hashcount 1, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c, name: foo [2012-06-20 13:22:22.402103] T [nfs3.c:1408:nfs3_lookup] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.402124] T [nfs3-helpers.c:3679:nfs3_fh_resolve_entry_hard] 0-nfs-nfsv3: FH hard resolution: gfid: a4e1c22c-8d79-4b0b-b0a0-fff48b01ab4c , entry: foo [2012-06-20 13:22:22.402147] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.402165] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.402181] T [nfs-fops.c:335:nfs_fop_lookup] 0-nfs: Lookup: /baz/foo [2012-06-20 13:22:22.402199] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.402216] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.402268] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.402292] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 156, payload: 88, rpc hdr: 68 [2012-06-20 13:22:22.402340] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12333x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.402742] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12333x Program: GlusterFS 3.1, ProgVers: 330, Proc: 27) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.402786] D [nfs3-helpers.c:3458:nfs3_log_newfh_res] 0-nfs-nfsv3: XID: 3d777866, LOOKUP: NFS: 0(Call completed successfully.), POSIX: 22(Invalid argument), FH: hashcount 2, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid 3b2400dc-1951-426d-8420-6c44546f4ec3 [2012-06-20 13:22:22.402814] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 224 [2012-06-20 13:22:22.402836] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 248, payload: 224, rpc hdr: 24 [2012-06-20 13:22:22.402877] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239782x, Program: NFS3, ProgVers: 3, Proc: 3) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.403057] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.403086] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.403105] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777867, Ver: 2, Program: 100003, ProgVers: 3, Proc: 4) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.403125] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.403143] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - ACCESS [2012-06-20 13:22:22.403179] D [nfs3-helpers.c:1627:nfs3_log_common_call] 0-nfs-nfsv3: XID: 3d777867, ACCESS: args: FH: hashcount 2, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid 3b2400dc-1951-426d-8420-6c44546f4ec3 [2012-06-20 13:22:22.403200] T [nfs3.c:1548:nfs3_access] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.403219] T [nfs3-helpers.c:3726:nfs3_fh_resolve_inode] 0-nfs-nfsv3: FH needs inode resolution [2012-06-20 13:22:22.403237] T [nfs3-helpers.c:3535:nfs3_fh_resolve_inode_done] 0-nfs-nfsv3: FH inode resolved [2012-06-20 13:22:22.403257] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.403275] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.403291] T [nfs-fops.c:381:nfs_fop_access] 0-nfs: Access: /baz/foo [2012-06-20 13:22:22.403308] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.403325] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.403348] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.403369] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 92, payload: 24, rpc hdr: 68 [2012-06-20 13:22:22.403417] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12334x Program: GlusterFS 3.1, ProgVers: 330, Proc: 22) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.403755] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12334x Program: GlusterFS 3.1, ProgVers: 330, Proc: 22) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.403789] D [nfs3-helpers.c:3389:nfs3_log_common_res] 0-nfs-nfsv3: XID: 3d777867, ACCESS: NFS: 0(Call completed successfully.), POSIX: 4(Interrupted system call) [2012-06-20 13:22:22.403812] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 12 [2012-06-20 13:22:22.403833] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 36, payload: 12, rpc hdr: 24 [2012-06-20 13:22:22.403873] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239783x, Program: NFS3, ProgVers: 3, Proc: 4) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.404069] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.404098] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.404116] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777868, Ver: 2, Program: 100003, ProgVers: 3, Proc: 17) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.404136] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.404155] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - READDIRPLUS [2012-06-20 13:22:22.404179] D [nfs3-helpers.c:3523:nfs3_log_readdir_call] 0-nfs-nfsv3: XID: 3d777868, READDIRPLUS: args: FH: hashcount 2, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid 3b2400dc-1951-426d-8420-6c44546f4ec3, dircount: 1008, maxcount: 8064 [2012-06-20 13:22:22.404199] T [nfs3.c:4310:nfs3_readdir] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.404218] T [nfs3-helpers.c:3726:nfs3_fh_resolve_inode] 0-nfs-nfsv3: FH needs inode resolution [2012-06-20 13:22:22.404236] T [nfs3-helpers.c:3535:nfs3_fh_resolve_inode_done] 0-nfs-nfsv3: FH inode resolved [2012-06-20 13:22:22.404258] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.404276] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.404292] T [nfs-fops.c:610:nfs_fop_readdirp] 0-nfs: readdir [2012-06-20 13:22:22.404310] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.404327] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.404351] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.404385] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 108, payload: 40, rpc hdr: 68 [2012-06-20 13:22:22.404434] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12335x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.404928] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12335x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.404964] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.404985] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.405002] T [nfs-fops.c:475:nfs_fop_fstat] 0-nfs: FStat [2012-06-20 13:22:22.405020] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.405037] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.405060] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.405081] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 96, payload: 28, rpc hdr: 68 [2012-06-20 13:22:22.405130] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12336x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.405524] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12336x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.405553] T [nfs3.c:4104:nfs3svc_readdir_fstat_cbk] 0-nfs-nfsv3: Reached end-of-directory [2012-06-20 13:22:22.405577] D [nfs3-helpers.c:3489:nfs3_log_readdirp_res] 0-nfs-nfsv3: XID: 3d777868, READDIRPLUS: NFS: 0(Call completed successfully.), POSIX: 0(Success), dircount: 1008, maxcount: 8064, cverf: 59641052, is_eof: 1 [2012-06-20 13:22:22.405599] T [nfs3-helpers.c:758:nfs3_fill_entryp3] 0-nfs-nfsv3: Entry: .., ino: 1205893126 [2012-06-20 13:22:22.405619] T [nfs3-helpers.c:758:nfs3_fill_entryp3] 0-nfs-nfsv3: Entry: ., ino: 2920037965 [2012-06-20 13:22:22.405644] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 444 [2012-06-20 13:22:22.405665] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 468, payload: 444, rpc hdr: 24 [2012-06-20 13:22:22.405707] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239784x, Program: NFS3, ProgVers: 3, Proc: 17) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.405734] T [nfs3.c:447:nfs3_call_state_wipe] 0-nfs-nfsv3: fd 0x38e0cdc ref: 1 [2012-06-20 13:22:22.405913] T [rpcsvc.c:470:rpcsvc_handle_rpc_call] 0-rpcsvc: Client port: 826 [2012-06-20 13:22:22.405942] T [rpcsvc-auth.c:305:rpcsvc_auth_request_init] 0-rpc-service: Auth handler: AUTH_UNIX [2012-06-20 13:22:22.405960] T [rpcsvc.c:382:rpcsvc_request_create] 0-rpc-service: received rpc-message (XID: 0x3d777869, Ver: 2, Program: 100003, ProgVers: 3, Proc: 17) from rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.405980] T [auth-unix.c:58:auth_unix_authenticate] 0-rpc-service: Auth Info: machine name: localhost, uid: 0, gid: 0 [2012-06-20 13:22:22.405998] T [rpcsvc.c:211:rpcsvc_program_actor] 0-rpc-service: Actor found: NFS3 - READDIRPLUS [2012-06-20 13:22:22.406023] D [nfs3-helpers.c:3523:nfs3_log_readdir_call] 0-nfs-nfsv3: XID: 3d777869, READDIRPLUS: args: FH: hashcount 2, exportid b2d75589-8370-4528-ab4e-b543b3abdc3b, gfid 3b2400dc-1951-426d-8420-6c44546f4ec3, dircount: 1008, maxcount: 8064 [2012-06-20 13:22:22.406043] T [nfs3.c:4310:nfs3_readdir] 0-nfs-nfsv3: FH to Volume: bar [2012-06-20 13:22:22.406062] T [nfs3-helpers.c:3726:nfs3_fh_resolve_inode] 0-nfs-nfsv3: FH needs inode resolution [2012-06-20 13:22:22.406080] T [nfs3-helpers.c:3535:nfs3_fh_resolve_inode_done] 0-nfs-nfsv3: FH inode resolved [2012-06-20 13:22:22.406101] T [nfs3-helpers.c:1572:nfs3_verify_dircookie] 0-nfs-nfsv3: Verifying cookie: cverf: 59641052, cookie: 2147483647 [2012-06-20 13:22:22.406131] T [nfs3-helpers.c:1597:nfs3_verify_dircookie] 0-nfs-nfsv3: Cookie verified [2012-06-20 13:22:22.406149] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.406167] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.406183] T [nfs-fops.c:610:nfs_fop_readdirp] 0-nfs: readdir [2012-06-20 13:22:22.406201] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.406218] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.406242] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.406264] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 108, payload: 40, rpc hdr: 68 [2012-06-20 13:22:22.406313] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12337x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.406766] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12337x Program: GlusterFS 3.1, ProgVers: 330, Proc: 40) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.406797] T [nfs.c:437:nfs_user_create] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.406816] T [nfs.c:445:nfs_user_create] 0-nfs: gid: 0 [2012-06-20 13:22:22.406833] T [nfs-fops.c:475:nfs_fop_fstat] 0-nfs: FStat [2012-06-20 13:22:22.406851] T [nfs-fops.c:131:nfs_create_frame] 0-nfs: uid: 0, gid 0, gids: 1 [2012-06-20 13:22:22.406868] T [nfs-fops.c:133:nfs_create_frame] 0-nfs: gid: 0 [2012-06-20 13:22:22.406891] T [rpc-clnt.c:1310:rpc_clnt_record] 0-bar-client-0: Auth Info: pid: 1, uid: 0, gid: 0, owner: [2012-06-20 13:22:22.406912] T [rpc-clnt.c:1190:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 96, payload: 28, rpc hdr: 68 [2012-06-20 13:22:22.406961] T [rpc-clnt.c:1510:rpc_clnt_submit] 0-rpc-clnt: submitted request (XID: 0x12338x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) to rpc-transport (bar-client-0) [2012-06-20 13:22:22.407341] T [rpc-clnt.c:685:rpc_clnt_reply_init] 0-bar-client-0: received rpc message (RPC XID: 0x12338x Program: GlusterFS 3.1, ProgVers: 330, Proc: 25) from rpc-transport (bar-client-0) [2012-06-20 13:22:22.407372] T [nfs3.c:4104:nfs3svc_readdir_fstat_cbk] 0-nfs-nfsv3: Reached end-of-directory [2012-06-20 13:22:22.407395] D [nfs3-helpers.c:3489:nfs3_log_readdirp_res] 0-nfs-nfsv3: XID: 3d777869, READDIRPLUS: NFS: 0(Call completed successfully.), POSIX: 0(Success), dircount: 1008, maxcount: 8064, cverf: 59641052, is_eof: 1 [2012-06-20 13:22:22.407421] T [rpcsvc.c:1050:rpcsvc_submit_generic] 0-rpc-service: Tx message: 108 [2012-06-20 13:22:22.407443] T [rpcsvc.c:676:rpcsvc_record_build_header] 0-rpc-service: Reply fraglen 132, payload: 108, rpc hdr: 24 [2012-06-20 13:22:22.407483] T [rpcsvc.c:1087:rpcsvc_submit_generic] 0-rpc-service: submitted reply for rpc-message (XID: 0x1031239785x, Program: NFS3, ProgVers: 3, Proc: 17) to rpc-transport (socket.nfs-server) [2012-06-20 13:22:22.407508] T [nfs3.c:447:nfs3_call_state_wipe] 0-nfs-nfsv3: fd 0x38e0cdc ref: 1
