>> Could you provide a network trace of the isssue happening? You can add a >> new bug report on bugzilla.samba.org in the cifsVFS/kernel fs section >> and attach the trace there. > I submitted a bug. Seems to happen every night. Cron starts at 11:30 PM. Error happens around 1:25 AM. Here are some logs in context as well as a tcpdump—drobo-ds is the NAS backup device. I created a large (3GB) tcpdump during the backup but it’s way too big to upload. Could this be bufferbloat? > > May 11 01:22:23 ourserver kernel: CIFS VFS: Server droboh has not responded in 120 seconds. Reconnecting... > May 11 01:23:40 ourserver kernel: CIFS VFS: sends on sock ffff9f2881408c80 stuck for 15 seconds > May 11 01:23:40 ourserver kernel: CIFS VFS: Error -11 sending data on socket to server > May 11 01:24:24 ourserver kernel: CIFS VFS: sends on sock ffff9f2881408c80 stuck for 15 seconds > May 11 01:24:24 ourserver kernel: CIFS VFS: Error -11 sending data on socket to server > May 11 01:25:00 ourserver kernel: CIFS VFS: sends on sock ffff9f2881408c80 stuck for 15 seconds > May 11 01:25:00 ourserver kernel: CIFS VFS: Error -11 sending data on socket to server > May 11 01:25:16 ourserver kernel: CIFS VFS: sends on sock ffff9f2881408c80 stuck for 15 seconds > May 11 01:25:16 ourserver kernel: CIFS VFS: Error -11 sending data on socket to server > May 11 01:25:49 ourserver kernel: CIFS VFS: sends on sock ffff9f2881408c80 stuck for 15 seconds > May 11 01:25:49 ourserver kernel: CIFS VFS: Error -11 sending data on socket to server > > reading from file capture_eth1.pcap, link-type EN10MB (Ethernet) > 01:29:10.445882 IP ourserver.uuidgen > fileserver.nfs: Flags [P.], seq 2359428476:2359428700, ack 4223248510, win 1444, options [nop,nop,TS val 1979978735 ecr 775533219], length 224: NFS request xid 2016398399 220 getattr fh 0,2/53 > 01:29:10.446331 IP fileserver.nfs > ourserver.uuidgen: Flags [P.], seq 1:173, ack 224, win 5204, options [nop,nop,TS val 775535659 ecr 1979978735], length 172: NFS reply xid 2016398399 reply ok 168 getattr NON 4 ids 0/1730480217 sz 1861894709 > 01:29:10.446378 IP ourserver.uuidgen > fileserver.nfs: Flags [.], ack 173, win 1444, options [nop,nop,TS val 1979978736 ecr 775535659], length 0 > 01:29:10.446466 IP ourserver.uuidgen > fileserver.nfs: Flags [P.], seq 224:568, ack 173, win 1444, options [nop,nop,TS val 1979978736 ecr 775535659], length 344: NFS request xid 2033175615 340 getattr fh 0,2/53 > 01:29:10.447034 IP fileserver.nfs > ourserver.uuidgen: Flags [P.], seq 173:537, ack 568, win 5204, options [nop,nop,TS val 775535660 ecr 1979978736], length 364: NFS reply xid 2033175615 reply ok 360 getattr NON 6 ids 0/1730480217 sz 1861894709 > 01:29:10.447346 IP ourserver.uuidgen > fileserver.nfs: Flags [P.], seq 568:836, ack 537, win 1444, options [nop,nop,TS val 1979978737 ecr 775535660], length 268: NFS request xid 2049952831 264 getattr fh 0,2/53 > 01:29:10.465786 IP fileserver.nfs > ourserver.uuidgen: Flags [P.], seq 537:805, ack 836, win 5204, options [nop,nop,TS val 775535679 ecr 1979978737], length 268: NFS reply xid 2049952831 reply ok 264 getattr NON 4 ids 0/1730480217 sz 1861894709 > 01:29:13.964676 IP drobo-ds > ourserver.42582: Flags [.], ack 3571070888, win 26508, options [nop,nop,TS val 616097295 ecr 1073740628], length 0 > 01:29:13.964780 IP drobo-ds > ourserver.42582: Flags [.], ack 2897, win 26508, options [nop,nop,TS val 616097295 ecr 1073740628], length 0 > 01:29:13.965029 IP drobo-ds > ourserver.42582: Flags [.], ack 5793, win 26508, options [nop,nop,TS val 616097295 ecr 1073740628], length 0 > 01:29:13.965155 IP drobo-ds > ourserver.42582: Flags [.], ack 8689, win 26508, options [nop,nop,TS val 616097295 ecr 1073740629], length 0 > 01:29:13.965176 IP ourserver.42582 > drobo-ds: Flags [.], seq 101361:115841, ack 0, win 321, options [nop,nop,TS val 1073740637 ecr 616097295], length 14480 SMB-over-TCP packet:(raw data or continuation?) > > 01:29:13.965397 IP drobo-ds > ourserver.42582: Flags [.], ack 11585, win 26421, options [nop,nop,TS val 616097295 ecr 1073740630], length 0 > 01:29:13.965418 IP ourserver.42582 > drobo-ds: Flags [.], seq 115841:118737, ack 0, win 321, options [nop,nop,TS val 1073740638 ecr 616097295], length 2896 SMB-over-TCP packet:(raw data or continuation?) > > 01:29:13.966364 IP drobo-ds > ourserver.42582: Flags [P.], seq 0:51, ack 18825, win 25986, options [nop,nop,TS val 616097295 ecr 1073740630], length 51 SMB PACKET: SMBwriteX (REPLY) > > 01:29:13.966386 IP drobo-ds > ourserver.42582: Flags [.], ack 21721, win 26508, options [nop,nop,TS val 616097295 ecr 1073740630], length 0 > 01:29:13.966416 IP ourserver.42582 > drobo-ds: Flags [.], seq 118737:125977, ack 51, win 321, options [nop,nop,TS val 1073740639 ecr 616097295], length 7240 SMB-over-TCP packet:(raw data or continuation?) > > 01:29:13.966658 IP drobo-ds > ourserver.42582: Flags [.], ack 24617, win 26508, options [nop,nop,TS val 616097295 ecr 1073740631], length 0 > 01:29:13.966783 IP drobo-ds > ourserver.42582: Flags [.], ack 27513, win 26508, options [nop,nop,TS val 616097295 ecr 1073740631], length 0 > 01:29:13.967054 IP drobo-ds > ourserver.42582: Flags [.], ack 30409, win 26508, options [nop,nop,TS val 616097295 ecr 1073740631], length 0 > 01:29:13.967072 IP ourserver.42582 > drobo-ds: Flags [P.], seq 125977:137561, ack 51, win 321, options [nop,nop,TS val 1073740639 ecr 616097295], length 11584 SMB-over-TCP packet:(raw data or continuation?) > > 01:29:13.967408 IP drobo-ds > ourserver.42582: Flags [.], ack 33305, win 26508, options [nop,nop,TS val 616097295 ecr 1073740631], length 0 > 01:29:13.968436 IP drobo-ds > ourserver.42582: Flags [.], ack 44889, win 26508, options [nop,nop,TS val 616097296 ecr 1073740632], length 0 > 01:29:13.968460 IP ourserver.42582 > drobo-ds: Flags [.], seq 140457:152041, ack 51, win 321, options [nop,nop,TS val 1073740641 ecr 616097296], length 11584 SMB-over-TCP packet:(raw data or continuation?) > > 01:29:13.968515 IP drobo-ds > ourserver.42582: Flags [.], ack 47785, win 26508, options [nop,nop,TS val 616097296 ecr 1073740634], length 0 > 01:29:13.968782 IP drobo-ds > ourserver.42582: Flags [.], ack 50681, win 26508, options [nop,nop,TS val 616097296 ecr 1073740634], length 0 > 01:29:13.969224 IP drobo-ds > ourserver.42582: Flags [.], ack 53577, win 26508, options [nop,nop,TS val 616097296 ecr 1073740634], length 0 > 01:29:13.969242 IP ourserver.42582 > drobo-ds: Flags [.], seq 152041:160729, ack 51, win 321, options [nop,nop,TS val 1073740642 ecr 616097296], length 8688 SMB-over-TCP packet:(raw data or continuation?) > > -- To unsubscribe from this list: send the line "unsubscribe linux-cifs" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
