----- Original Message ----- > From: "Eyal Ben David" <bdeyal@xxxxxxxxx> > To: emilne@xxxxxxxxxx > Cc: "Laurence Oberman" <loberman@xxxxxxxxxx>, dgilbert@xxxxxxxxxxxx, linux-scsi@xxxxxxxxxxxxxxx > Sent: Monday, November 21, 2016 9:55:29 AM > Subject: Re: SG does not ignore dxferp (direct io + mmap) > > Thanks for your reply, > > On RHEL system it does not occur. > > So far I have seen the problem on Ubuntu 16.04 and Fedora 22 (both > with kernel 4.4.x) > > 2016-11-21 16:24 GMT+02:00 Ewan D. Milne <emilne@xxxxxxxxxx>: > > On Mon, 2016-11-21 at 11:23 +0200, Eyal Ben David wrote: > >> Hi, > >> > >> The utility I mentioned is just a small program that I wrote to learn > >> more about the problem. > >> > >> It is a very simple read16 with options for mmap and dxferp as null or > >> other. > >> > >> Here is the source code: > >> > >> == cut here == > >> > > > > <snip> > > > >> 2016-11-21 2:04 GMT+02:00 Laurence Oberman <loberman@xxxxxxxxxx>: > >> > > >> > > >> > ----- Original Message ----- > >> >> From: "Eyal Ben David" <bdeyal@xxxxxxxxx> > >> >> To: linux-scsi@xxxxxxxxxxxxxxx > >> >> Sent: Sunday, November 20, 2016 11:02:49 AM > >> >> Subject: SG does not ignore dxferp (direct io + mmap) > >> >> > >> >> Hi all, > >> >> > >> >> We have some IO utility that perform the IOs using sg and direct io > >> >> with > >> >> mmap. > >> >> Our current systems are Ubuntu 14.04, RHEL 6,7 > >> >> The IO utility always set dxferp to either the address or mmap of > >> >> other allocation (valloc) > >> >> Setting dxferp was harmless since SG is supposed to ignore the address > >> >> if mmap IO is selected. > >> >> When porting to Ubuntu 16.04, we had a corruption problem - first byte > >> >> of a read task is always 0. > >> >> When setting dxferp as NULL the corruption does not occur any more. > >> >> This is a regression and not according to SCSI generic documentation. > >> >> > >> >> I wrote a small program that shows the change: > >> >> > >> >> Read indirect (no mmap), lba=0: > >> >> ======================= > >> >> $ ./sg_mmap_read -d /dev/sg0 -l 0 > >> >> 0000000 eb 63 90 10 8e d0 bc 00 b0 b8 00 00 8e d8 8e c0 > >> >> > >> >> Read with mmap, lba=0, dxferp=NULL: > >> >> ============================ > >> >> $ ./sg_mmap_read -d /dev/sg0 -l 0 -m > >> >> 0000000 eb 63 90 10 8e d0 bc 00 b0 b8 00 00 8e d8 8e c0 > >> >> > >> >> Read with mmap, lba=0, dxferp=address from mmap > >> >> ====================================== > >> >> $ ./sg_mmap_read -d /dev/sg0 -l 0 -m -b > >> >> 0000000 00 63 90 10 8e d0 bc 00 b0 b8 00 00 8e d8 8e c0 > >> >> > >> >> On the older systems all results are the same. > >> >> > >> >> Thanks for any answer! > >> >> -- > > > > For what it's worth, I ran this on a 4.8 kernel and did not see your > > problem. I couldn't reproduce it on a RHEL kernel either. > > > > # ./sg_mmap_read -d /dev/sg0 -l 0 | od -x > > 0000000 63eb 1090 d08e 00bc b8b0 0000 d88e c08e > > 0000020 befb 7c00 00bf b906 0200 a4f3 21ea 0006 > > 0000040 be00 07be 0438 0b75 c683 8110 fefe 7507 > > 0000060 ebf3 b416 b002 bb01 7c00 80b2 748a 8b01 > > 0000100 > > # ./sg_mmap_read -d /dev/sg0 -l 0 -m | od -x > > 0000000 63eb 1090 d08e 00bc b8b0 0000 d88e c08e > > 0000020 befb 7c00 00bf b906 0200 a4f3 21ea 0006 > > 0000040 be00 07be 0438 0b75 c683 8110 fefe 7507 > > 0000060 ebf3 b416 b002 bb01 7c00 80b2 748a 8b01 > > 0000100 > > # ./sg_mmap_read -d /dev/sg0 -l 0 -m -b | od -x > > 0000000 63eb 1090 d08e 00bc b8b0 0000 d88e c08e > > 0000020 befb 7c00 00bf b906 0200 a4f3 21ea 0006 > > 0000040 be00 07be 0438 0b75 c683 8110 fefe 7507 > > 0000060 ebf3 b416 b002 bb01 7c00 80b2 748a 8b01 > > 0000100 > > > > The only recent relevant change I see is: > > > > commit 5ecee0a3ee8d74b6950cb41e8989b0c2174568d4 > > Author: Douglas Gilbert <dgilbert@xxxxxxxxxxxx> > > Date: Thu Mar 3 00:31:29 2016 -0500 > > > > sg: fix dxferp in from_to case > > > > However the kernel I used has that change, and the > > change purposely does not clear hp->dxferp if > > SG_DXFER_TO_FROM_DEV is specified, which your program > > does not, and the behavior is correct regardless. > > > > Can you modify your program to output the userspace > > address of your buffer? > > > > -Ewan > > > > > -- > To unsubscribe from this list: send the line "unsubscribe linux-scsi" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html > This is Upstream 4.8.0-rc4 # uname -a 4.8.0-rc4+ #1 SMP Tue Aug 30 15:43:13 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux [root@dhcp40-131 ~]# sudo ./sg_mmap_read -d /dev/sg1 -l 0 | od -x 0000000 63eb 1090 d08e 00bc b8b0 0000 d88e c08e 0000020 befb 7c00 00bf b906 0200 a4f3 21ea 0006 0000040 be00 07be 0438 0b75 c683 8110 fefe 7507 0000060 ebf3 b416 b002 bb01 7c00 80b2 748a 8b01 0000100 [root@dhcp40-131 ~]# sudo ./sg_mmap_read -d /dev/sg1 -l 0 -m | od -x 0000000 63eb 1090 d08e 00bc b8b0 0000 d88e c08e 0000020 befb 7c00 00bf b906 0200 a4f3 21ea 0006 0000040 be00 07be 0438 0b75 c683 8110 fefe 7507 0000060 ebf3 b416 b002 bb01 7c00 80b2 748a 8b01 0000100 [root@dhcp40-131 ~]# sudo ./sg_mmap_read -d /dev/sg1 -l 0 -m -b | od -x 0000000 63eb 1090 d08e 00bc b8b0 0000 d88e c08e 0000020 befb 7c00 00bf b906 0200 a4f3 21ea 0006 0000040 be00 07be 0438 0b75 c683 8110 fefe 7507 0000060 ebf3 b416 b002 bb01 7c00 80b2 748a 8b01 0000100 -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
