On 07/25/2012 10:31 AM, Peng Tao wrote: > Hi Boaz, > > Sorry about the long delay. I had some internal interrupt. Now I'm > looking at the partial LD write problem again. Instead of trying to > bail out unaligned writes blindly, this time I want to fix the write > code to handle partial write as you suggested before. However, it > seems to be more problematic than I used to think. > > The dirty range of a page passed to LD->write_pagelist may be > unaligned to sector size, in which case block layer cannot handle it > correctly. Even worse, I cannot do a read-modify-write cycle within > the same page because bio would read in the entire sector and thus > ruin user data within the same sector. Currently I'm thinking of > creating shadow pages for partial sector write and use them to read in > the sector and copy necessary data into user pages. But it is way too > tricky and I don't feel like it at all. So I want to ask how you solve > the partial sector write problem in object layout driver. > > I looked at the ore code and found that you are using bio to deal with > partial page read/write as well. But in places like _add_to_r4w(), I > don't see how partial sectors are handled. Maybe I was misreading the > code. Would you please shed some light? More specifically, how does > object layout driver handle partial sector writers like in bellow > simple testcase? Thanks in advance. > The objlayout does not have this problem. OSD-SCSI is a byte aligned protocol, unlike DISK-SCSI. The code you are looking for is at _add_to_r4w_first_page() && _add_to_r4w_last_page. But as I said I just submit a read of: 0 => offset within the page What ever that might be. In your case: why? all you have to do is allocate 2 sectors (1k) at most one for partial sector at end and one for partial sector at beginning. And use chained BIOs then memcpy at most [1k -2] bytes. What you do is chain a single-sector BIO to an all aligned BIO You do the following: - You will need to preform two reads, right? One for the unaligned BLOCK at the begging and one for the BLOCK at the end. Since in blocklayout all IO is BLOCK aligned. Beginning end of IO - Jump over first unaligned SECTOR. Prepare BIO from first full sector, to the end of the BLOCK. - Prepare a 1-biovec BIO from the above allocated sector, which reads the full first sector. - perpend the 1-vec BIO to the big one. - preform the read - memcpy from above allocated sector the 0=>offset part into the NFS original page. Do the same for end of IO but for the very last unaligned sector. Chain 1-vec BIO to the end this time. memcpy last_byte=>end-of-sector part. So you see no shadow pages and not so complicated. In the unaligned case at most you need allocate 1k and chain BIOs at beginning and/or at end. Tell me if you need help with BIO chaining. The 1-vec BIO just use bio_kmalloc(). Cheers Boaz -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
