Hi Bruce, Shyam As mentioned here http://wiki.linux-nfs.org/wiki/index.php/PNFS_server_projects gfs2 is also having issues(crashes, performance), so instead of going for gfs2 can we debug spNFS itself to get high performance? -Taousif -----Original Message----- From: Iyer, Shyam Sent: Thursday, May 19, 2011 8:08 PM To: Ansari, Taousif - Dell Team; bfields@xxxxxxxxxxxx Cc: linux-nfs@xxxxxxxxxxxxxxx Subject: RE: Performance Issue with multiple dataserver > -----Original Message----- > From: linux-nfs-owner@xxxxxxxxxxxxxxx [mailto:linux-nfs- > owner@xxxxxxxxxxxxxxx] On Behalf Of Ansari, Taousif - Dell Team > > Can you please elaborate GFS2-setup a bit more... I guess Bruce is saying the step-by-step procedure is not written up... Create a Redhat cluster using the shared block storage(iSCSI in your case I guess). You would get documentation on creating a RH cluster in many places.. All the MDSs and the DSs need to be part of the cluster. Format GFS2 on the shared iSCSI storage. Mount the GFS2 formatted iSCSI storage on all the MDSs and DSs and export them via NFS. Use Benny's tree for NFS. The GFS2 cluster backend is your glue to scale the MDSes and DSes. > > -----Original Message----- > From: J. Bruce Fields [mailto:bfields@xxxxxxxxxxxx] > Sent: Thursday, May 19, 2011 7:14 PM > To: Ansari, Taousif - Dell Team > Cc: linux-nfs@xxxxxxxxxxxxxxx > Subject: Re: Performance Issue with multiple dataserver > > On Thu, May 19, 2011 at 06:44:59PM +0530, Taousif_Ansari@xxxxxxxxxxxx > wrote: > > Then what should I follow, and what details are needed.... > > There isn't really any supported server-side pNFS. > > The closest is the GFS2-based code, for which you need to install > Benny's latest tree, configure a shared block device, create a GFS2 > filesystem on it, mount it across all DS's and the MDS, and export it > from all of them--but I don't believe anyone has written step-by-step > instructions for that. > > --b. > > > > > -----Original Message----- > > From: linux-nfs-owner@xxxxxxxxxxxxxxx [mailto:linux-nfs- > owner@xxxxxxxxxxxxxxx] On Behalf Of J. Bruce Fields > > Sent: Thursday, May 19, 2011 6:43 PM > > To: Ansari, Taousif - Dell Team > > Cc: linux-nfs@xxxxxxxxxxxxxxx > > Subject: Re: Performance Issue with multiple dataserver > > > > On Thu, May 19, 2011 at 06:09:21PM +0530, Taousif_Ansari@xxxxxxxxxxxx > wrote: > > > I have followed the way given on http://wiki.linux- > nfs.org/wiki/index.php/Configuring_pNFS/spnfsd . > > > > Oh. As noted there, spnfs is unmaintained. > > > > And, in any case, we'd need many more details about your setup. > > > > --b. > > > > > > > > -Taousif > > > > > > -----Original Message----- > > > From: J. Bruce Fields [mailto:bfields@xxxxxxxxxxxx] > > > Sent: Thursday, May 19, 2011 5:20 PM > > > To: Ansari, Taousif - Dell Team > > > Cc: linux-nfs@xxxxxxxxxxxxxxx > > > Subject: Re: Performance Issue with multiple dataserver > > > > > > On Thu, May 19, 2011 at 10:56:44AM +0530, > Taousif_Ansari@xxxxxxxxxxxx wrote: > > > > Hi, > > > > > > > > I am using on Server linux-pnfs-2.6.38(linux-pnfs-ae7441f.tar) > and on client also linux-pnfs-2.6.38(linux-pnfs-ae7441f.tar) downloaded > from http://git.linux-nfs.org/?p=bhalevy/linux-pnfs.git;a=summary on > Fedora 14. > > > > > > So you're using GFS2 on the server? With what sort of storage? > > > > > > --b. > > > > > > > > > > > Extremely sorry for causing confusing . > > > > -----Original Message----- > > > > From: J. Bruce Fields [mailto:bfields@xxxxxxxxxxxx] > > > > Sent: Wednesday, May 18, 2011 9:43 PM > > > > To: Ansari, Taousif - Dell Team > > > > Cc: linux-nfs@xxxxxxxxxxxxxxx > > > > Subject: Re: Performance Issue with multiple dataserver > > > > > > > > You sent this message as a reply to an unrelated message, which > is > > > > confusing to those of us with threaded mail readers. > > > > > > > > On Wed, May 18, 2011 at 05:24:45PM +0530, > Taousif_Ansari@xxxxxxxxxxxx wrote: > > > > > I have done pNFS setup with single Dataserver and Two > Dataserver and ran the IOzone tool on both, I found that the > performance with multiple dataservers is less than the performance with > single dataservers. > > > > > > > > What are you using as the server, and what as the client? > > > > > > > > --b. > > > > > > > > > > > > > > Here are some numbers, which were captured by the IOzone tool. > > > > > > > > > > > > > > > 4 8 16 32 > 64 128 256 512 1024 <== Record Length in KB > > > > > With Single Dataserver: > > > > > Read operation for file size 1 MB- 66415 66359 63630 > 70358 86223 70256 66047 66068 68489 <== IO kB/sec > > > > > Write operation for file size 1 MB- 18827 16920 18846 > 17039 18896 17009 17173 19206 17947 <== IO kB/sec > > > > > > > > > > With Two Dataservers : > > > > > Read operation for file size 1 MB- 36882 381198 > 38150 38084 38749 33663 34398 37313 37847 <== IO kB/sec > > > > > Write operation for file size 1 MB- 5461 4661 5586 > 4870 5227 4922 4214 5572 4658 <== IO kB/sec > > > > > > > > > > > > > > > Can somebody tell me What could be the issue.... > > > > > -- > > > > > To unsubscribe from this list: send the line "unsubscribe > linux-nfs" in > > > > > the body of a message to majordomo@xxxxxxxxxxxxxxx > > > > > More majordomo info at http://vger.kernel.org/majordomo- > info.html > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-nfs" > in > > the body of a message to majordomo@xxxxxxxxxxxxxxx > > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- > To unsubscribe from this list: send the line "unsubscribe linux-nfs" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
