Hi, We are debugging the issue. We observed the problem could be an unwound that did not happen in one(or more) of the performance translator. So here is what we are doing to analyze the issue. A patch[1] is sent with six test cases in which one of the performance translator is made off in each of the test case. With the patch, the netbsd regressions are passing for three test cases without any hang in which quick-read, open-behind, write-behind are the translators which are made off in the corresponding test cases. The netbsd may be passing individually and there may be a race that could happen too. We are debugging the issue. [1] http://review.gluster.org/#/c/13167/ Thank you :-) -- Regards, Manikandan Selvaganesh. ----- Original Message ----- From: "Manikandan Selvaganesh" <mselvaga@xxxxxxxxxx> To: "Raghavendra Gowdappa" <rgowdapp@xxxxxxxxxx> Cc: "Gluster Devel" <gluster-devel@xxxxxxxxxxx> Sent: Monday, January 4, 2016 7:00:16 PM Subject: Re: quota.t hangs on NetBSD machines Hi, We have taken statedump of fuse client process, quotad and bricks. Apparently, we could not find any stack information in brick's statedump. Below is the client statedump state information: [global.callpool.stack.1.frame.1] frame=0xb80775f0 ref_count=0 translator=patchy-write-behind complete=0 parent=patchy-read-ahead wind_from=ra_writev wind_to=FIRST_CHILD(this)->fops->writev unwind_to=ra_writev_cbk [global.callpool.stack.1.frame.2] frame=0xb8077540 ref_count=1 translator=patchy-read-ahead complete=0 parent=patchy-io-cache wind_from=ioc_writev wind_to=FIRST_CHILD(this)->fops->writev unwind_to=ioc_writev_cbk [global.callpool.stack.1.frame.3] frame=0xb8077490 ref_count=1 translator=patchy-io-cache complete=0 parent=patchy-quick-read wind_from=qr_writev wind_to=FIRST_CHILD (this)->fops->writev unwind_to=default_writev_cbk [global.callpool.stack.1.frame.4] frame=0xb80773e0 ref_count=1 translator=patchy-quick-read complete=0 parent=patchy-open-behind wind_from=default_writev_resume wind_to=FIRST_CHILD(this)->fops->writev unwind_to=default_writev_cbk [global.callpool.stack.1.frame.5] frame=0xb8077330 ref_count=1 translator=patchy-open-behind complete=0 parent=patchy-md-cache wind_from=mdc_writev wind_to=FIRST_CHILD(this)->fops->writev unwind_to=mdc_writev_cbk [global.callpool.stack.1.frame.6] frame=0xb80771d0 ref_count=1 translator=patchy-md-cache complete=0 parent=patchy wind_from=io_stats_writev wind_to=FIRST_CHILD(this)->fops->writev unwind_to=io_stats_writev_cbk [global.callpool.stack.1.frame.7] frame=0xb8077120 ref_count=1 translator=patchy complete=0 parent=fuse wind_from=fuse_write_resume wind_to=FIRST_CHILD(this)->fops->writev unwind_to=fuse_writev_cbk [global.callpool.stack.1.frame.8] frame=0xb8077070 ref_count=1 translator=fuse complete=0 [global.callpool.stack.2] stack=0xba420040 uid=0 gid=0 pid=0 unique=0 lk-owner= op=stack type=0 cnt=1 [global.callpool.stack.2.frame.1] frame=0xba43c6d0 ref_count=0 translator=glusterfs complete=0 [fuse] Below is the statedump information for quotad [global.callpool.stack.1.frame.1] frame=0xbb1d0620 ref_count=0 translator=glusterfs complete=0 Thank you :-) -- Regards, Manikandan Selvaganesh. ----- Original Message ----- From: "Raghavendra Gowdappa" <rgowdapp@xxxxxxxxxx> To: "Emmanuel Dreyfus" <manu@xxxxxxxxxx> Cc: "Gluster Devel" <gluster-devel@xxxxxxxxxxx> Sent: Monday, January 4, 2016 6:11:24 PM Subject: Re: quota.t hangs on NetBSD machines ----- Original Message ----- > From: "Emmanuel Dreyfus" <manu@xxxxxxxxxx> > To: "Raghavendra Gowdappa" <rgowdapp@xxxxxxxxxx> > Cc: "Emmanuel Dreyfus" <manu@xxxxxxxxxx>, "Gluster Devel" <gluster-devel@xxxxxxxxxxx>, "Raghavendra Talur" > <rtalur@xxxxxxxxxx> > Sent: Monday, January 4, 2016 4:03:22 PM > Subject: Re: quota.t hangs on NetBSD machines > > On Mon, Jan 04, 2016 at 05:16:16AM -0500, Raghavendra Gowdappa wrote: > > Can you send the statedump? Please look for frames with "complete=0". This > > indicates that the frame is not unwound. > > Here it is. No unwound frame? Is this statedump? Statedumps carry lots of other information too. This seems more like profile output from io-stats. Steps to obtain statedump from my previous mail: 1. Add "all=yes" <gluster-install-directory>/var/run/gluster/glusterdump.options 2. kill -SIGUSR1 <gluster-client-pid> 3. statedump can be found in <gluster-install-directory>/var/run/gluster/*dump* Also, please take statedump only after you find the application process is in "uninterruptible sleep" ('D' on Linux) state. > > { > "gluster.patchy.aggr.read_1b": "0", > "gluster.patchy.aggr.write_1b": "0", > "gluster.patchy.aggr.read_2b": "0", > "gluster.patchy.aggr.write_2b": "0", > "gluster.patchy.aggr.read_4b": "0", > "gluster.patchy.aggr.write_4b": "0", > "gluster.patchy.aggr.read_8b": "0", > "gluster.patchy.aggr.write_8b": "0", > "gluster.patchy.aggr.read_16b": "0", > "gluster.patchy.aggr.write_16b": "0", > "gluster.patchy.aggr.read_32b": "0", > "gluster.patchy.aggr.write_32b": "0", > "gluster.patchy.aggr.read_64b": "0", > "gluster.patchy.aggr.write_64b": "0", > "gluster.patchy.aggr.read_128b": "0", > "gluster.patchy.aggr.write_128b": "0", > "gluster.patchy.aggr.read_256b": "0", > "gluster.patchy.aggr.write_256b": "0", > "gluster.patchy.aggr.read_512b": "0", > "gluster.patchy.aggr.write_512b": "0", > "gluster.patchy.aggr.read_1kb": "0", > "gluster.patchy.aggr.write_1kb": "0", > "gluster.patchy.aggr.read_2kb": "0", > "gluster.patchy.aggr.write_2kb": "0", > "gluster.patchy.aggr.read_4kb": "0", > "gluster.patchy.aggr.write_4kb": "0", > "gluster.patchy.aggr.read_8kb": "0", > "gluster.patchy.aggr.write_8kb": "0", > "gluster.patchy.aggr.read_16kb": "0", > "gluster.patchy.aggr.write_16kb": "0", > "gluster.patchy.aggr.read_32kb": "0", > "gluster.patchy.aggr.write_32kb": "357", > "gluster.patchy.aggr.read_64kb": "0", > "gluster.patchy.aggr.write_64kb": "0", > "gluster.patchy.aggr.read_128kb": "0", > "gluster.patchy.aggr.write_128kb": "0", > "gluster.patchy.aggr.read_256kb": "0", > "gluster.patchy.aggr.write_256kb": "0", > "gluster.patchy.aggr.read_512kb": "0", > "gluster.patchy.aggr.write_512kb": "0", > "gluster.patchy.aggr.read_1mb": "0", > "gluster.patchy.aggr.write_1mb": "0", > "gluster.patchy.aggr.read_2mb": "0", > "gluster.patchy.aggr.write_2mb": "0", > "gluster.patchy.aggr.read_4mb": "0", > "gluster.patchy.aggr.write_4mb": "0", > "gluster.patchy.aggr.read_8mb": "0", > "gluster.patchy.aggr.write_8mb": "0", > "gluster.patchy.aggr.read_16mb": "0", > "gluster.patchy.aggr.write_16mb": "0", > "gluster.patchy.aggr.read_32mb": "0", > "gluster.patchy.aggr.write_32mb": "0", > "gluster.patchy.aggr.read_64mb": "0", > "gluster.patchy.aggr.write_64mb": "0", > "gluster.patchy.aggr.read_128mb": "0", > "gluster.patchy.aggr.write_128mb": "0", > "gluster.patchy.aggr.read_256mb": "0", > "gluster.patchy.aggr.write_256mb": "0", > "gluster.patchy.aggr.read_512mb": "0", > "gluster.patchy.aggr.write_512mb": "0", > "gluster.patchy.aggr.read_1024mb": "0", > "gluster.patchy.aggr.write_1024mb": "0", > "gluster.patchy.aggr.fds.open_count": "1", > "gluster.patchy.aggr.fds.max_open_count": "1", > "gluster.patchy.aggr.fop.null.count": "-5070885384636858368", > "gluster.patchy.aggr.fop.null.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.null.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.null.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.stat.count": "-5070885384636858368", > "gluster.patchy.aggr.fop.stat.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.stat.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.stat.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.readlink.count": "-4937050892273713152", > "gluster.patchy.aggr.fop.readlink.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.readlink.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.readlink.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.mknod.count": "-4937050853619007488", > "gluster.patchy.aggr.fop.mknod.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.mknod.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.mknod.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.mkdir.count": "-4937050827849203712", > "gluster.patchy.aggr.fop.mkdir.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.mkdir.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.mkdir.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.unlink.count": "-4937050802079399936", > "gluster.patchy.aggr.fop.unlink.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.unlink.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.unlink.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.rmdir.count": "-4937050772014628864", > "gluster.patchy.aggr.fop.rmdir.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.rmdir.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.rmdir.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.symlink.count": "-4937050746244825088", > "gluster.patchy.aggr.fop.symlink.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.symlink.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.symlink.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.rename.count": "-4937050711885086720", > "gluster.patchy.aggr.fop.rename.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.rename.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.rename.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.link.count": "-5070885384636858368", > "gluster.patchy.aggr.fop.link.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.link.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.link.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.truncate.count": "-4937050660345479168", > "gluster.patchy.aggr.fop.truncate.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.truncate.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.truncate.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.open.count": "-5070885384636858368", > "gluster.patchy.aggr.fop.open.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.open.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.open.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.read.count": "-5070885384636858368", > "gluster.patchy.aggr.fop.read.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.read.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.read.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.write.count": "-4937050578741100544", > "gluster.patchy.aggr.fop.write.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.write.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.write.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.statfs.count": "-4937050552971296768", > "gluster.patchy.aggr.fop.statfs.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.statfs.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.statfs.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.flush.count": "-4937050522906525696", > "gluster.patchy.aggr.fop.flush.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.flush.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.flush.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fsync.count": "-4937050497136721920", > "gluster.patchy.aggr.fop.fsync.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fsync.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fsync.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.setxattr.count": "-4937050471366918144", > "gluster.patchy.aggr.fop.setxattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.setxattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.setxattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.getxattr.count": "-4937050432712212480", > "gluster.patchy.aggr.fop.getxattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.getxattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.getxattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.removexattr.count": "-5071240166115377152", > "gluster.patchy.aggr.fop.removexattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.removexattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.removexattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.opendir.count": "-4937050342517899264", > "gluster.patchy.aggr.fop.opendir.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.opendir.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.opendir.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fsyncdir.count": "-4937050308158160896", > "gluster.patchy.aggr.fop.fsyncdir.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fsyncdir.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fsyncdir.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.access.count": "-4937050269503455232", > "gluster.patchy.aggr.fop.access.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.access.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.access.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.create.count": "-4937050239438684160", > "gluster.patchy.aggr.fop.create.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.create.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.create.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.ftruncate.count": "-5071240166115377152", > "gluster.patchy.aggr.fop.ftruncate.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.ftruncate.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.ftruncate.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fstat.count": "-4937050166424240128", > "gluster.patchy.aggr.fop.fstat.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fstat.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fstat.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.lk.count": "-5070885384636858368", > "gluster.patchy.aggr.fop.lk.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.lk.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.lk.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.lookup.count": "-4937050127769534464", > "gluster.patchy.aggr.fop.lookup.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.lookup.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.lookup.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.readdir.count": "-4937050097704763392", > "gluster.patchy.aggr.fop.readdir.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.readdir.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.readdir.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.inodelk.count": "-4937050063345025024", > "gluster.patchy.aggr.fop.inodelk.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.inodelk.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.inodelk.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.finodelk.count": "-4937050028985286656", > "gluster.patchy.aggr.fop.finodelk.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.finodelk.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.finodelk.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.entrylk.count": "-4937049990330580992", > "gluster.patchy.aggr.fop.entrylk.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.entrylk.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.entrylk.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fentrylk.count": "-4937049955970842624", > "gluster.patchy.aggr.fop.fentrylk.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fentrylk.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fentrylk.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.xattrop.count": "-4937049917316136960", > "gluster.patchy.aggr.fop.xattrop.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.xattrop.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.xattrop.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fxattrop.count": "-4937049882956398592", > "gluster.patchy.aggr.fop.fxattrop.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fxattrop.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fxattrop.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fgetxattr.count": "-5071240166115377152", > "gluster.patchy.aggr.fop.fgetxattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fgetxattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fgetxattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fsetxattr.count": "-5071240166115377152", > "gluster.patchy.aggr.fop.fsetxattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fsetxattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fsetxattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.rchecksum.count": "-5071240166115377152", > "gluster.patchy.aggr.fop.rchecksum.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.rchecksum.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.rchecksum.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.setattr.count": "-4937049715452674048", > "gluster.patchy.aggr.fop.setattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.setattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.setattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fsetattr.count": "-4937049681092935680", > "gluster.patchy.aggr.fop.fsetattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fsetattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fsetattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.readdirp.count": "-4937049642438230016", > "gluster.patchy.aggr.fop.readdirp.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.readdirp.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.readdirp.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.forget.count": "-4937049603783524350", > "gluster.patchy.aggr.fop.forget.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.forget.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.forget.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.release.count": "-4937049573718753280", > "gluster.patchy.aggr.fop.release.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.release.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.release.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.releasedir.count": "-5071240166115377149", > "gluster.patchy.aggr.fop.releasedir.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.releasedir.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.releasedir.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.getspec.count": "-4937049492114374656", > "gluster.patchy.aggr.fop.getspec.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.getspec.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.getspec.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fremovexattr.count": "-5071240166115377152", > "gluster.patchy.aggr.fop.fremovexattr.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fremovexattr.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fremovexattr.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.fallocate.count": "-5071240166115377152", > "gluster.patchy.aggr.fop.fallocate.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.fallocate.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.fallocate.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.discard.count": "-4937049358970388480", > "gluster.patchy.aggr.fop.discard.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.discard.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.discard.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.zerofill.count": "-4937049324610650112", > "gluster.patchy.aggr.fop.zerofill.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.zerofill.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.zerofill.latency_max_usec": "0.00", > "gluster.patchy.aggr.fop.ipc.count": "-5070885384636858368", > "gluster.patchy.aggr.fop.ipc.latency_ave_usec": "0.00", > "gluster.patchy.aggr.fop.ipc.latency_min_usec": "0.00", > "gluster.patchy.aggr.fop.ipc.latency_max_usec": "0.00", > "gluster.patchy.aggr.uptime": "349665", > "gluster.patchy.aggr.bytes_read": "0", > "gluster.patchy.aggr.bytes_written": "11698176" > } > { > "gluster.patchy.inter.read_1b_per_sec": "0.00", > "gluster.patchy.inter.write_1b_per_sec": "0.00", > "gluster.patchy.inter.read_2b_per_sec": "0.00", > "gluster.patchy.inter.write_2b_per_sec": "0.00", > "gluster.patchy.inter.read_4b_per_sec": "0.00", > "gluster.patchy.inter.write_4b_per_sec": "0.00", > "gluster.patchy.inter.read_8b_per_sec": "0.00", > "gluster.patchy.inter.write_8b_per_sec": "0.00", > "gluster.patchy.inter.read_16b_per_sec": "0.00", > "gluster.patchy.inter.write_16b_per_sec": "0.00", > "gluster.patchy.inter.read_32b_per_sec": "0.00", > "gluster.patchy.inter.write_32b_per_sec": "0.00", > "gluster.patchy.inter.read_64b_per_sec": "0.00", > "gluster.patchy.inter.write_64b_per_sec": "0.00", > "gluster.patchy.inter.read_128b_per_sec": "0.00", > "gluster.patchy.inter.write_128b_per_sec": "0.00", > "gluster.patchy.inter.read_256b_per_sec": "0.00", > "gluster.patchy.inter.write_256b_per_sec": "0.00", > "gluster.patchy.inter.read_512b_per_sec": "0.00", > "gluster.patchy.inter.write_512b_per_sec": "0.00", > "gluster.patchy.inter.read_1kb_per_sec": "0.00", > "gluster.patchy.inter.write_1kb_per_sec": "0.00", > "gluster.patchy.inter.read_2kb_per_sec": "0.00", > "gluster.patchy.inter.write_2kb_per_sec": "0.00", > "gluster.patchy.inter.read_4kb_per_sec": "0.00", > "gluster.patchy.inter.write_4kb_per_sec": "0.00", > "gluster.patchy.inter.read_8kb_per_sec": "0.00", > "gluster.patchy.inter.write_8kb_per_sec": "0.00", > "gluster.patchy.inter.read_16kb_per_sec": "0.00", > "gluster.patchy.inter.write_16kb_per_sec": "0.00", > "gluster.patchy.inter.read_32kb_per_sec": "0.00", > "gluster.patchy.inter.write_32kb_per_sec": "0.00", > "gluster.patchy.inter.read_64kb_per_sec": "0.00", > "gluster.patchy.inter.write_64kb_per_sec": "0.00", > "gluster.patchy.inter.read_128kb_per_sec": "0.00", > "gluster.patchy.inter.write_128kb_per_sec": "0.00", > "gluster.patchy.inter.read_256kb_per_sec": "0.00", > "gluster.patchy.inter.write_256kb_per_sec": "0.00", > "gluster.patchy.inter.read_512kb_per_sec": "0.00", > "gluster.patchy.inter.write_512kb_per_sec": "0.00", > "gluster.patchy.inter.read_1mb_per_sec": "0.00", > "gluster.patchy.inter.write_1mb_per_sec": "0.00", > "gluster.patchy.inter.read_2mb_per_sec": "0.00", > "gluster.patchy.inter.write_2mb_per_sec": "0.00", > "gluster.patchy.inter.read_4mb_per_sec": "0.00", > "gluster.patchy.inter.write_4mb_per_sec": "0.00", > "gluster.patchy.inter.read_8mb_per_sec": "0.00", > "gluster.patchy.inter.write_8mb_per_sec": "0.00", > "gluster.patchy.inter.read_16mb_per_sec": "0.00", > "gluster.patchy.inter.write_16mb_per_sec": "0.00", > "gluster.patchy.inter.read_32mb_per_sec": "0.00", > "gluster.patchy.inter.write_32mb_per_sec": "0.00", > "gluster.patchy.inter.read_64mb_per_sec": "0.00", > "gluster.patchy.inter.write_64mb_per_sec": "0.00", > "gluster.patchy.inter.read_128mb_per_sec": "0.00", > "gluster.patchy.inter.write_128mb_per_sec": "0.00", > "gluster.patchy.inter.read_256mb_per_sec": "0.00", > "gluster.patchy.inter.write_256mb_per_sec": "0.00", > "gluster.patchy.inter.read_512mb_per_sec": "0.00", > "gluster.patchy.inter.write_512mb_per_sec": "0.00", > "gluster.patchy.inter.read_1024mb_per_sec": "0.00", > "gluster.patchy.inter.write_1024mb_per_sec": "0.00", > "gluster.patchy.inter.fop.null.per_sec": "0.00", > "gluster.patchy.inter.fop.null.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.null.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.null.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.stat.per_sec": "0.00", > "gluster.patchy.inter.fop.stat.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.stat.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.stat.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.readlink.per_sec": "0.00", > "gluster.patchy.inter.fop.readlink.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.readlink.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.readlink.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.mknod.per_sec": "0.00", > "gluster.patchy.inter.fop.mknod.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.mknod.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.mknod.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.mkdir.per_sec": "0.00", > "gluster.patchy.inter.fop.mkdir.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.mkdir.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.mkdir.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.unlink.per_sec": "0.00", > "gluster.patchy.inter.fop.unlink.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.unlink.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.unlink.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.rmdir.per_sec": "0.00", > "gluster.patchy.inter.fop.rmdir.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.rmdir.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.rmdir.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.symlink.per_sec": "0.00", > "gluster.patchy.inter.fop.symlink.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.symlink.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.symlink.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.rename.per_sec": "0.00", > "gluster.patchy.inter.fop.rename.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.rename.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.rename.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.link.per_sec": "0.00", > "gluster.patchy.inter.fop.link.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.link.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.link.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.truncate.per_sec": "0.00", > "gluster.patchy.inter.fop.truncate.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.truncate.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.truncate.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.open.per_sec": "0.00", > "gluster.patchy.inter.fop.open.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.open.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.open.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.read.per_sec": "0.00", > "gluster.patchy.inter.fop.read.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.read.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.read.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.write.per_sec": "0.00", > "gluster.patchy.inter.fop.write.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.write.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.write.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.statfs.per_sec": "0.00", > "gluster.patchy.inter.fop.statfs.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.statfs.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.statfs.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.flush.per_sec": "0.00", > "gluster.patchy.inter.fop.flush.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.flush.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.flush.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fsync.per_sec": "0.00", > "gluster.patchy.inter.fop.fsync.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fsync.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fsync.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.setxattr.per_sec": "0.00", > "gluster.patchy.inter.fop.setxattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.setxattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.setxattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.getxattr.per_sec": "0.00", > "gluster.patchy.inter.fop.getxattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.getxattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.getxattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.removexattr.per_sec": "0.00", > "gluster.patchy.inter.fop.removexattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.removexattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.removexattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.opendir.per_sec": "0.00", > "gluster.patchy.inter.fop.opendir.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.opendir.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.opendir.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fsyncdir.per_sec": "0.00", > "gluster.patchy.inter.fop.fsyncdir.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fsyncdir.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fsyncdir.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.access.per_sec": "0.00", > "gluster.patchy.inter.fop.access.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.access.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.access.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.create.per_sec": "0.00", > "gluster.patchy.inter.fop.create.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.create.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.create.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.ftruncate.per_sec": "0.00", > "gluster.patchy.inter.fop.ftruncate.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.ftruncate.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.ftruncate.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fstat.per_sec": "0.00", > "gluster.patchy.inter.fop.fstat.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fstat.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fstat.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.lk.per_sec": "0.00", > "gluster.patchy.inter.fop.lk.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.lk.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.lk.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.lookup.per_sec": "0.00", > "gluster.patchy.inter.fop.lookup.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.lookup.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.lookup.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.readdir.per_sec": "0.00", > "gluster.patchy.inter.fop.readdir.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.readdir.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.readdir.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.inodelk.per_sec": "0.00", > "gluster.patchy.inter.fop.inodelk.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.inodelk.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.inodelk.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.finodelk.per_sec": "0.00", > "gluster.patchy.inter.fop.finodelk.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.finodelk.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.finodelk.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.entrylk.per_sec": "0.00", > "gluster.patchy.inter.fop.entrylk.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.entrylk.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.entrylk.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fentrylk.per_sec": "0.00", > "gluster.patchy.inter.fop.fentrylk.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fentrylk.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fentrylk.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.xattrop.per_sec": "0.00", > "gluster.patchy.inter.fop.xattrop.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.xattrop.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.xattrop.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fxattrop.per_sec": "0.00", > "gluster.patchy.inter.fop.fxattrop.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fxattrop.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fxattrop.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fgetxattr.per_sec": "0.00", > "gluster.patchy.inter.fop.fgetxattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fgetxattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fgetxattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fsetxattr.per_sec": "0.00", > "gluster.patchy.inter.fop.fsetxattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fsetxattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fsetxattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.rchecksum.per_sec": "0.00", > "gluster.patchy.inter.fop.rchecksum.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.rchecksum.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.rchecksum.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.setattr.per_sec": "0.00", > "gluster.patchy.inter.fop.setattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.setattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.setattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fsetattr.per_sec": "0.00", > "gluster.patchy.inter.fop.fsetattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fsetattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fsetattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.readdirp.per_sec": "0.00", > "gluster.patchy.inter.fop.readdirp.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.readdirp.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.readdirp.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.forget.per_sec": "0.00", > "gluster.patchy.inter.fop.forget.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.forget.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.forget.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.release.per_sec": "0.00", > "gluster.patchy.inter.fop.release.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.release.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.release.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.releasedir.per_sec": "0.00", > "gluster.patchy.inter.fop.releasedir.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.releasedir.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.releasedir.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.getspec.per_sec": "0.00", > "gluster.patchy.inter.fop.getspec.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.getspec.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.getspec.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fremovexattr.per_sec": "0.00", > "gluster.patchy.inter.fop.fremovexattr.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fremovexattr.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fremovexattr.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.fallocate.per_sec": "0.00", > "gluster.patchy.inter.fop.fallocate.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.fallocate.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.fallocate.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.discard.per_sec": "0.00", > "gluster.patchy.inter.fop.discard.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.discard.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.discard.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.zerofill.per_sec": "0.00", > "gluster.patchy.inter.fop.zerofill.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.zerofill.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.zerofill.latency_max_usec": "0.00", > "gluster.patchy.inter.fop.ipc.per_sec": "0.00", > "gluster.patchy.inter.fop.ipc.latency_ave_usec": "0.00", > "gluster.patchy.inter.fop.ipc.latency_min_usec": "0.00", > "gluster.patchy.inter.fop.ipc.latency_max_usec": "0.00", > "gluster.patchy.inter.sample_interval_sec": "5.01", > "gluster.patchy.inter.bytes_read_per_sec": "0.00", > "gluster.patchy.inter.bytes_written_per_sec": "0.00" > } > > -- > Emmanuel Dreyfus > manu@xxxxxxxxxx > _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-devel _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-devel _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-devel
