On Fri, Jul 22, 2016 at 10:03 AM, Samuli Heinonen <samppah@xxxxxxxxxxxxx> wrote: > Here is a quick way how to test this: > GlusterFS 3.7.13 volume with default settings with brick on ZFS dataset. gluster-test1 is server and gluster-test2 is client mounting with FUSE. > > Writing file with oflag=direct is not ok: > [root@gluster-test2 gluster]# dd if=/dev/zero of=file oflag=direct count=1 bs=1024000 > dd: failed to open ‘file’: Invalid argument > > Enable network.remote-dio on Gluster Volume: > [root@gluster-test1 gluster]# gluster volume set gluster network.remote-dio enable > volume set: success > > Writing small file with oflag=direct is ok: > [root@gluster-test2 gluster]# dd if=/dev/zero of=file oflag=direct count=1 bs=1024000 > 1+0 records in > 1+0 records out > 1024000 bytes (1.0 MB) copied, 0.0103793 s, 98.7 MB/s > > Writing bigger file with oflag=direct is ok: > [root@gluster-test2 gluster]# dd if=/dev/zero of=file3 oflag=direct count=100 bs=1M > 100+0 records in > 100+0 records out > 104857600 bytes (105 MB) copied, 1.10583 s, 94.8 MB/s > > Enable Sharding on Gluster Volume: > [root@gluster-test1 gluster]# gluster volume set gluster features.shard enable > volume set: success > > Writing small file with oflag=direct is ok: > [root@gluster-test2 gluster]# dd if=/dev/zero of=file3 oflag=direct count=1 bs=1M > 1+0 records in > 1+0 records out > 1048576 bytes (1.0 MB) copied, 0.0115247 s, 91.0 MB/s > > Writing bigger file with oflag=direct is not ok: > [root@gluster-test2 gluster]# dd if=/dev/zero of=file3 oflag=direct count=100 bs=1M > dd: error writing ‘file3’: Operation not permitted > dd: closing output file ‘file3’: Operation not permitted > Thank you for these tests! would it be possible to share the brick and client logs? Regards, Vijay _______________________________________________ Gluster-devel mailing list Gluster-devel@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-devel